00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 1003 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3670 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.074 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.075 The recommended git tool is: git 00:00:00.075 using credential 00000000-0000-0000-0000-000000000002 00:00:00.077 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.103 Fetching changes from the remote Git repository 00:00:00.105 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.138 Using shallow fetch with depth 1 00:00:00.138 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.138 > git --version # timeout=10 00:00:00.159 > git --version # 'git version 2.39.2' 00:00:00.159 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.175 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.175 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.556 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.568 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.579 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:04.579 > git config core.sparsecheckout # timeout=10 00:00:04.590 > git read-tree -mu HEAD # timeout=10 00:00:04.604 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:04.628 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:04.628 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:04.738 [Pipeline] Start of Pipeline 00:00:04.749 [Pipeline] library 00:00:04.750 Loading library shm_lib@master 00:00:04.750 Library shm_lib@master is cached. Copying from home. 00:00:04.761 [Pipeline] node 00:00:04.766 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.768 [Pipeline] { 00:00:04.774 [Pipeline] catchError 00:00:04.775 [Pipeline] { 00:00:04.783 [Pipeline] wrap 00:00:04.788 [Pipeline] { 00:00:04.793 [Pipeline] stage 00:00:04.794 [Pipeline] { (Prologue) 00:00:04.938 [Pipeline] sh 00:00:05.218 + logger -p user.info -t JENKINS-CI 00:00:05.236 [Pipeline] echo 00:00:05.238 Node: GP11 00:00:05.244 [Pipeline] sh 00:00:05.541 [Pipeline] setCustomBuildProperty 00:00:05.552 [Pipeline] echo 00:00:05.553 Cleanup processes 00:00:05.558 [Pipeline] sh 00:00:05.842 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.842 1858533 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.855 [Pipeline] sh 00:00:06.138 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.138 ++ grep -v 'sudo pgrep' 00:00:06.138 ++ awk '{print $1}' 00:00:06.138 + sudo kill -9 00:00:06.138 + true 00:00:06.151 [Pipeline] cleanWs 00:00:06.160 [WS-CLEANUP] Deleting project workspace... 00:00:06.160 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.166 [WS-CLEANUP] done 00:00:06.170 [Pipeline] setCustomBuildProperty 00:00:06.186 [Pipeline] sh 00:00:06.469 + sudo git config --global --replace-all safe.directory '*' 00:00:06.558 [Pipeline] httpRequest 00:00:06.839 [Pipeline] echo 00:00:06.840 Sorcerer 10.211.164.20 is alive 00:00:06.846 [Pipeline] retry 00:00:06.848 [Pipeline] { 00:00:06.859 [Pipeline] httpRequest 00:00:06.862 HttpMethod: GET 00:00:06.863 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:06.863 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:06.866 Response Code: HTTP/1.1 200 OK 00:00:06.866 Success: Status code 200 is in the accepted range: 200,404 00:00:06.866 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.896 [Pipeline] } 00:00:07.916 [Pipeline] // retry 00:00:07.926 [Pipeline] sh 00:00:08.209 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.227 [Pipeline] httpRequest 00:00:08.590 [Pipeline] echo 00:00:08.592 Sorcerer 10.211.164.20 is alive 00:00:08.602 [Pipeline] retry 00:00:08.604 [Pipeline] { 00:00:08.617 [Pipeline] httpRequest 00:00:08.622 HttpMethod: GET 00:00:08.622 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:08.623 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:08.643 Response Code: HTTP/1.1 200 OK 00:00:08.643 Success: Status code 200 is in the accepted range: 200,404 00:00:08.644 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:13.042 [Pipeline] } 00:01:13.061 [Pipeline] // retry 00:01:13.070 [Pipeline] sh 00:01:13.360 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:16.653 [Pipeline] sh 00:01:16.952 + git -C spdk log --oneline -n5 00:01:16.952 c13c99a5e test: Various fixes for Fedora40 00:01:16.952 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:16.952 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:16.952 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:16.952 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:16.971 [Pipeline] withCredentials 00:01:16.980 > git --version # timeout=10 00:01:16.992 > git --version # 'git version 2.39.2' 00:01:17.006 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:17.008 [Pipeline] { 00:01:17.037 [Pipeline] retry 00:01:17.039 [Pipeline] { 00:01:17.055 [Pipeline] sh 00:01:17.337 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:17.608 [Pipeline] } 00:01:17.627 [Pipeline] // retry 00:01:17.632 [Pipeline] } 00:01:17.647 [Pipeline] // withCredentials 00:01:17.655 [Pipeline] httpRequest 00:01:17.973 [Pipeline] echo 00:01:17.975 Sorcerer 10.211.164.20 is alive 00:01:17.984 [Pipeline] retry 00:01:17.985 [Pipeline] { 00:01:17.997 [Pipeline] httpRequest 00:01:18.001 HttpMethod: GET 00:01:18.001 URL: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:18.002 Sending request to url: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:18.006 Response Code: HTTP/1.1 200 OK 00:01:18.006 Success: Status code 200 is in the accepted range: 200,404 00:01:18.007 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:24.576 [Pipeline] } 00:01:24.593 [Pipeline] // retry 00:01:24.601 [Pipeline] sh 00:01:24.886 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:26.275 [Pipeline] sh 00:01:26.556 + git -C dpdk log --oneline -n5 00:01:26.556 caf0f5d395 version: 22.11.4 00:01:26.556 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:26.556 dc9c799c7d vhost: fix missing spinlock unlock 00:01:26.556 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:26.556 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:26.566 [Pipeline] } 00:01:26.579 [Pipeline] // stage 00:01:26.589 [Pipeline] stage 00:01:26.591 [Pipeline] { (Prepare) 00:01:26.613 [Pipeline] writeFile 00:01:26.629 [Pipeline] sh 00:01:26.909 + logger -p user.info -t JENKINS-CI 00:01:26.921 [Pipeline] sh 00:01:27.203 + logger -p user.info -t JENKINS-CI 00:01:27.214 [Pipeline] sh 00:01:27.494 + cat autorun-spdk.conf 00:01:27.494 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.494 SPDK_TEST_NVMF=1 00:01:27.494 SPDK_TEST_NVME_CLI=1 00:01:27.494 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.494 SPDK_TEST_NVMF_NICS=e810 00:01:27.494 SPDK_TEST_VFIOUSER=1 00:01:27.494 SPDK_RUN_UBSAN=1 00:01:27.494 NET_TYPE=phy 00:01:27.494 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:27.494 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:27.500 RUN_NIGHTLY=1 00:01:27.505 [Pipeline] readFile 00:01:27.529 [Pipeline] withEnv 00:01:27.531 [Pipeline] { 00:01:27.543 [Pipeline] sh 00:01:27.826 + set -ex 00:01:27.826 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:27.826 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:27.826 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:27.826 ++ SPDK_TEST_NVMF=1 00:01:27.826 ++ SPDK_TEST_NVME_CLI=1 00:01:27.826 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:27.826 ++ SPDK_TEST_NVMF_NICS=e810 00:01:27.826 ++ SPDK_TEST_VFIOUSER=1 00:01:27.826 ++ SPDK_RUN_UBSAN=1 00:01:27.826 ++ NET_TYPE=phy 00:01:27.826 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:27.826 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:27.826 ++ RUN_NIGHTLY=1 00:01:27.826 + case $SPDK_TEST_NVMF_NICS in 00:01:27.826 + DRIVERS=ice 00:01:27.826 + [[ tcp == \r\d\m\a ]] 00:01:27.826 + [[ -n ice ]] 00:01:27.826 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:27.826 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:27.826 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:27.826 rmmod: ERROR: Module irdma is not currently loaded 00:01:27.826 rmmod: ERROR: Module i40iw is not currently loaded 00:01:27.826 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:27.826 + true 00:01:27.826 + for D in $DRIVERS 00:01:27.826 + sudo modprobe ice 00:01:27.826 + exit 0 00:01:27.835 [Pipeline] } 00:01:27.850 [Pipeline] // withEnv 00:01:27.855 [Pipeline] } 00:01:27.868 [Pipeline] // stage 00:01:27.877 [Pipeline] catchError 00:01:27.878 [Pipeline] { 00:01:27.892 [Pipeline] timeout 00:01:27.892 Timeout set to expire in 1 hr 0 min 00:01:27.894 [Pipeline] { 00:01:27.908 [Pipeline] stage 00:01:27.910 [Pipeline] { (Tests) 00:01:27.924 [Pipeline] sh 00:01:28.206 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.206 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.206 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.206 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:28.206 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:28.206 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:28.206 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:28.206 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:28.206 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:28.206 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:28.206 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:28.206 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:28.206 + source /etc/os-release 00:01:28.206 ++ NAME='Fedora Linux' 00:01:28.206 ++ VERSION='39 (Cloud Edition)' 00:01:28.206 ++ ID=fedora 00:01:28.206 ++ VERSION_ID=39 00:01:28.206 ++ VERSION_CODENAME= 00:01:28.206 ++ PLATFORM_ID=platform:f39 00:01:28.206 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:28.206 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:28.206 ++ LOGO=fedora-logo-icon 00:01:28.206 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:28.206 ++ HOME_URL=https://fedoraproject.org/ 00:01:28.206 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:28.206 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:28.206 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:28.206 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:28.206 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:28.206 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:28.206 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:28.206 ++ SUPPORT_END=2024-11-12 00:01:28.206 ++ VARIANT='Cloud Edition' 00:01:28.206 ++ VARIANT_ID=cloud 00:01:28.206 + uname -a 00:01:28.206 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:28.206 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:29.141 Hugepages 00:01:29.141 node hugesize free / total 00:01:29.141 node0 1048576kB 0 / 0 00:01:29.141 node0 2048kB 0 / 0 00:01:29.141 node1 1048576kB 0 / 0 00:01:29.141 node1 2048kB 0 / 0 00:01:29.141 00:01:29.141 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:29.141 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:29.141 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:29.141 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:29.400 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:29.400 + rm -f /tmp/spdk-ld-path 00:01:29.400 + source autorun-spdk.conf 00:01:29.400 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.400 ++ SPDK_TEST_NVMF=1 00:01:29.400 ++ SPDK_TEST_NVME_CLI=1 00:01:29.400 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.400 ++ SPDK_TEST_NVMF_NICS=e810 00:01:29.400 ++ SPDK_TEST_VFIOUSER=1 00:01:29.400 ++ SPDK_RUN_UBSAN=1 00:01:29.400 ++ NET_TYPE=phy 00:01:29.400 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:29.400 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.400 ++ RUN_NIGHTLY=1 00:01:29.400 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:29.400 + [[ -n '' ]] 00:01:29.400 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.400 + for M in /var/spdk/build-*-manifest.txt 00:01:29.400 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:29.400 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.400 + for M in /var/spdk/build-*-manifest.txt 00:01:29.400 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:29.400 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.400 + for M in /var/spdk/build-*-manifest.txt 00:01:29.400 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:29.400 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:29.400 ++ uname 00:01:29.400 + [[ Linux == \L\i\n\u\x ]] 00:01:29.400 + sudo dmesg -T 00:01:29.400 + sudo dmesg --clear 00:01:29.400 + dmesg_pid=1859851 00:01:29.400 + [[ Fedora Linux == FreeBSD ]] 00:01:29.400 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.400 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.400 + sudo dmesg -Tw 00:01:29.400 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:29.400 + [[ -x /usr/src/fio-static/fio ]] 00:01:29.400 + export FIO_BIN=/usr/src/fio-static/fio 00:01:29.400 + FIO_BIN=/usr/src/fio-static/fio 00:01:29.400 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:29.400 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:29.400 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:29.400 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.400 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.400 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:29.400 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.400 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.400 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:29.400 Test configuration: 00:01:29.400 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.400 SPDK_TEST_NVMF=1 00:01:29.400 SPDK_TEST_NVME_CLI=1 00:01:29.400 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.400 SPDK_TEST_NVMF_NICS=e810 00:01:29.400 SPDK_TEST_VFIOUSER=1 00:01:29.400 SPDK_RUN_UBSAN=1 00:01:29.400 NET_TYPE=phy 00:01:29.400 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:29.400 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.400 RUN_NIGHTLY=1 02:12:53 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:29.400 02:12:53 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:29.400 02:12:53 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:29.400 02:12:53 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:29.400 02:12:53 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:29.400 02:12:53 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.400 02:12:53 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.400 02:12:53 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.400 02:12:53 -- paths/export.sh@5 -- $ export PATH 00:01:29.400 02:12:53 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.400 02:12:53 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:29.400 02:12:53 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:29.400 02:12:53 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732669973.XXXXXX 00:01:29.400 02:12:53 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732669973.ZrYNOT 00:01:29.400 02:12:53 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:29.400 02:12:53 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:29.400 02:12:53 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.400 02:12:53 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:29.400 02:12:53 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:29.400 02:12:53 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:29.400 02:12:53 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:29.400 02:12:53 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:29.400 02:12:53 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.400 02:12:53 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:29.401 02:12:53 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:29.401 02:12:53 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:29.401 02:12:53 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.401 02:12:53 -- spdk/autobuild.sh@16 -- $ date -u 00:01:29.401 Wed Nov 27 01:12:53 AM UTC 2024 00:01:29.401 02:12:53 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:29.401 LTS-67-gc13c99a5e 00:01:29.401 02:12:53 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:29.401 02:12:53 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:29.401 02:12:53 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:29.401 02:12:53 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:29.401 02:12:53 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:29.401 02:12:53 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.401 ************************************ 00:01:29.401 START TEST ubsan 00:01:29.401 ************************************ 00:01:29.401 02:12:53 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:29.401 using ubsan 00:01:29.401 00:01:29.401 real 0m0.000s 00:01:29.401 user 0m0.000s 00:01:29.401 sys 0m0.000s 00:01:29.401 02:12:53 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:29.401 02:12:53 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.401 ************************************ 00:01:29.401 END TEST ubsan 00:01:29.401 ************************************ 00:01:29.401 02:12:53 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:29.401 02:12:53 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:29.401 02:12:53 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:29.401 02:12:53 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:29.401 02:12:53 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:29.401 02:12:53 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.401 ************************************ 00:01:29.401 START TEST build_native_dpdk 00:01:29.401 ************************************ 00:01:29.401 02:12:53 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:29.401 02:12:53 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:29.401 02:12:53 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:29.401 02:12:53 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:29.401 02:12:53 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:29.401 02:12:53 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:29.401 02:12:53 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:29.401 02:12:53 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:29.401 02:12:53 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:29.401 02:12:53 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:29.401 02:12:53 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:29.401 02:12:53 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:29.401 02:12:53 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:29.401 02:12:54 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:29.401 02:12:54 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:29.401 02:12:54 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.401 02:12:54 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.401 02:12:54 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:29.401 02:12:54 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:29.401 02:12:54 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:29.401 caf0f5d395 version: 22.11.4 00:01:29.401 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:29.401 dc9c799c7d vhost: fix missing spinlock unlock 00:01:29.401 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:29.401 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:29.401 02:12:54 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:29.401 02:12:54 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:29.401 02:12:54 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:29.401 02:12:54 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:29.401 02:12:54 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:29.401 02:12:54 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:29.401 02:12:54 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:29.401 02:12:54 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:29.401 02:12:54 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:29.401 02:12:54 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:29.401 02:12:54 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:29.401 02:12:54 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:29.401 02:12:54 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:29.401 02:12:54 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:29.401 02:12:54 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:29.401 02:12:54 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:29.401 02:12:54 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:29.401 02:12:54 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:29.401 02:12:54 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:29.401 02:12:54 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:29.401 02:12:54 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:29.401 02:12:54 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:29.401 02:12:54 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:29.401 02:12:54 -- scripts/common.sh@343 -- $ case "$op" in 00:01:29.401 02:12:54 -- scripts/common.sh@344 -- $ : 1 00:01:29.401 02:12:54 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:29.401 02:12:54 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:29.401 02:12:54 -- scripts/common.sh@364 -- $ decimal 22 00:01:29.401 02:12:54 -- scripts/common.sh@352 -- $ local d=22 00:01:29.401 02:12:54 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:29.401 02:12:54 -- scripts/common.sh@354 -- $ echo 22 00:01:29.401 02:12:54 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:29.401 02:12:54 -- scripts/common.sh@365 -- $ decimal 21 00:01:29.401 02:12:54 -- scripts/common.sh@352 -- $ local d=21 00:01:29.401 02:12:54 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:29.401 02:12:54 -- scripts/common.sh@354 -- $ echo 21 00:01:29.401 02:12:54 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:29.401 02:12:54 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:29.401 02:12:54 -- scripts/common.sh@366 -- $ return 1 00:01:29.401 02:12:54 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:29.401 patching file config/rte_config.h 00:01:29.401 Hunk #1 succeeded at 60 (offset 1 line). 00:01:29.401 02:12:54 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:29.401 02:12:54 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:29.401 02:12:54 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:29.401 02:12:54 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:29.401 02:12:54 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:29.401 02:12:54 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:29.401 02:12:54 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:29.401 02:12:54 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:29.401 02:12:54 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:29.401 02:12:54 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:29.401 02:12:54 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:29.401 02:12:54 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:29.401 02:12:54 -- scripts/common.sh@343 -- $ case "$op" in 00:01:29.401 02:12:54 -- scripts/common.sh@344 -- $ : 1 00:01:29.401 02:12:54 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:29.401 02:12:54 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:29.401 02:12:54 -- scripts/common.sh@364 -- $ decimal 22 00:01:29.401 02:12:54 -- scripts/common.sh@352 -- $ local d=22 00:01:29.401 02:12:54 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:29.401 02:12:54 -- scripts/common.sh@354 -- $ echo 22 00:01:29.401 02:12:54 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:29.401 02:12:54 -- scripts/common.sh@365 -- $ decimal 24 00:01:29.660 02:12:54 -- scripts/common.sh@352 -- $ local d=24 00:01:29.660 02:12:54 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:29.660 02:12:54 -- scripts/common.sh@354 -- $ echo 24 00:01:29.660 02:12:54 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:29.660 02:12:54 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:29.660 02:12:54 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:29.660 02:12:54 -- scripts/common.sh@367 -- $ return 0 00:01:29.660 02:12:54 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:29.660 patching file lib/pcapng/rte_pcapng.c 00:01:29.660 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:29.660 02:12:54 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:29.660 02:12:54 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:29.660 02:12:54 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:29.660 02:12:54 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:29.660 02:12:54 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:33.849 The Meson build system 00:01:33.849 Version: 1.5.0 00:01:33.849 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:33.849 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:33.849 Build type: native build 00:01:33.849 Program cat found: YES (/usr/bin/cat) 00:01:33.849 Project name: DPDK 00:01:33.849 Project version: 22.11.4 00:01:33.849 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:33.849 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:33.849 Host machine cpu family: x86_64 00:01:33.849 Host machine cpu: x86_64 00:01:33.849 Message: ## Building in Developer Mode ## 00:01:33.849 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:33.849 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:33.849 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:33.849 Program objdump found: YES (/usr/bin/objdump) 00:01:33.849 Program python3 found: YES (/usr/bin/python3) 00:01:33.849 Program cat found: YES (/usr/bin/cat) 00:01:33.849 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:33.849 Checking for size of "void *" : 8 00:01:33.849 Checking for size of "void *" : 8 (cached) 00:01:33.849 Library m found: YES 00:01:33.849 Library numa found: YES 00:01:33.849 Has header "numaif.h" : YES 00:01:33.849 Library fdt found: NO 00:01:33.849 Library execinfo found: NO 00:01:33.849 Has header "execinfo.h" : YES 00:01:33.849 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:33.849 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:33.849 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:33.849 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:33.849 Run-time dependency openssl found: YES 3.1.1 00:01:33.849 Run-time dependency libpcap found: YES 1.10.4 00:01:33.849 Has header "pcap.h" with dependency libpcap: YES 00:01:33.849 Compiler for C supports arguments -Wcast-qual: YES 00:01:33.849 Compiler for C supports arguments -Wdeprecated: YES 00:01:33.849 Compiler for C supports arguments -Wformat: YES 00:01:33.849 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:33.849 Compiler for C supports arguments -Wformat-security: NO 00:01:33.849 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:33.849 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:33.849 Compiler for C supports arguments -Wnested-externs: YES 00:01:33.849 Compiler for C supports arguments -Wold-style-definition: YES 00:01:33.849 Compiler for C supports arguments -Wpointer-arith: YES 00:01:33.849 Compiler for C supports arguments -Wsign-compare: YES 00:01:33.849 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:33.849 Compiler for C supports arguments -Wundef: YES 00:01:33.849 Compiler for C supports arguments -Wwrite-strings: YES 00:01:33.849 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:33.849 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:33.849 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:33.849 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:33.849 Compiler for C supports arguments -mavx512f: YES 00:01:33.849 Checking if "AVX512 checking" compiles: YES 00:01:33.849 Fetching value of define "__SSE4_2__" : 1 00:01:33.849 Fetching value of define "__AES__" : 1 00:01:33.850 Fetching value of define "__AVX__" : 1 00:01:33.850 Fetching value of define "__AVX2__" : (undefined) 00:01:33.850 Fetching value of define "__AVX512BW__" : (undefined) 00:01:33.850 Fetching value of define "__AVX512CD__" : (undefined) 00:01:33.850 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:33.850 Fetching value of define "__AVX512F__" : (undefined) 00:01:33.850 Fetching value of define "__AVX512VL__" : (undefined) 00:01:33.850 Fetching value of define "__PCLMUL__" : 1 00:01:33.850 Fetching value of define "__RDRND__" : 1 00:01:33.850 Fetching value of define "__RDSEED__" : (undefined) 00:01:33.850 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:33.850 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:33.850 Message: lib/kvargs: Defining dependency "kvargs" 00:01:33.850 Message: lib/telemetry: Defining dependency "telemetry" 00:01:33.850 Checking for function "getentropy" : YES 00:01:33.850 Message: lib/eal: Defining dependency "eal" 00:01:33.850 Message: lib/ring: Defining dependency "ring" 00:01:33.850 Message: lib/rcu: Defining dependency "rcu" 00:01:33.850 Message: lib/mempool: Defining dependency "mempool" 00:01:33.850 Message: lib/mbuf: Defining dependency "mbuf" 00:01:33.850 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:33.850 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:33.850 Compiler for C supports arguments -mpclmul: YES 00:01:33.850 Compiler for C supports arguments -maes: YES 00:01:33.850 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:33.850 Compiler for C supports arguments -mavx512bw: YES 00:01:33.850 Compiler for C supports arguments -mavx512dq: YES 00:01:33.850 Compiler for C supports arguments -mavx512vl: YES 00:01:33.850 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:33.850 Compiler for C supports arguments -mavx2: YES 00:01:33.850 Compiler for C supports arguments -mavx: YES 00:01:33.850 Message: lib/net: Defining dependency "net" 00:01:33.850 Message: lib/meter: Defining dependency "meter" 00:01:33.850 Message: lib/ethdev: Defining dependency "ethdev" 00:01:33.850 Message: lib/pci: Defining dependency "pci" 00:01:33.850 Message: lib/cmdline: Defining dependency "cmdline" 00:01:33.850 Message: lib/metrics: Defining dependency "metrics" 00:01:33.850 Message: lib/hash: Defining dependency "hash" 00:01:33.850 Message: lib/timer: Defining dependency "timer" 00:01:33.850 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:33.850 Compiler for C supports arguments -mavx2: YES (cached) 00:01:33.850 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:33.850 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:33.850 Message: lib/acl: Defining dependency "acl" 00:01:33.850 Message: lib/bbdev: Defining dependency "bbdev" 00:01:33.850 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:33.850 Run-time dependency libelf found: YES 0.191 00:01:33.850 Message: lib/bpf: Defining dependency "bpf" 00:01:33.850 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:33.850 Message: lib/compressdev: Defining dependency "compressdev" 00:01:33.850 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:33.850 Message: lib/distributor: Defining dependency "distributor" 00:01:33.850 Message: lib/efd: Defining dependency "efd" 00:01:33.850 Message: lib/eventdev: Defining dependency "eventdev" 00:01:33.850 Message: lib/gpudev: Defining dependency "gpudev" 00:01:33.850 Message: lib/gro: Defining dependency "gro" 00:01:33.850 Message: lib/gso: Defining dependency "gso" 00:01:33.850 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:33.850 Message: lib/jobstats: Defining dependency "jobstats" 00:01:33.850 Message: lib/latencystats: Defining dependency "latencystats" 00:01:33.850 Message: lib/lpm: Defining dependency "lpm" 00:01:33.850 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:33.850 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:33.850 Message: lib/member: Defining dependency "member" 00:01:33.850 Message: lib/pcapng: Defining dependency "pcapng" 00:01:33.850 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:33.850 Message: lib/power: Defining dependency "power" 00:01:33.850 Message: lib/rawdev: Defining dependency "rawdev" 00:01:33.850 Message: lib/regexdev: Defining dependency "regexdev" 00:01:33.850 Message: lib/dmadev: Defining dependency "dmadev" 00:01:33.850 Message: lib/rib: Defining dependency "rib" 00:01:33.850 Message: lib/reorder: Defining dependency "reorder" 00:01:33.850 Message: lib/sched: Defining dependency "sched" 00:01:33.850 Message: lib/security: Defining dependency "security" 00:01:33.850 Message: lib/stack: Defining dependency "stack" 00:01:33.850 Has header "linux/userfaultfd.h" : YES 00:01:33.850 Message: lib/vhost: Defining dependency "vhost" 00:01:33.850 Message: lib/ipsec: Defining dependency "ipsec" 00:01:33.850 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:33.850 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:33.850 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:33.850 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:33.850 Message: lib/fib: Defining dependency "fib" 00:01:33.850 Message: lib/port: Defining dependency "port" 00:01:33.850 Message: lib/pdump: Defining dependency "pdump" 00:01:33.850 Message: lib/table: Defining dependency "table" 00:01:33.850 Message: lib/pipeline: Defining dependency "pipeline" 00:01:33.850 Message: lib/graph: Defining dependency "graph" 00:01:33.850 Message: lib/node: Defining dependency "node" 00:01:33.850 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:33.850 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:33.850 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:33.850 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:33.850 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:33.850 Compiler for C supports arguments -Wno-unused-value: YES 00:01:35.753 Compiler for C supports arguments -Wno-format: YES 00:01:35.753 Compiler for C supports arguments -Wno-format-security: YES 00:01:35.753 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:35.753 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:35.753 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:35.753 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:35.753 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:35.753 Compiler for C supports arguments -mavx2: YES (cached) 00:01:35.753 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:35.753 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:35.753 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:35.753 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:35.753 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:35.753 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:35.753 Configuring doxy-api.conf using configuration 00:01:35.753 Program sphinx-build found: NO 00:01:35.753 Configuring rte_build_config.h using configuration 00:01:35.753 Message: 00:01:35.753 ================= 00:01:35.753 Applications Enabled 00:01:35.753 ================= 00:01:35.753 00:01:35.753 apps: 00:01:35.753 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:35.753 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:35.753 test-security-perf, 00:01:35.753 00:01:35.753 Message: 00:01:35.753 ================= 00:01:35.753 Libraries Enabled 00:01:35.753 ================= 00:01:35.753 00:01:35.753 libs: 00:01:35.753 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:35.753 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:35.753 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:35.753 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:35.753 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:35.753 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:35.753 table, pipeline, graph, node, 00:01:35.753 00:01:35.753 Message: 00:01:35.753 =============== 00:01:35.753 Drivers Enabled 00:01:35.753 =============== 00:01:35.753 00:01:35.753 common: 00:01:35.753 00:01:35.753 bus: 00:01:35.753 pci, vdev, 00:01:35.753 mempool: 00:01:35.753 ring, 00:01:35.753 dma: 00:01:35.753 00:01:35.753 net: 00:01:35.753 i40e, 00:01:35.753 raw: 00:01:35.753 00:01:35.753 crypto: 00:01:35.753 00:01:35.753 compress: 00:01:35.753 00:01:35.753 regex: 00:01:35.753 00:01:35.753 vdpa: 00:01:35.753 00:01:35.753 event: 00:01:35.753 00:01:35.753 baseband: 00:01:35.753 00:01:35.753 gpu: 00:01:35.753 00:01:35.753 00:01:35.753 Message: 00:01:35.753 ================= 00:01:35.753 Content Skipped 00:01:35.753 ================= 00:01:35.753 00:01:35.753 apps: 00:01:35.753 00:01:35.753 libs: 00:01:35.753 kni: explicitly disabled via build config (deprecated lib) 00:01:35.753 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:35.753 00:01:35.753 drivers: 00:01:35.753 common/cpt: not in enabled drivers build config 00:01:35.753 common/dpaax: not in enabled drivers build config 00:01:35.753 common/iavf: not in enabled drivers build config 00:01:35.753 common/idpf: not in enabled drivers build config 00:01:35.753 common/mvep: not in enabled drivers build config 00:01:35.753 common/octeontx: not in enabled drivers build config 00:01:35.753 bus/auxiliary: not in enabled drivers build config 00:01:35.753 bus/dpaa: not in enabled drivers build config 00:01:35.753 bus/fslmc: not in enabled drivers build config 00:01:35.753 bus/ifpga: not in enabled drivers build config 00:01:35.753 bus/vmbus: not in enabled drivers build config 00:01:35.753 common/cnxk: not in enabled drivers build config 00:01:35.753 common/mlx5: not in enabled drivers build config 00:01:35.753 common/qat: not in enabled drivers build config 00:01:35.753 common/sfc_efx: not in enabled drivers build config 00:01:35.753 mempool/bucket: not in enabled drivers build config 00:01:35.754 mempool/cnxk: not in enabled drivers build config 00:01:35.754 mempool/dpaa: not in enabled drivers build config 00:01:35.754 mempool/dpaa2: not in enabled drivers build config 00:01:35.754 mempool/octeontx: not in enabled drivers build config 00:01:35.754 mempool/stack: not in enabled drivers build config 00:01:35.754 dma/cnxk: not in enabled drivers build config 00:01:35.754 dma/dpaa: not in enabled drivers build config 00:01:35.754 dma/dpaa2: not in enabled drivers build config 00:01:35.754 dma/hisilicon: not in enabled drivers build config 00:01:35.754 dma/idxd: not in enabled drivers build config 00:01:35.754 dma/ioat: not in enabled drivers build config 00:01:35.754 dma/skeleton: not in enabled drivers build config 00:01:35.754 net/af_packet: not in enabled drivers build config 00:01:35.754 net/af_xdp: not in enabled drivers build config 00:01:35.754 net/ark: not in enabled drivers build config 00:01:35.754 net/atlantic: not in enabled drivers build config 00:01:35.754 net/avp: not in enabled drivers build config 00:01:35.754 net/axgbe: not in enabled drivers build config 00:01:35.754 net/bnx2x: not in enabled drivers build config 00:01:35.754 net/bnxt: not in enabled drivers build config 00:01:35.754 net/bonding: not in enabled drivers build config 00:01:35.754 net/cnxk: not in enabled drivers build config 00:01:35.754 net/cxgbe: not in enabled drivers build config 00:01:35.754 net/dpaa: not in enabled drivers build config 00:01:35.754 net/dpaa2: not in enabled drivers build config 00:01:35.754 net/e1000: not in enabled drivers build config 00:01:35.754 net/ena: not in enabled drivers build config 00:01:35.754 net/enetc: not in enabled drivers build config 00:01:35.754 net/enetfec: not in enabled drivers build config 00:01:35.754 net/enic: not in enabled drivers build config 00:01:35.754 net/failsafe: not in enabled drivers build config 00:01:35.754 net/fm10k: not in enabled drivers build config 00:01:35.754 net/gve: not in enabled drivers build config 00:01:35.754 net/hinic: not in enabled drivers build config 00:01:35.754 net/hns3: not in enabled drivers build config 00:01:35.754 net/iavf: not in enabled drivers build config 00:01:35.754 net/ice: not in enabled drivers build config 00:01:35.754 net/idpf: not in enabled drivers build config 00:01:35.754 net/igc: not in enabled drivers build config 00:01:35.754 net/ionic: not in enabled drivers build config 00:01:35.754 net/ipn3ke: not in enabled drivers build config 00:01:35.754 net/ixgbe: not in enabled drivers build config 00:01:35.754 net/kni: not in enabled drivers build config 00:01:35.754 net/liquidio: not in enabled drivers build config 00:01:35.754 net/mana: not in enabled drivers build config 00:01:35.754 net/memif: not in enabled drivers build config 00:01:35.754 net/mlx4: not in enabled drivers build config 00:01:35.754 net/mlx5: not in enabled drivers build config 00:01:35.754 net/mvneta: not in enabled drivers build config 00:01:35.754 net/mvpp2: not in enabled drivers build config 00:01:35.754 net/netvsc: not in enabled drivers build config 00:01:35.754 net/nfb: not in enabled drivers build config 00:01:35.754 net/nfp: not in enabled drivers build config 00:01:35.754 net/ngbe: not in enabled drivers build config 00:01:35.754 net/null: not in enabled drivers build config 00:01:35.754 net/octeontx: not in enabled drivers build config 00:01:35.754 net/octeon_ep: not in enabled drivers build config 00:01:35.754 net/pcap: not in enabled drivers build config 00:01:35.754 net/pfe: not in enabled drivers build config 00:01:35.754 net/qede: not in enabled drivers build config 00:01:35.754 net/ring: not in enabled drivers build config 00:01:35.754 net/sfc: not in enabled drivers build config 00:01:35.754 net/softnic: not in enabled drivers build config 00:01:35.754 net/tap: not in enabled drivers build config 00:01:35.754 net/thunderx: not in enabled drivers build config 00:01:35.754 net/txgbe: not in enabled drivers build config 00:01:35.754 net/vdev_netvsc: not in enabled drivers build config 00:01:35.754 net/vhost: not in enabled drivers build config 00:01:35.754 net/virtio: not in enabled drivers build config 00:01:35.754 net/vmxnet3: not in enabled drivers build config 00:01:35.754 raw/cnxk_bphy: not in enabled drivers build config 00:01:35.754 raw/cnxk_gpio: not in enabled drivers build config 00:01:35.754 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:35.754 raw/ifpga: not in enabled drivers build config 00:01:35.754 raw/ntb: not in enabled drivers build config 00:01:35.754 raw/skeleton: not in enabled drivers build config 00:01:35.754 crypto/armv8: not in enabled drivers build config 00:01:35.754 crypto/bcmfs: not in enabled drivers build config 00:01:35.754 crypto/caam_jr: not in enabled drivers build config 00:01:35.754 crypto/ccp: not in enabled drivers build config 00:01:35.754 crypto/cnxk: not in enabled drivers build config 00:01:35.754 crypto/dpaa_sec: not in enabled drivers build config 00:01:35.754 crypto/dpaa2_sec: not in enabled drivers build config 00:01:35.754 crypto/ipsec_mb: not in enabled drivers build config 00:01:35.754 crypto/mlx5: not in enabled drivers build config 00:01:35.754 crypto/mvsam: not in enabled drivers build config 00:01:35.754 crypto/nitrox: not in enabled drivers build config 00:01:35.754 crypto/null: not in enabled drivers build config 00:01:35.754 crypto/octeontx: not in enabled drivers build config 00:01:35.754 crypto/openssl: not in enabled drivers build config 00:01:35.754 crypto/scheduler: not in enabled drivers build config 00:01:35.754 crypto/uadk: not in enabled drivers build config 00:01:35.754 crypto/virtio: not in enabled drivers build config 00:01:35.754 compress/isal: not in enabled drivers build config 00:01:35.754 compress/mlx5: not in enabled drivers build config 00:01:35.754 compress/octeontx: not in enabled drivers build config 00:01:35.754 compress/zlib: not in enabled drivers build config 00:01:35.754 regex/mlx5: not in enabled drivers build config 00:01:35.754 regex/cn9k: not in enabled drivers build config 00:01:35.754 vdpa/ifc: not in enabled drivers build config 00:01:35.754 vdpa/mlx5: not in enabled drivers build config 00:01:35.754 vdpa/sfc: not in enabled drivers build config 00:01:35.754 event/cnxk: not in enabled drivers build config 00:01:35.754 event/dlb2: not in enabled drivers build config 00:01:35.754 event/dpaa: not in enabled drivers build config 00:01:35.754 event/dpaa2: not in enabled drivers build config 00:01:35.754 event/dsw: not in enabled drivers build config 00:01:35.754 event/opdl: not in enabled drivers build config 00:01:35.754 event/skeleton: not in enabled drivers build config 00:01:35.754 event/sw: not in enabled drivers build config 00:01:35.754 event/octeontx: not in enabled drivers build config 00:01:35.754 baseband/acc: not in enabled drivers build config 00:01:35.754 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:35.754 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:35.754 baseband/la12xx: not in enabled drivers build config 00:01:35.754 baseband/null: not in enabled drivers build config 00:01:35.754 baseband/turbo_sw: not in enabled drivers build config 00:01:35.754 gpu/cuda: not in enabled drivers build config 00:01:35.754 00:01:35.754 00:01:35.754 Build targets in project: 316 00:01:35.754 00:01:35.754 DPDK 22.11.4 00:01:35.754 00:01:35.754 User defined options 00:01:35.754 libdir : lib 00:01:35.754 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:35.754 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:35.754 c_link_args : 00:01:35.754 enable_docs : false 00:01:35.754 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:35.754 enable_kmods : false 00:01:35.754 machine : native 00:01:35.754 tests : false 00:01:35.754 00:01:35.754 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:35.754 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:35.754 02:13:00 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:35.754 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:35.754 [1/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:36.020 [2/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:36.021 [3/745] Generating lib/rte_telemetry_def with a custom command 00:01:36.021 [4/745] Generating lib/rte_kvargs_def with a custom command 00:01:36.021 [5/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:36.021 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:36.021 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:36.021 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:36.021 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:36.021 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:36.021 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:36.021 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:36.021 [13/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:36.021 [14/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:36.021 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:36.021 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:36.021 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:36.021 [18/745] Linking static target lib/librte_kvargs.a 00:01:36.021 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:36.021 [20/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:36.021 [21/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:36.021 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:36.021 [23/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:36.021 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:36.021 [25/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:36.021 [26/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:36.021 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:36.021 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:36.021 [29/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:36.021 [30/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:36.021 [31/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:36.021 [32/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:36.021 [33/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:36.021 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:36.289 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:36.289 [36/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:36.289 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:36.289 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:36.289 [39/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:36.289 [40/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:36.289 [41/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:36.289 [42/745] Generating lib/rte_eal_mingw with a custom command 00:01:36.289 [43/745] Generating lib/rte_eal_def with a custom command 00:01:36.289 [44/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:36.289 [45/745] Generating lib/rte_ring_def with a custom command 00:01:36.289 [46/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:36.289 [47/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:36.289 [48/745] Generating lib/rte_ring_mingw with a custom command 00:01:36.289 [49/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:36.289 [50/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:36.289 [51/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:36.289 [52/745] Generating lib/rte_rcu_mingw with a custom command 00:01:36.289 [53/745] Generating lib/rte_rcu_def with a custom command 00:01:36.289 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:36.289 [55/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:36.289 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:36.289 [57/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:36.289 [58/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:36.289 [59/745] Generating lib/rte_mempool_mingw with a custom command 00:01:36.289 [60/745] Generating lib/rte_mempool_def with a custom command 00:01:36.289 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:36.289 [62/745] Generating lib/rte_mbuf_def with a custom command 00:01:36.289 [63/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:36.289 [64/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:36.289 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:36.289 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:36.289 [67/745] Generating lib/rte_net_def with a custom command 00:01:36.289 [68/745] Generating lib/rte_meter_def with a custom command 00:01:36.289 [69/745] Generating lib/rte_meter_mingw with a custom command 00:01:36.289 [70/745] Generating lib/rte_net_mingw with a custom command 00:01:36.289 [71/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:36.289 [72/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:36.289 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:36.289 [74/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:36.289 [75/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:36.289 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:36.289 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:36.548 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:36.548 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.548 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:36.548 [81/745] Linking static target lib/librte_ring.a 00:01:36.548 [82/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:36.548 [83/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:36.548 [84/745] Linking target lib/librte_kvargs.so.23.0 00:01:36.548 [85/745] Generating lib/rte_pci_def with a custom command 00:01:36.548 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:36.548 [87/745] Linking static target lib/librte_meter.a 00:01:36.548 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:36.548 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:36.548 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:36.548 [91/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:36.548 [92/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:36.548 [93/745] Linking static target lib/librte_pci.a 00:01:36.808 [94/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:36.808 [95/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:36.808 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:36.808 [97/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:36.808 [98/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:36.808 [99/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.808 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:36.808 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:36.808 [102/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.070 [103/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:37.070 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:37.070 [105/745] Generating lib/rte_cmdline_def with a custom command 00:01:37.070 [106/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.070 [107/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:37.070 [108/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:37.070 [109/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:37.070 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:37.070 [111/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:37.070 [112/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:37.070 [113/745] Linking static target lib/librte_telemetry.a 00:01:37.070 [114/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:37.070 [115/745] Generating lib/rte_metrics_mingw with a custom command 00:01:37.070 [116/745] Generating lib/rte_metrics_def with a custom command 00:01:37.070 [117/745] Generating lib/rte_hash_def with a custom command 00:01:37.070 [118/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:37.070 [119/745] Generating lib/rte_hash_mingw with a custom command 00:01:37.070 [120/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:37.070 [121/745] Generating lib/rte_timer_def with a custom command 00:01:37.070 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:37.330 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:37.330 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:37.330 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:37.330 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:37.330 [127/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:37.330 [128/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:37.330 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:37.330 [130/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:37.593 [131/745] Generating lib/rte_acl_mingw with a custom command 00:01:37.593 [132/745] Generating lib/rte_acl_def with a custom command 00:01:37.593 [133/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:37.593 [134/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:37.593 [135/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:37.593 [136/745] Generating lib/rte_bbdev_def with a custom command 00:01:37.593 [137/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:37.593 [138/745] Generating lib/rte_bitratestats_def with a custom command 00:01:37.593 [139/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:37.593 [140/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.593 [141/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:37.593 [142/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:37.593 [143/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:37.593 [144/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:37.593 [145/745] Linking target lib/librte_telemetry.so.23.0 00:01:37.593 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:37.593 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:37.593 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:37.593 [149/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:37.593 [150/745] Generating lib/rte_bpf_def with a custom command 00:01:37.852 [151/745] Generating lib/rte_bpf_mingw with a custom command 00:01:37.852 [152/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:37.852 [153/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:37.852 [154/745] Generating lib/rte_cfgfile_def with a custom command 00:01:37.852 [155/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:37.852 [156/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:37.852 [157/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:37.852 [158/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:37.852 [159/745] Generating lib/rte_compressdev_def with a custom command 00:01:37.852 [160/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:37.852 [161/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:37.852 [162/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:37.852 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:01:37.852 [164/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:37.852 [165/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:37.852 [166/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:37.852 [167/745] Linking static target lib/librte_rcu.a 00:01:37.852 [168/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:37.852 [169/745] Generating lib/rte_distributor_def with a custom command 00:01:37.852 [170/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:37.852 [171/745] Linking static target lib/librte_timer.a 00:01:37.852 [172/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:38.114 [173/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:38.114 [174/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:38.114 [175/745] Generating lib/rte_distributor_mingw with a custom command 00:01:38.114 [176/745] Linking static target lib/librte_cmdline.a 00:01:38.114 [177/745] Generating lib/rte_efd_def with a custom command 00:01:38.114 [178/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:38.114 [179/745] Generating lib/rte_efd_mingw with a custom command 00:01:38.114 [180/745] Linking static target lib/librte_net.a 00:01:38.114 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:38.114 [182/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:38.377 [183/745] Linking static target lib/librte_cfgfile.a 00:01:38.377 [184/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:38.377 [185/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:38.377 [186/745] Linking static target lib/librte_metrics.a 00:01:38.377 [187/745] Linking static target lib/librte_mempool.a 00:01:38.377 [188/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.377 [189/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.377 [190/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:38.377 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.638 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:38.638 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:38.638 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:38.638 [195/745] Linking static target lib/librte_eal.a 00:01:38.638 [196/745] Generating lib/rte_eventdev_def with a custom command 00:01:38.638 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:38.638 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:38.638 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:38.638 [200/745] Generating lib/rte_gpudev_def with a custom command 00:01:38.638 [201/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:38.638 [202/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:38.638 [203/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.902 [204/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:38.902 [205/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:38.902 [206/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:38.902 [207/745] Linking static target lib/librte_bitratestats.a 00:01:38.902 [208/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.902 [209/745] Generating lib/rte_gro_mingw with a custom command 00:01:38.902 [210/745] Generating lib/rte_gro_def with a custom command 00:01:38.902 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:38.902 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:38.902 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:39.161 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:39.161 [215/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:39.161 [216/745] Generating lib/rte_gso_def with a custom command 00:01:39.161 [217/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.161 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:39.161 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:39.161 [220/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:39.161 [221/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:39.424 [222/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:39.424 [223/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.424 [224/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:39.424 [225/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.424 [226/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:39.424 [227/745] Generating lib/rte_ip_frag_def with a custom command 00:01:39.424 [228/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:39.424 [229/745] Linking static target lib/librte_bbdev.a 00:01:39.424 [230/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:39.424 [231/745] Generating lib/rte_jobstats_def with a custom command 00:01:39.424 [232/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:39.424 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:39.424 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:39.424 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:39.685 [236/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:39.685 [237/745] Generating lib/rte_lpm_def with a custom command 00:01:39.685 [238/745] Linking static target lib/librte_compressdev.a 00:01:39.685 [239/745] Generating lib/rte_lpm_mingw with a custom command 00:01:39.685 [240/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:39.685 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:39.685 [242/745] Linking static target lib/librte_jobstats.a 00:01:39.948 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:39.948 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:39.948 [245/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:39.948 [246/745] Linking static target lib/librte_distributor.a 00:01:39.948 [247/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:39.948 [248/745] Generating lib/rte_member_def with a custom command 00:01:39.948 [249/745] Generating lib/rte_member_mingw with a custom command 00:01:40.210 [250/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:40.210 [251/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.210 [252/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:40.210 [253/745] Generating lib/rte_pcapng_def with a custom command 00:01:40.210 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:40.210 [255/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:40.210 [256/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:40.210 [257/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:40.210 [258/745] Linking static target lib/librte_bpf.a 00:01:40.210 [259/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:40.210 [260/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.210 [261/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:40.210 [262/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.468 [263/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:40.468 [264/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:40.468 [265/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:40.468 [266/745] Generating lib/rte_power_def with a custom command 00:01:40.468 [267/745] Generating lib/rte_power_mingw with a custom command 00:01:40.468 [268/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:40.468 [269/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:40.468 [270/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:40.468 [271/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:40.468 [272/745] Linking static target lib/librte_gpudev.a 00:01:40.468 [273/745] Generating lib/rte_rawdev_def with a custom command 00:01:40.468 [274/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:40.468 [275/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:40.468 [276/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:40.468 [277/745] Linking static target lib/librte_gro.a 00:01:40.468 [278/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:40.468 [279/745] Generating lib/rte_regexdev_def with a custom command 00:01:40.468 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:40.468 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:40.468 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:40.729 [283/745] Generating lib/rte_rib_def with a custom command 00:01:40.729 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:40.729 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:40.729 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:40.729 [287/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:40.729 [288/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.729 [289/745] Generating lib/rte_reorder_mingw with a custom command 00:01:40.989 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.989 [291/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:40.989 [292/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:40.989 [293/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:40.989 [294/745] Generating lib/rte_sched_def with a custom command 00:01:40.989 [295/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.989 [296/745] Generating lib/rte_sched_mingw with a custom command 00:01:40.989 [297/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:40.989 [298/745] Generating lib/rte_security_def with a custom command 00:01:40.989 [299/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:40.989 [300/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:40.989 [301/745] Linking static target lib/librte_latencystats.a 00:01:40.989 [302/745] Generating lib/rte_security_mingw with a custom command 00:01:40.989 [303/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:40.989 [304/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:40.989 [305/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:40.989 [306/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:40.989 [307/745] Generating lib/rte_stack_def with a custom command 00:01:40.989 [308/745] Generating lib/rte_stack_mingw with a custom command 00:01:40.989 [309/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:41.254 [310/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:41.254 [311/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:41.254 [312/745] Linking static target lib/librte_rawdev.a 00:01:41.254 [313/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:41.254 [314/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:41.254 [315/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:41.254 [316/745] Linking static target lib/librte_stack.a 00:01:41.254 [317/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:41.254 [318/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:41.254 [319/745] Generating lib/rte_vhost_mingw with a custom command 00:01:41.254 [320/745] Generating lib/rte_vhost_def with a custom command 00:01:41.254 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:41.254 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:41.254 [323/745] Linking static target lib/librte_dmadev.a 00:01:41.254 [324/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:41.254 [325/745] Linking static target lib/librte_ip_frag.a 00:01:41.254 [326/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.254 [327/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:41.515 [328/745] Generating lib/rte_ipsec_def with a custom command 00:01:41.515 [329/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:41.515 [330/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:41.515 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.515 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:41.776 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:41.776 [334/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.776 [335/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:41.776 [336/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.776 [337/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.776 [338/745] Generating lib/rte_fib_mingw with a custom command 00:01:41.776 [339/745] Generating lib/rte_fib_def with a custom command 00:01:42.042 [340/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:42.042 [341/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:42.042 [342/745] Linking static target lib/librte_gso.a 00:01:42.042 [343/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:42.042 [344/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:42.043 [345/745] Linking static target lib/librte_regexdev.a 00:01:42.043 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.301 [347/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:42.301 [348/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:42.301 [349/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.301 [350/745] Linking static target lib/librte_efd.a 00:01:42.301 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:42.562 [352/745] Linking static target lib/librte_pcapng.a 00:01:42.562 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:42.562 [354/745] Linking static target lib/librte_lpm.a 00:01:42.562 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:42.562 [356/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:42.562 [357/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:42.562 [358/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:42.562 [359/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:42.562 [360/745] Linking static target lib/librte_reorder.a 00:01:42.562 [361/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.824 [362/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:42.824 [363/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:42.824 [364/745] Linking static target lib/acl/libavx2_tmp.a 00:01:42.824 [365/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:42.824 [366/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:42.824 [367/745] Generating lib/rte_port_def with a custom command 00:01:42.824 [368/745] Generating lib/rte_port_mingw with a custom command 00:01:42.824 [369/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:42.824 [370/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:42.824 [371/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:42.824 [372/745] Generating lib/rte_pdump_def with a custom command 00:01:42.824 [373/745] Generating lib/rte_pdump_mingw with a custom command 00:01:42.824 [374/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:42.824 [375/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:42.824 [376/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.824 [377/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:42.824 [378/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:42.824 [379/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:42.824 [380/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.824 [381/745] Linking static target lib/librte_security.a 00:01:43.120 [382/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:43.120 [383/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.120 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:43.120 [385/745] Linking static target lib/librte_power.a 00:01:43.120 [386/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.120 [387/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:43.120 [388/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:43.120 [389/745] Linking static target lib/librte_hash.a 00:01:43.402 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:43.402 [391/745] Linking static target lib/librte_rib.a 00:01:43.402 [392/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:43.402 [393/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:43.402 [394/745] Linking static target lib/acl/libavx512_tmp.a 00:01:43.402 [395/745] Linking static target lib/librte_acl.a 00:01:43.402 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:43.402 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:43.675 [398/745] Generating lib/rte_table_def with a custom command 00:01:43.675 [399/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:43.675 [400/745] Generating lib/rte_table_mingw with a custom command 00:01:43.675 [401/745] Linking static target lib/librte_ethdev.a 00:01:43.675 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.940 [403/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.940 [404/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:43.940 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.940 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:43.940 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:44.199 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:44.199 [409/745] Generating lib/rte_pipeline_def with a custom command 00:01:44.199 [410/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:44.199 [411/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:44.199 [412/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:44.199 [413/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:44.199 [414/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:44.199 [415/745] Linking static target lib/librte_mbuf.a 00:01:44.199 [416/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.199 [417/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:44.199 [418/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:44.199 [419/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:44.199 [420/745] Generating lib/rte_graph_def with a custom command 00:01:44.199 [421/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:44.199 [422/745] Generating lib/rte_graph_mingw with a custom command 00:01:44.199 [423/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:44.462 [424/745] Linking static target lib/librte_fib.a 00:01:44.462 [425/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:44.462 [426/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:44.462 [427/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:44.462 [428/745] Linking static target lib/librte_eventdev.a 00:01:44.462 [429/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.462 [430/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:44.462 [431/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:44.462 [432/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:44.738 [433/745] Linking static target lib/librte_member.a 00:01:44.738 [434/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:44.738 [435/745] Generating lib/rte_node_def with a custom command 00:01:44.738 [436/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:44.738 [437/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:44.738 [438/745] Generating lib/rte_node_mingw with a custom command 00:01:44.738 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:44.738 [440/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:44.738 [441/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.001 [442/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:45.001 [443/745] Linking static target lib/librte_sched.a 00:01:45.001 [444/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:45.001 [445/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:45.001 [446/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:45.001 [447/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:45.001 [448/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.001 [449/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:45.001 [450/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:45.001 [451/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:45.001 [452/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:45.001 [453/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:45.001 [454/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:45.001 [455/745] Linking static target lib/librte_cryptodev.a 00:01:45.001 [456/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.261 [457/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:45.261 [458/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:45.261 [459/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:45.261 [460/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:45.261 [461/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:45.261 [462/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:45.261 [463/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:45.261 [464/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:45.261 [465/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:45.522 [466/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:45.522 [467/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:45.522 [468/745] Linking static target lib/librte_pdump.a 00:01:45.522 [469/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:45.522 [470/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:45.522 [471/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:45.522 [472/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:45.522 [473/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:45.522 [474/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:45.522 [475/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:45.522 [476/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.522 [477/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:45.790 [478/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:45.790 [479/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:45.790 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:45.790 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:45.790 [482/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:45.790 [483/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:45.790 [484/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.055 [485/745] Linking static target lib/librte_table.a 00:01:46.055 [486/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:46.055 [487/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:46.055 [488/745] Linking static target drivers/librte_bus_vdev.a 00:01:46.055 [489/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:46.055 [490/745] Linking static target lib/librte_ipsec.a 00:01:46.055 [491/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:46.055 [492/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:46.318 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:46.318 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:46.318 [495/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.318 [496/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:46.318 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:46.583 [498/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:46.583 [499/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:46.583 [500/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:46.583 [501/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:46.583 [502/745] Linking static target lib/librte_graph.a 00:01:46.583 [503/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.583 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:46.583 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:46.583 [506/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:46.583 [507/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:46.583 [508/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:46.583 [509/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:46.583 [510/745] Linking static target drivers/librte_bus_pci.a 00:01:46.851 [511/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:46.851 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:47.111 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:47.111 [514/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.111 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:47.377 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.377 [517/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.377 [518/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:47.377 [519/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:47.377 [520/745] Linking static target lib/librte_port.a 00:01:47.639 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:47.639 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:47.639 [523/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:47.639 [524/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:47.639 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:47.903 [526/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:47.903 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.164 [528/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:48.164 [529/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:48.164 [530/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:48.164 [531/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.164 [532/745] Linking static target drivers/librte_mempool_ring.a 00:01:48.164 [533/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:48.164 [534/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:48.164 [535/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.164 [536/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:48.164 [537/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:48.426 [538/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.426 [539/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.426 [540/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:48.426 [541/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:48.998 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:48.998 [543/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:48.998 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:48.998 [545/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:48.998 [546/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:48.998 [547/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:48.998 [548/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:49.257 [549/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:49.257 [550/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:49.257 [551/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:49.518 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:49.518 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:49.783 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:49.783 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:49.783 [556/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:49.783 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:50.044 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:50.044 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:50.306 [560/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:50.306 [561/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:50.306 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:50.569 [563/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:50.569 [564/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:50.569 [565/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:50.569 [566/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:50.569 [567/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.569 [568/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:50.569 [569/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:50.569 [570/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:50.569 [571/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:50.569 [572/745] Linking target lib/librte_eal.so.23.0 00:01:50.569 [573/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:50.831 [574/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:50.831 [575/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:50.831 [576/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:50.831 [577/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:51.092 [578/745] Linking target lib/librte_ring.so.23.0 00:01:51.092 [579/745] Linking target lib/librte_meter.so.23.0 00:01:51.092 [580/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:51.092 [581/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:51.092 [582/745] Linking target lib/librte_pci.so.23.0 00:01:51.092 [583/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:51.092 [584/745] Linking target lib/librte_timer.so.23.0 00:01:51.092 [585/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:51.092 [586/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.092 [587/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:51.092 [588/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:51.092 [589/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:51.359 [590/745] Linking target lib/librte_acl.so.23.0 00:01:51.359 [591/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:51.359 [592/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:51.359 [593/745] Linking target lib/librte_cfgfile.so.23.0 00:01:51.359 [594/745] Linking target lib/librte_jobstats.so.23.0 00:01:51.359 [595/745] Linking target lib/librte_rcu.so.23.0 00:01:51.359 [596/745] Linking target lib/librte_rawdev.so.23.0 00:01:51.359 [597/745] Linking target lib/librte_mempool.so.23.0 00:01:51.359 [598/745] Linking target lib/librte_dmadev.so.23.0 00:01:51.359 [599/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:51.359 [600/745] Linking target lib/librte_stack.so.23.0 00:01:51.359 [601/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:51.359 [602/745] Linking target lib/librte_graph.so.23.0 00:01:51.359 [603/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:51.359 [604/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:51.359 [605/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:51.359 [606/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:51.359 [607/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:51.359 [608/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:51.619 [609/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:51.619 [610/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:51.619 [611/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:51.619 [612/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:51.619 [613/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:51.619 [614/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:51.619 [615/745] Linking target lib/librte_mbuf.so.23.0 00:01:51.619 [616/745] Linking target lib/librte_rib.so.23.0 00:01:51.619 [617/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:51.619 [618/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:51.880 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:51.880 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:51.880 [621/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:51.880 [622/745] Linking target lib/librte_net.so.23.0 00:01:51.880 [623/745] Linking target lib/librte_bbdev.so.23.0 00:01:51.880 [624/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:51.880 [625/745] Linking target lib/librte_compressdev.so.23.0 00:01:52.141 [626/745] Linking target lib/librte_cryptodev.so.23.0 00:01:52.141 [627/745] Linking target lib/librte_distributor.so.23.0 00:01:52.141 [628/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:52.141 [629/745] Linking target lib/librte_gpudev.so.23.0 00:01:52.141 [630/745] Linking target lib/librte_cmdline.so.23.0 00:01:52.141 [631/745] Linking target lib/librte_ethdev.so.23.0 00:01:52.141 [632/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:52.141 [633/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:52.405 [634/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:52.405 [635/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:52.405 [636/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:52.405 [637/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:52.405 [638/745] Linking target lib/librte_hash.so.23.0 00:01:52.405 [639/745] Linking target lib/librte_reorder.so.23.0 00:01:52.405 [640/745] Linking target lib/librte_regexdev.so.23.0 00:01:52.405 [641/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:52.405 [642/745] Linking target lib/librte_sched.so.23.0 00:01:52.405 [643/745] Linking target lib/librte_security.so.23.0 00:01:52.405 [644/745] Linking target lib/librte_fib.so.23.0 00:01:52.405 [645/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:52.405 [646/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:52.405 [647/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:52.405 [648/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:52.664 [649/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:52.664 [650/745] Linking target lib/librte_pcapng.so.23.0 00:01:52.664 [651/745] Linking target lib/librte_gso.so.23.0 00:01:52.664 [652/745] Linking target lib/librte_power.so.23.0 00:01:52.664 [653/745] Linking target lib/librte_gro.so.23.0 00:01:52.664 [654/745] Linking target lib/librte_metrics.so.23.0 00:01:52.664 [655/745] Linking target lib/librte_bpf.so.23.0 00:01:52.664 [656/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:52.664 [657/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:52.664 [658/745] Linking target lib/librte_efd.so.23.0 00:01:52.664 [659/745] Linking target lib/librte_lpm.so.23.0 00:01:52.664 [660/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:52.664 [661/745] Linking target lib/librte_ip_frag.so.23.0 00:01:52.664 [662/745] Linking target lib/librte_eventdev.so.23.0 00:01:52.664 [663/745] Linking target lib/librte_member.so.23.0 00:01:52.664 [664/745] Linking target lib/librte_ipsec.so.23.0 00:01:52.664 [665/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:52.664 [666/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:52.924 [667/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:52.924 [668/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:52.924 [669/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:52.924 [670/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:52.924 [671/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:52.924 [672/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:52.924 [673/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:52.924 [674/745] Linking target lib/librte_latencystats.so.23.0 00:01:52.924 [675/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:52.924 [676/745] Linking target lib/librte_pdump.so.23.0 00:01:52.924 [677/745] Linking target lib/librte_bitratestats.so.23.0 00:01:52.924 [678/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:52.924 [679/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:52.924 [680/745] Linking target lib/librte_port.so.23.0 00:01:52.924 [681/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:53.182 [682/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:53.182 [683/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:53.182 [684/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:53.182 [685/745] Linking target lib/librte_table.so.23.0 00:01:53.182 [686/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:53.182 [687/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:53.182 [688/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:53.182 [689/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:53.440 [690/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:53.440 [691/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:53.440 [692/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:53.440 [693/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:53.698 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:53.698 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:53.698 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:53.956 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:54.214 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:54.214 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:54.214 [700/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:54.473 [701/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:54.473 [702/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:54.737 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:54.737 [704/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:54.995 [705/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:54.995 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:54.995 [707/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:54.995 [708/745] Linking static target drivers/librte_net_i40e.a 00:01:54.995 [709/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:55.561 [710/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.561 [711/745] Linking target drivers/librte_net_i40e.so.23.0 00:01:55.561 [712/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:56.497 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:56.497 [714/745] Linking static target lib/librte_node.a 00:01:56.756 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.756 [716/745] Linking target lib/librte_node.so.23.0 00:01:56.756 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:57.324 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:57.890 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:05.999 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:38.076 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:38.076 [722/745] Linking static target lib/librte_vhost.a 00:02:38.076 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:38.076 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:48.132 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:48.132 [726/745] Linking static target lib/librte_pipeline.a 00:02:48.132 [727/745] Linking target app/dpdk-test-sad 00:02:48.132 [728/745] Linking target app/dpdk-test-pipeline 00:02:48.132 [729/745] Linking target app/dpdk-dumpcap 00:02:48.132 [730/745] Linking target app/dpdk-test-flow-perf 00:02:48.132 [731/745] Linking target app/dpdk-pdump 00:02:48.132 [732/745] Linking target app/dpdk-test-fib 00:02:48.132 [733/745] Linking target app/dpdk-proc-info 00:02:48.132 [734/745] Linking target app/dpdk-test-gpudev 00:02:48.132 [735/745] Linking target app/dpdk-test-security-perf 00:02:48.132 [736/745] Linking target app/dpdk-test-regex 00:02:48.132 [737/745] Linking target app/dpdk-test-cmdline 00:02:48.132 [738/745] Linking target app/dpdk-test-bbdev 00:02:48.132 [739/745] Linking target app/dpdk-test-acl 00:02:48.132 [740/745] Linking target app/dpdk-test-compress-perf 00:02:48.132 [741/745] Linking target app/dpdk-test-eventdev 00:02:48.132 [742/745] Linking target app/dpdk-test-crypto-perf 00:02:48.132 [743/745] Linking target app/dpdk-testpmd 00:02:49.510 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:49.510 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:49.510 02:14:13 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:49.510 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:49.510 [0/1] Installing files. 00:02:49.772 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.772 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:49.773 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:49.774 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.775 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.776 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:49.777 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:49.778 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:49.778 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:49.778 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.037 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.038 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:50.297 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:50.297 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:50.297 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.297 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:50.297 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.297 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.298 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.560 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.560 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.561 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.562 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:50.563 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:50.563 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:50.563 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:50.563 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:50.563 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:50.563 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:50.563 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:50.563 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:50.563 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:50.563 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:50.563 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:50.563 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:50.563 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:50.563 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:50.563 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:50.563 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:50.563 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:50.563 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:50.563 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:50.563 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:50.563 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:50.563 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:50.563 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:50.563 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:50.563 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:50.563 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:50.563 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:50.563 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:50.563 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:50.563 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:50.563 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:50.563 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:50.563 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:50.563 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:50.564 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:50.564 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:50.564 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:50.564 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:50.564 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:50.564 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:50.564 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:50.564 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:50.564 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:50.564 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:50.564 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:50.564 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:50.564 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:50.564 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:50.564 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:50.564 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:50.564 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:50.564 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:50.564 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:50.564 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:50.564 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:50.564 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:50.564 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:50.564 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:50.564 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:50.564 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:50.564 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:50.564 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:50.564 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:50.564 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:50.564 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:50.564 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:50.564 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:50.564 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:50.564 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:50.564 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:50.564 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:50.564 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:50.564 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:50.564 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:50.564 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:50.564 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:50.564 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:50.564 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:50.564 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:50.564 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:50.564 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:50.564 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:50.564 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:50.564 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:50.564 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:50.564 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:50.564 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:50.564 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:50.564 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:50.564 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:50.564 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:50.564 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:50.564 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:50.564 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:50.564 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:50.564 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:50.564 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:50.564 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:50.564 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:50.564 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:50.564 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:50.564 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:50.564 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:50.564 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:50.564 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:50.564 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:50.564 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:50.564 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:50.564 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:50.564 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:50.564 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:50.564 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:50.564 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:50.564 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:50.564 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:50.564 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:50.564 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:50.564 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:50.564 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:50.564 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:50.564 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:50.564 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:50.564 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:50.564 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:50.564 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:50.564 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:50.564 02:14:15 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:50.564 02:14:15 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:50.564 02:14:15 -- common/autobuild_common.sh@203 -- $ cat 00:02:50.564 02:14:15 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:50.564 00:02:50.564 real 1m21.039s 00:02:50.564 user 14m24.977s 00:02:50.564 sys 1m49.611s 00:02:50.564 02:14:15 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:50.565 02:14:15 -- common/autotest_common.sh@10 -- $ set +x 00:02:50.565 ************************************ 00:02:50.565 END TEST build_native_dpdk 00:02:50.565 ************************************ 00:02:50.565 02:14:15 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:50.565 02:14:15 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:50.565 02:14:15 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:50.565 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:50.823 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:50.823 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:50.823 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:51.083 Using 'verbs' RDMA provider 00:03:01.323 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:09.441 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:09.441 Creating mk/config.mk...done. 00:03:09.441 Creating mk/cc.flags.mk...done. 00:03:09.441 Type 'make' to build. 00:03:09.441 02:14:33 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:09.441 02:14:33 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:09.441 02:14:33 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:09.441 02:14:33 -- common/autotest_common.sh@10 -- $ set +x 00:03:09.441 ************************************ 00:03:09.441 START TEST make 00:03:09.441 ************************************ 00:03:09.441 02:14:33 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:09.441 make[1]: Nothing to be done for 'all'. 00:03:11.360 The Meson build system 00:03:11.360 Version: 1.5.0 00:03:11.360 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:11.360 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:11.360 Build type: native build 00:03:11.360 Project name: libvfio-user 00:03:11.360 Project version: 0.0.1 00:03:11.360 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:11.360 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:11.360 Host machine cpu family: x86_64 00:03:11.360 Host machine cpu: x86_64 00:03:11.360 Run-time dependency threads found: YES 00:03:11.360 Library dl found: YES 00:03:11.360 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:11.360 Run-time dependency json-c found: YES 0.17 00:03:11.360 Run-time dependency cmocka found: YES 1.1.7 00:03:11.360 Program pytest-3 found: NO 00:03:11.360 Program flake8 found: NO 00:03:11.360 Program misspell-fixer found: NO 00:03:11.360 Program restructuredtext-lint found: NO 00:03:11.360 Program valgrind found: YES (/usr/bin/valgrind) 00:03:11.360 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:11.360 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:11.360 Compiler for C supports arguments -Wwrite-strings: YES 00:03:11.360 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:11.360 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:11.361 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:11.361 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:11.361 Build targets in project: 8 00:03:11.361 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:11.361 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:11.361 00:03:11.361 libvfio-user 0.0.1 00:03:11.361 00:03:11.361 User defined options 00:03:11.361 buildtype : debug 00:03:11.361 default_library: shared 00:03:11.361 libdir : /usr/local/lib 00:03:11.361 00:03:11.361 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:12.313 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:12.313 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:12.313 [2/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:12.313 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:12.313 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:12.313 [5/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:12.313 [6/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:12.313 [7/37] Compiling C object samples/null.p/null.c.o 00:03:12.313 [8/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:12.313 [9/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:12.313 [10/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:12.575 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:12.575 [12/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:12.575 [13/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:12.575 [14/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:12.575 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:12.575 [16/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:12.575 [17/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:12.575 [18/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:12.575 [19/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:12.575 [20/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:12.575 [21/37] Compiling C object samples/server.p/server.c.o 00:03:12.575 [22/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:12.575 [23/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:12.575 [24/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:12.575 [25/37] Compiling C object samples/client.p/client.c.o 00:03:12.575 [26/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:12.575 [27/37] Linking target samples/client 00:03:12.575 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:12.840 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:03:12.840 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:12.840 [31/37] Linking target test/unit_tests 00:03:12.840 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:13.099 [33/37] Linking target samples/server 00:03:13.099 [34/37] Linking target samples/null 00:03:13.099 [35/37] Linking target samples/gpio-pci-idio-16 00:03:13.099 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:13.099 [37/37] Linking target samples/lspci 00:03:13.099 INFO: autodetecting backend as ninja 00:03:13.099 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:13.099 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:14.037 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:14.037 ninja: no work to do. 00:03:26.237 CC lib/ut/ut.o 00:03:26.237 CC lib/log/log.o 00:03:26.237 CC lib/log/log_flags.o 00:03:26.237 CC lib/log/log_deprecated.o 00:03:26.237 CC lib/ut_mock/mock.o 00:03:26.237 LIB libspdk_ut_mock.a 00:03:26.237 SO libspdk_ut_mock.so.5.0 00:03:26.237 LIB libspdk_log.a 00:03:26.237 LIB libspdk_ut.a 00:03:26.237 SO libspdk_ut.so.1.0 00:03:26.237 SO libspdk_log.so.6.1 00:03:26.237 SYMLINK libspdk_ut_mock.so 00:03:26.237 SYMLINK libspdk_ut.so 00:03:26.237 SYMLINK libspdk_log.so 00:03:26.237 CC lib/ioat/ioat.o 00:03:26.237 CC lib/dma/dma.o 00:03:26.237 CXX lib/trace_parser/trace.o 00:03:26.237 CC lib/util/base64.o 00:03:26.237 CC lib/util/bit_array.o 00:03:26.237 CC lib/util/cpuset.o 00:03:26.237 CC lib/util/crc16.o 00:03:26.237 CC lib/util/crc32.o 00:03:26.237 CC lib/util/crc32c.o 00:03:26.237 CC lib/util/crc32_ieee.o 00:03:26.237 CC lib/util/crc64.o 00:03:26.237 CC lib/util/dif.o 00:03:26.237 CC lib/util/fd.o 00:03:26.237 CC lib/util/file.o 00:03:26.237 CC lib/util/hexlify.o 00:03:26.237 CC lib/util/iov.o 00:03:26.237 CC lib/util/math.o 00:03:26.237 CC lib/util/pipe.o 00:03:26.237 CC lib/util/strerror_tls.o 00:03:26.237 CC lib/util/string.o 00:03:26.237 CC lib/util/uuid.o 00:03:26.237 CC lib/util/fd_group.o 00:03:26.237 CC lib/util/xor.o 00:03:26.237 CC lib/util/zipf.o 00:03:26.237 CC lib/vfio_user/host/vfio_user_pci.o 00:03:26.237 CC lib/vfio_user/host/vfio_user.o 00:03:26.237 LIB libspdk_dma.a 00:03:26.237 SO libspdk_dma.so.3.0 00:03:26.237 SYMLINK libspdk_dma.so 00:03:26.237 LIB libspdk_ioat.a 00:03:26.237 SO libspdk_ioat.so.6.0 00:03:26.237 LIB libspdk_vfio_user.a 00:03:26.237 SO libspdk_vfio_user.so.4.0 00:03:26.237 SYMLINK libspdk_ioat.so 00:03:26.237 SYMLINK libspdk_vfio_user.so 00:03:26.237 LIB libspdk_util.a 00:03:26.237 SO libspdk_util.so.8.0 00:03:26.237 SYMLINK libspdk_util.so 00:03:26.237 CC lib/rdma/common.o 00:03:26.237 CC lib/idxd/idxd.o 00:03:26.237 CC lib/json/json_parse.o 00:03:26.237 CC lib/rdma/rdma_verbs.o 00:03:26.237 CC lib/vmd/vmd.o 00:03:26.237 CC lib/idxd/idxd_user.o 00:03:26.237 CC lib/json/json_util.o 00:03:26.237 CC lib/vmd/led.o 00:03:26.237 CC lib/json/json_write.o 00:03:26.237 CC lib/idxd/idxd_kernel.o 00:03:26.237 CC lib/env_dpdk/env.o 00:03:26.237 CC lib/conf/conf.o 00:03:26.237 CC lib/env_dpdk/memory.o 00:03:26.237 CC lib/env_dpdk/pci.o 00:03:26.237 CC lib/env_dpdk/init.o 00:03:26.237 CC lib/env_dpdk/threads.o 00:03:26.237 CC lib/env_dpdk/pci_ioat.o 00:03:26.237 CC lib/env_dpdk/pci_virtio.o 00:03:26.237 CC lib/env_dpdk/pci_vmd.o 00:03:26.237 CC lib/env_dpdk/pci_idxd.o 00:03:26.237 CC lib/env_dpdk/pci_event.o 00:03:26.237 CC lib/env_dpdk/sigbus_handler.o 00:03:26.237 CC lib/env_dpdk/pci_dpdk.o 00:03:26.237 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:26.237 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:26.237 LIB libspdk_trace_parser.a 00:03:26.237 SO libspdk_trace_parser.so.4.0 00:03:26.237 SYMLINK libspdk_trace_parser.so 00:03:26.237 LIB libspdk_rdma.a 00:03:26.237 SO libspdk_rdma.so.5.0 00:03:26.237 LIB libspdk_conf.a 00:03:26.237 LIB libspdk_json.a 00:03:26.237 SO libspdk_conf.so.5.0 00:03:26.237 SO libspdk_json.so.5.1 00:03:26.237 SYMLINK libspdk_rdma.so 00:03:26.237 SYMLINK libspdk_conf.so 00:03:26.237 SYMLINK libspdk_json.so 00:03:26.237 CC lib/jsonrpc/jsonrpc_server.o 00:03:26.237 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:26.237 CC lib/jsonrpc/jsonrpc_client.o 00:03:26.237 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:26.237 LIB libspdk_idxd.a 00:03:26.237 SO libspdk_idxd.so.11.0 00:03:26.237 SYMLINK libspdk_idxd.so 00:03:26.237 LIB libspdk_vmd.a 00:03:26.237 SO libspdk_vmd.so.5.0 00:03:26.237 SYMLINK libspdk_vmd.so 00:03:26.496 LIB libspdk_jsonrpc.a 00:03:26.496 SO libspdk_jsonrpc.so.5.1 00:03:26.496 SYMLINK libspdk_jsonrpc.so 00:03:26.496 CC lib/rpc/rpc.o 00:03:26.754 LIB libspdk_rpc.a 00:03:26.754 SO libspdk_rpc.so.5.0 00:03:26.754 SYMLINK libspdk_rpc.so 00:03:27.013 CC lib/sock/sock.o 00:03:27.013 CC lib/sock/sock_rpc.o 00:03:27.013 CC lib/trace/trace.o 00:03:27.013 CC lib/notify/notify.o 00:03:27.013 CC lib/trace/trace_flags.o 00:03:27.013 CC lib/notify/notify_rpc.o 00:03:27.013 CC lib/trace/trace_rpc.o 00:03:27.013 LIB libspdk_notify.a 00:03:27.013 SO libspdk_notify.so.5.0 00:03:27.271 SYMLINK libspdk_notify.so 00:03:27.271 LIB libspdk_trace.a 00:03:27.271 SO libspdk_trace.so.9.0 00:03:27.271 SYMLINK libspdk_trace.so 00:03:27.271 LIB libspdk_sock.a 00:03:27.271 CC lib/thread/thread.o 00:03:27.271 CC lib/thread/iobuf.o 00:03:27.271 SO libspdk_sock.so.8.0 00:03:27.529 SYMLINK libspdk_sock.so 00:03:27.529 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:27.529 CC lib/nvme/nvme_ctrlr.o 00:03:27.529 CC lib/nvme/nvme_fabric.o 00:03:27.529 CC lib/nvme/nvme_ns_cmd.o 00:03:27.529 CC lib/nvme/nvme_ns.o 00:03:27.529 CC lib/nvme/nvme_pcie_common.o 00:03:27.529 CC lib/nvme/nvme_pcie.o 00:03:27.529 CC lib/nvme/nvme_qpair.o 00:03:27.529 CC lib/nvme/nvme.o 00:03:27.529 CC lib/nvme/nvme_quirks.o 00:03:27.529 CC lib/nvme/nvme_transport.o 00:03:27.529 CC lib/nvme/nvme_discovery.o 00:03:27.529 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:27.529 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:27.529 CC lib/nvme/nvme_tcp.o 00:03:27.529 CC lib/nvme/nvme_opal.o 00:03:27.529 CC lib/nvme/nvme_io_msg.o 00:03:27.529 CC lib/nvme/nvme_poll_group.o 00:03:27.529 CC lib/nvme/nvme_zns.o 00:03:27.529 CC lib/nvme/nvme_cuse.o 00:03:27.529 CC lib/nvme/nvme_vfio_user.o 00:03:27.529 CC lib/nvme/nvme_rdma.o 00:03:27.529 LIB libspdk_env_dpdk.a 00:03:27.788 SO libspdk_env_dpdk.so.13.0 00:03:27.788 SYMLINK libspdk_env_dpdk.so 00:03:29.162 LIB libspdk_thread.a 00:03:29.162 SO libspdk_thread.so.9.0 00:03:29.162 SYMLINK libspdk_thread.so 00:03:29.162 CC lib/init/json_config.o 00:03:29.162 CC lib/vfu_tgt/tgt_endpoint.o 00:03:29.162 CC lib/blob/blobstore.o 00:03:29.162 CC lib/init/subsystem.o 00:03:29.162 CC lib/virtio/virtio.o 00:03:29.163 CC lib/accel/accel.o 00:03:29.163 CC lib/vfu_tgt/tgt_rpc.o 00:03:29.163 CC lib/blob/request.o 00:03:29.163 CC lib/accel/accel_rpc.o 00:03:29.163 CC lib/init/subsystem_rpc.o 00:03:29.163 CC lib/virtio/virtio_vhost_user.o 00:03:29.163 CC lib/blob/zeroes.o 00:03:29.163 CC lib/virtio/virtio_vfio_user.o 00:03:29.163 CC lib/init/rpc.o 00:03:29.163 CC lib/accel/accel_sw.o 00:03:29.163 CC lib/blob/blob_bs_dev.o 00:03:29.163 CC lib/virtio/virtio_pci.o 00:03:29.421 LIB libspdk_init.a 00:03:29.421 SO libspdk_init.so.4.0 00:03:29.421 SYMLINK libspdk_init.so 00:03:29.421 LIB libspdk_virtio.a 00:03:29.421 LIB libspdk_vfu_tgt.a 00:03:29.679 SO libspdk_virtio.so.6.0 00:03:29.679 SO libspdk_vfu_tgt.so.2.0 00:03:29.679 SYMLINK libspdk_vfu_tgt.so 00:03:29.679 SYMLINK libspdk_virtio.so 00:03:29.679 CC lib/event/app.o 00:03:29.679 CC lib/event/reactor.o 00:03:29.679 CC lib/event/log_rpc.o 00:03:29.679 CC lib/event/app_rpc.o 00:03:29.679 CC lib/event/scheduler_static.o 00:03:29.937 LIB libspdk_nvme.a 00:03:29.937 SO libspdk_nvme.so.12.0 00:03:29.937 LIB libspdk_event.a 00:03:30.196 SO libspdk_event.so.12.0 00:03:30.196 SYMLINK libspdk_event.so 00:03:30.196 SYMLINK libspdk_nvme.so 00:03:30.196 LIB libspdk_accel.a 00:03:30.196 SO libspdk_accel.so.14.0 00:03:30.454 SYMLINK libspdk_accel.so 00:03:30.454 CC lib/bdev/bdev.o 00:03:30.454 CC lib/bdev/bdev_rpc.o 00:03:30.454 CC lib/bdev/bdev_zone.o 00:03:30.454 CC lib/bdev/part.o 00:03:30.454 CC lib/bdev/scsi_nvme.o 00:03:32.424 LIB libspdk_blob.a 00:03:32.424 SO libspdk_blob.so.10.1 00:03:32.424 SYMLINK libspdk_blob.so 00:03:32.424 CC lib/blobfs/blobfs.o 00:03:32.424 CC lib/blobfs/tree.o 00:03:32.424 CC lib/lvol/lvol.o 00:03:33.018 LIB libspdk_bdev.a 00:03:33.018 LIB libspdk_blobfs.a 00:03:33.018 SO libspdk_bdev.so.14.0 00:03:33.018 SO libspdk_blobfs.so.9.0 00:03:33.018 LIB libspdk_lvol.a 00:03:33.284 SO libspdk_lvol.so.9.1 00:03:33.284 SYMLINK libspdk_bdev.so 00:03:33.284 SYMLINK libspdk_blobfs.so 00:03:33.284 SYMLINK libspdk_lvol.so 00:03:33.284 CC lib/scsi/dev.o 00:03:33.284 CC lib/ublk/ublk.o 00:03:33.284 CC lib/nbd/nbd.o 00:03:33.284 CC lib/nvmf/ctrlr.o 00:03:33.284 CC lib/ublk/ublk_rpc.o 00:03:33.284 CC lib/scsi/lun.o 00:03:33.284 CC lib/ftl/ftl_core.o 00:03:33.284 CC lib/nbd/nbd_rpc.o 00:03:33.284 CC lib/nvmf/ctrlr_discovery.o 00:03:33.284 CC lib/scsi/port.o 00:03:33.284 CC lib/ftl/ftl_init.o 00:03:33.284 CC lib/nvmf/ctrlr_bdev.o 00:03:33.284 CC lib/scsi/scsi.o 00:03:33.284 CC lib/ftl/ftl_layout.o 00:03:33.284 CC lib/nvmf/subsystem.o 00:03:33.284 CC lib/scsi/scsi_bdev.o 00:03:33.284 CC lib/nvmf/nvmf.o 00:03:33.284 CC lib/ftl/ftl_debug.o 00:03:33.284 CC lib/ftl/ftl_io.o 00:03:33.284 CC lib/nvmf/nvmf_rpc.o 00:03:33.284 CC lib/scsi/scsi_pr.o 00:03:33.284 CC lib/scsi/scsi_rpc.o 00:03:33.284 CC lib/ftl/ftl_sb.o 00:03:33.284 CC lib/nvmf/transport.o 00:03:33.284 CC lib/scsi/task.o 00:03:33.284 CC lib/nvmf/tcp.o 00:03:33.284 CC lib/ftl/ftl_l2p.o 00:03:33.284 CC lib/nvmf/vfio_user.o 00:03:33.284 CC lib/ftl/ftl_l2p_flat.o 00:03:33.284 CC lib/nvmf/rdma.o 00:03:33.284 CC lib/ftl/ftl_band.o 00:03:33.284 CC lib/ftl/ftl_nv_cache.o 00:03:33.284 CC lib/ftl/ftl_band_ops.o 00:03:33.284 CC lib/ftl/ftl_rq.o 00:03:33.284 CC lib/ftl/ftl_writer.o 00:03:33.284 CC lib/ftl/ftl_reloc.o 00:03:33.284 CC lib/ftl/ftl_l2p_cache.o 00:03:33.284 CC lib/ftl/ftl_p2l.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:33.284 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:33.543 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:33.543 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:33.543 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:33.543 CC lib/ftl/utils/ftl_conf.o 00:03:33.543 CC lib/ftl/utils/ftl_md.o 00:03:33.543 CC lib/ftl/utils/ftl_mempool.o 00:03:33.807 CC lib/ftl/utils/ftl_bitmap.o 00:03:33.807 CC lib/ftl/utils/ftl_property.o 00:03:33.807 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:33.807 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:33.807 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:33.807 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:33.807 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:33.807 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:33.807 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:33.807 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:33.807 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:33.807 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:33.807 CC lib/ftl/base/ftl_base_dev.o 00:03:33.807 CC lib/ftl/base/ftl_base_bdev.o 00:03:33.807 CC lib/ftl/ftl_trace.o 00:03:34.066 LIB libspdk_nbd.a 00:03:34.067 SO libspdk_nbd.so.6.0 00:03:34.067 SYMLINK libspdk_nbd.so 00:03:34.067 LIB libspdk_scsi.a 00:03:34.067 SO libspdk_scsi.so.8.0 00:03:34.325 SYMLINK libspdk_scsi.so 00:03:34.325 LIB libspdk_ublk.a 00:03:34.325 SO libspdk_ublk.so.2.0 00:03:34.325 CC lib/vhost/vhost.o 00:03:34.325 CC lib/iscsi/conn.o 00:03:34.325 CC lib/iscsi/init_grp.o 00:03:34.325 CC lib/vhost/vhost_rpc.o 00:03:34.325 CC lib/iscsi/iscsi.o 00:03:34.325 CC lib/vhost/vhost_scsi.o 00:03:34.325 CC lib/vhost/vhost_blk.o 00:03:34.325 CC lib/iscsi/md5.o 00:03:34.325 CC lib/iscsi/param.o 00:03:34.325 CC lib/vhost/rte_vhost_user.o 00:03:34.325 CC lib/iscsi/portal_grp.o 00:03:34.325 CC lib/iscsi/tgt_node.o 00:03:34.325 CC lib/iscsi/iscsi_subsystem.o 00:03:34.325 CC lib/iscsi/iscsi_rpc.o 00:03:34.325 CC lib/iscsi/task.o 00:03:34.325 SYMLINK libspdk_ublk.so 00:03:34.583 LIB libspdk_ftl.a 00:03:34.841 SO libspdk_ftl.so.8.0 00:03:35.099 SYMLINK libspdk_ftl.so 00:03:35.664 LIB libspdk_vhost.a 00:03:35.664 SO libspdk_vhost.so.7.1 00:03:35.664 SYMLINK libspdk_vhost.so 00:03:35.664 LIB libspdk_nvmf.a 00:03:35.921 SO libspdk_nvmf.so.17.0 00:03:35.921 LIB libspdk_iscsi.a 00:03:35.921 SO libspdk_iscsi.so.7.0 00:03:35.921 SYMLINK libspdk_nvmf.so 00:03:36.179 SYMLINK libspdk_iscsi.so 00:03:36.179 CC module/env_dpdk/env_dpdk_rpc.o 00:03:36.179 CC module/vfu_device/vfu_virtio.o 00:03:36.179 CC module/vfu_device/vfu_virtio_blk.o 00:03:36.179 CC module/vfu_device/vfu_virtio_scsi.o 00:03:36.179 CC module/vfu_device/vfu_virtio_rpc.o 00:03:36.179 CC module/blob/bdev/blob_bdev.o 00:03:36.179 CC module/accel/ioat/accel_ioat.o 00:03:36.179 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:36.179 CC module/accel/dsa/accel_dsa.o 00:03:36.179 CC module/accel/iaa/accel_iaa.o 00:03:36.179 CC module/accel/dsa/accel_dsa_rpc.o 00:03:36.179 CC module/sock/posix/posix.o 00:03:36.179 CC module/accel/iaa/accel_iaa_rpc.o 00:03:36.179 CC module/accel/ioat/accel_ioat_rpc.o 00:03:36.179 CC module/accel/error/accel_error.o 00:03:36.179 CC module/scheduler/gscheduler/gscheduler.o 00:03:36.179 CC module/accel/error/accel_error_rpc.o 00:03:36.436 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:36.436 LIB libspdk_env_dpdk_rpc.a 00:03:36.436 SO libspdk_env_dpdk_rpc.so.5.0 00:03:36.436 SYMLINK libspdk_env_dpdk_rpc.so 00:03:36.436 LIB libspdk_scheduler_dpdk_governor.a 00:03:36.436 LIB libspdk_scheduler_gscheduler.a 00:03:36.436 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:36.436 SO libspdk_scheduler_gscheduler.so.3.0 00:03:36.436 LIB libspdk_accel_error.a 00:03:36.436 LIB libspdk_accel_ioat.a 00:03:36.436 LIB libspdk_scheduler_dynamic.a 00:03:36.436 LIB libspdk_accel_iaa.a 00:03:36.436 SO libspdk_accel_ioat.so.5.0 00:03:36.436 SO libspdk_accel_error.so.1.0 00:03:36.436 SYMLINK libspdk_scheduler_gscheduler.so 00:03:36.436 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:36.436 SO libspdk_scheduler_dynamic.so.3.0 00:03:36.436 SO libspdk_accel_iaa.so.2.0 00:03:36.694 LIB libspdk_accel_dsa.a 00:03:36.694 SO libspdk_accel_dsa.so.4.0 00:03:36.694 SYMLINK libspdk_accel_ioat.so 00:03:36.694 SYMLINK libspdk_accel_error.so 00:03:36.694 SYMLINK libspdk_scheduler_dynamic.so 00:03:36.694 LIB libspdk_blob_bdev.a 00:03:36.694 SYMLINK libspdk_accel_iaa.so 00:03:36.694 SO libspdk_blob_bdev.so.10.1 00:03:36.694 SYMLINK libspdk_accel_dsa.so 00:03:36.694 SYMLINK libspdk_blob_bdev.so 00:03:36.952 CC module/bdev/null/bdev_null.o 00:03:36.952 CC module/bdev/error/vbdev_error.o 00:03:36.952 CC module/bdev/error/vbdev_error_rpc.o 00:03:36.952 CC module/bdev/null/bdev_null_rpc.o 00:03:36.952 CC module/bdev/gpt/gpt.o 00:03:36.952 CC module/bdev/aio/bdev_aio.o 00:03:36.952 CC module/bdev/iscsi/bdev_iscsi.o 00:03:36.952 CC module/bdev/gpt/vbdev_gpt.o 00:03:36.952 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:36.952 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:36.952 CC module/bdev/aio/bdev_aio_rpc.o 00:03:36.952 CC module/bdev/nvme/bdev_nvme.o 00:03:36.952 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:36.952 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:36.952 CC module/bdev/malloc/bdev_malloc.o 00:03:36.952 CC module/bdev/raid/bdev_raid.o 00:03:36.952 CC module/bdev/nvme/nvme_rpc.o 00:03:36.952 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:36.952 CC module/bdev/delay/vbdev_delay.o 00:03:36.952 CC module/bdev/raid/bdev_raid_rpc.o 00:03:36.952 CC module/bdev/lvol/vbdev_lvol.o 00:03:36.952 CC module/blobfs/bdev/blobfs_bdev.o 00:03:36.952 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:36.952 CC module/bdev/passthru/vbdev_passthru.o 00:03:36.952 CC module/bdev/raid/bdev_raid_sb.o 00:03:36.952 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:36.952 CC module/bdev/nvme/bdev_mdns_client.o 00:03:36.952 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:36.952 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:36.952 CC module/bdev/nvme/vbdev_opal.o 00:03:36.952 CC module/bdev/raid/raid0.o 00:03:36.952 CC module/bdev/ftl/bdev_ftl.o 00:03:36.952 CC module/bdev/raid/raid1.o 00:03:36.952 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:36.952 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:36.953 CC module/bdev/raid/concat.o 00:03:36.953 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:36.953 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:36.953 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:36.953 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:36.953 CC module/bdev/split/vbdev_split.o 00:03:36.953 CC module/bdev/split/vbdev_split_rpc.o 00:03:36.953 LIB libspdk_vfu_device.a 00:03:36.953 SO libspdk_vfu_device.so.2.0 00:03:37.211 SYMLINK libspdk_vfu_device.so 00:03:37.211 LIB libspdk_bdev_split.a 00:03:37.211 LIB libspdk_blobfs_bdev.a 00:03:37.211 SO libspdk_bdev_split.so.5.0 00:03:37.211 LIB libspdk_bdev_error.a 00:03:37.211 SO libspdk_blobfs_bdev.so.5.0 00:03:37.211 LIB libspdk_sock_posix.a 00:03:37.211 SO libspdk_bdev_error.so.5.0 00:03:37.211 SO libspdk_sock_posix.so.5.0 00:03:37.211 SYMLINK libspdk_bdev_split.so 00:03:37.211 LIB libspdk_bdev_gpt.a 00:03:37.211 SYMLINK libspdk_blobfs_bdev.so 00:03:37.211 SO libspdk_bdev_gpt.so.5.0 00:03:37.211 SYMLINK libspdk_bdev_error.so 00:03:37.469 SYMLINK libspdk_sock_posix.so 00:03:37.469 LIB libspdk_bdev_null.a 00:03:37.469 LIB libspdk_bdev_ftl.a 00:03:37.469 SYMLINK libspdk_bdev_gpt.so 00:03:37.469 LIB libspdk_bdev_passthru.a 00:03:37.469 SO libspdk_bdev_null.so.5.0 00:03:37.469 LIB libspdk_bdev_aio.a 00:03:37.469 SO libspdk_bdev_ftl.so.5.0 00:03:37.469 SO libspdk_bdev_passthru.so.5.0 00:03:37.469 SO libspdk_bdev_aio.so.5.0 00:03:37.469 LIB libspdk_bdev_delay.a 00:03:37.469 LIB libspdk_bdev_iscsi.a 00:03:37.469 SYMLINK libspdk_bdev_null.so 00:03:37.469 LIB libspdk_bdev_zone_block.a 00:03:37.469 SO libspdk_bdev_iscsi.so.5.0 00:03:37.469 SO libspdk_bdev_delay.so.5.0 00:03:37.469 SYMLINK libspdk_bdev_ftl.so 00:03:37.469 SYMLINK libspdk_bdev_passthru.so 00:03:37.469 SO libspdk_bdev_zone_block.so.5.0 00:03:37.469 SYMLINK libspdk_bdev_aio.so 00:03:37.469 LIB libspdk_bdev_malloc.a 00:03:37.469 SO libspdk_bdev_malloc.so.5.0 00:03:37.469 SYMLINK libspdk_bdev_iscsi.so 00:03:37.469 SYMLINK libspdk_bdev_delay.so 00:03:37.469 SYMLINK libspdk_bdev_zone_block.so 00:03:37.469 LIB libspdk_bdev_lvol.a 00:03:37.469 SYMLINK libspdk_bdev_malloc.so 00:03:37.469 SO libspdk_bdev_lvol.so.5.0 00:03:37.727 SYMLINK libspdk_bdev_lvol.so 00:03:37.727 LIB libspdk_bdev_virtio.a 00:03:37.727 SO libspdk_bdev_virtio.so.5.0 00:03:37.727 SYMLINK libspdk_bdev_virtio.so 00:03:37.985 LIB libspdk_bdev_raid.a 00:03:37.985 SO libspdk_bdev_raid.so.5.0 00:03:37.985 SYMLINK libspdk_bdev_raid.so 00:03:39.361 LIB libspdk_bdev_nvme.a 00:03:39.361 SO libspdk_bdev_nvme.so.6.0 00:03:39.361 SYMLINK libspdk_bdev_nvme.so 00:03:39.618 CC module/event/subsystems/sock/sock.o 00:03:39.618 CC module/event/subsystems/scheduler/scheduler.o 00:03:39.618 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:39.618 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:39.618 CC module/event/subsystems/iobuf/iobuf.o 00:03:39.618 CC module/event/subsystems/vmd/vmd.o 00:03:39.618 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:39.618 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:39.618 LIB libspdk_event_sock.a 00:03:39.618 LIB libspdk_event_vhost_blk.a 00:03:39.618 LIB libspdk_event_scheduler.a 00:03:39.618 LIB libspdk_event_vfu_tgt.a 00:03:39.618 LIB libspdk_event_vmd.a 00:03:39.618 SO libspdk_event_sock.so.4.0 00:03:39.618 SO libspdk_event_vhost_blk.so.2.0 00:03:39.618 LIB libspdk_event_iobuf.a 00:03:39.618 SO libspdk_event_vfu_tgt.so.2.0 00:03:39.618 SO libspdk_event_scheduler.so.3.0 00:03:39.876 SO libspdk_event_vmd.so.5.0 00:03:39.876 SO libspdk_event_iobuf.so.2.0 00:03:39.876 SYMLINK libspdk_event_sock.so 00:03:39.876 SYMLINK libspdk_event_vhost_blk.so 00:03:39.876 SYMLINK libspdk_event_vfu_tgt.so 00:03:39.876 SYMLINK libspdk_event_scheduler.so 00:03:39.876 SYMLINK libspdk_event_vmd.so 00:03:39.876 SYMLINK libspdk_event_iobuf.so 00:03:39.876 CC module/event/subsystems/accel/accel.o 00:03:40.136 LIB libspdk_event_accel.a 00:03:40.136 SO libspdk_event_accel.so.5.0 00:03:40.136 SYMLINK libspdk_event_accel.so 00:03:40.394 CC module/event/subsystems/bdev/bdev.o 00:03:40.394 LIB libspdk_event_bdev.a 00:03:40.394 SO libspdk_event_bdev.so.5.0 00:03:40.394 SYMLINK libspdk_event_bdev.so 00:03:40.653 CC module/event/subsystems/scsi/scsi.o 00:03:40.653 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:40.653 CC module/event/subsystems/nbd/nbd.o 00:03:40.653 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:40.653 CC module/event/subsystems/ublk/ublk.o 00:03:40.653 LIB libspdk_event_nbd.a 00:03:40.653 LIB libspdk_event_ublk.a 00:03:40.910 LIB libspdk_event_scsi.a 00:03:40.910 SO libspdk_event_nbd.so.5.0 00:03:40.910 SO libspdk_event_ublk.so.2.0 00:03:40.910 SO libspdk_event_scsi.so.5.0 00:03:40.910 SYMLINK libspdk_event_ublk.so 00:03:40.910 SYMLINK libspdk_event_nbd.so 00:03:40.910 SYMLINK libspdk_event_scsi.so 00:03:40.910 LIB libspdk_event_nvmf.a 00:03:40.910 SO libspdk_event_nvmf.so.5.0 00:03:40.910 SYMLINK libspdk_event_nvmf.so 00:03:40.910 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:40.910 CC module/event/subsystems/iscsi/iscsi.o 00:03:41.168 LIB libspdk_event_vhost_scsi.a 00:03:41.168 SO libspdk_event_vhost_scsi.so.2.0 00:03:41.168 LIB libspdk_event_iscsi.a 00:03:41.168 SO libspdk_event_iscsi.so.5.0 00:03:41.168 SYMLINK libspdk_event_vhost_scsi.so 00:03:41.168 SYMLINK libspdk_event_iscsi.so 00:03:41.168 SO libspdk.so.5.0 00:03:41.168 SYMLINK libspdk.so 00:03:41.432 CXX app/trace/trace.o 00:03:41.432 CC app/spdk_lspci/spdk_lspci.o 00:03:41.432 TEST_HEADER include/spdk/accel.h 00:03:41.432 CC app/trace_record/trace_record.o 00:03:41.432 CC app/spdk_top/spdk_top.o 00:03:41.432 CC app/spdk_nvme_perf/perf.o 00:03:41.432 CC app/spdk_nvme_discover/discovery_aer.o 00:03:41.432 TEST_HEADER include/spdk/accel_module.h 00:03:41.432 CC app/spdk_nvme_identify/identify.o 00:03:41.432 TEST_HEADER include/spdk/assert.h 00:03:41.432 TEST_HEADER include/spdk/barrier.h 00:03:41.432 TEST_HEADER include/spdk/base64.h 00:03:41.432 CC test/rpc_client/rpc_client_test.o 00:03:41.432 TEST_HEADER include/spdk/bdev.h 00:03:41.432 TEST_HEADER include/spdk/bdev_module.h 00:03:41.432 TEST_HEADER include/spdk/bdev_zone.h 00:03:41.432 TEST_HEADER include/spdk/bit_array.h 00:03:41.432 TEST_HEADER include/spdk/bit_pool.h 00:03:41.432 TEST_HEADER include/spdk/blob_bdev.h 00:03:41.432 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:41.432 TEST_HEADER include/spdk/blobfs.h 00:03:41.432 TEST_HEADER include/spdk/blob.h 00:03:41.432 TEST_HEADER include/spdk/conf.h 00:03:41.432 TEST_HEADER include/spdk/config.h 00:03:41.432 TEST_HEADER include/spdk/cpuset.h 00:03:41.432 CC app/spdk_dd/spdk_dd.o 00:03:41.432 TEST_HEADER include/spdk/crc16.h 00:03:41.432 TEST_HEADER include/spdk/crc32.h 00:03:41.432 TEST_HEADER include/spdk/crc64.h 00:03:41.432 CC app/nvmf_tgt/nvmf_main.o 00:03:41.432 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:41.432 TEST_HEADER include/spdk/dif.h 00:03:41.432 TEST_HEADER include/spdk/dma.h 00:03:41.432 TEST_HEADER include/spdk/endian.h 00:03:41.432 TEST_HEADER include/spdk/env_dpdk.h 00:03:41.432 TEST_HEADER include/spdk/env.h 00:03:41.432 CC app/iscsi_tgt/iscsi_tgt.o 00:03:41.432 CC app/vhost/vhost.o 00:03:41.432 CC examples/vmd/lsvmd/lsvmd.o 00:03:41.432 CC examples/util/zipf/zipf.o 00:03:41.432 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:41.432 CC examples/sock/hello_world/hello_sock.o 00:03:41.432 CC examples/nvme/hello_world/hello_world.o 00:03:41.432 TEST_HEADER include/spdk/event.h 00:03:41.432 CC examples/nvme/arbitration/arbitration.o 00:03:41.432 CC examples/ioat/verify/verify.o 00:03:41.432 CC examples/nvme/abort/abort.o 00:03:41.432 CC examples/idxd/perf/perf.o 00:03:41.432 TEST_HEADER include/spdk/fd_group.h 00:03:41.432 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:41.432 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:41.432 TEST_HEADER include/spdk/fd.h 00:03:41.432 CC examples/nvme/reconnect/reconnect.o 00:03:41.432 CC examples/ioat/perf/perf.o 00:03:41.432 CC examples/vmd/led/led.o 00:03:41.432 TEST_HEADER include/spdk/file.h 00:03:41.432 TEST_HEADER include/spdk/ftl.h 00:03:41.432 CC examples/accel/perf/accel_perf.o 00:03:41.432 CC app/fio/nvme/fio_plugin.o 00:03:41.432 TEST_HEADER include/spdk/gpt_spec.h 00:03:41.432 CC examples/nvme/hotplug/hotplug.o 00:03:41.432 TEST_HEADER include/spdk/hexlify.h 00:03:41.432 TEST_HEADER include/spdk/histogram_data.h 00:03:41.432 CC test/event/event_perf/event_perf.o 00:03:41.432 CC test/thread/poller_perf/poller_perf.o 00:03:41.697 TEST_HEADER include/spdk/idxd.h 00:03:41.697 CC app/spdk_tgt/spdk_tgt.o 00:03:41.697 TEST_HEADER include/spdk/idxd_spec.h 00:03:41.697 CC test/nvme/aer/aer.o 00:03:41.697 TEST_HEADER include/spdk/init.h 00:03:41.697 TEST_HEADER include/spdk/ioat.h 00:03:41.697 TEST_HEADER include/spdk/ioat_spec.h 00:03:41.697 TEST_HEADER include/spdk/iscsi_spec.h 00:03:41.697 TEST_HEADER include/spdk/json.h 00:03:41.697 TEST_HEADER include/spdk/jsonrpc.h 00:03:41.697 CC examples/blob/cli/blobcli.o 00:03:41.697 TEST_HEADER include/spdk/likely.h 00:03:41.697 TEST_HEADER include/spdk/log.h 00:03:41.697 TEST_HEADER include/spdk/lvol.h 00:03:41.697 CC examples/blob/hello_world/hello_blob.o 00:03:41.697 TEST_HEADER include/spdk/memory.h 00:03:41.697 TEST_HEADER include/spdk/mmio.h 00:03:41.697 CC examples/bdev/hello_world/hello_bdev.o 00:03:41.697 TEST_HEADER include/spdk/nbd.h 00:03:41.697 CC examples/nvmf/nvmf/nvmf.o 00:03:41.697 CC test/accel/dif/dif.o 00:03:41.697 CC test/blobfs/mkfs/mkfs.o 00:03:41.697 CC examples/thread/thread/thread_ex.o 00:03:41.697 CC examples/bdev/bdevperf/bdevperf.o 00:03:41.697 TEST_HEADER include/spdk/notify.h 00:03:41.697 CC test/dma/test_dma/test_dma.o 00:03:41.697 TEST_HEADER include/spdk/nvme.h 00:03:41.697 CC test/app/bdev_svc/bdev_svc.o 00:03:41.697 CC test/bdev/bdevio/bdevio.o 00:03:41.697 TEST_HEADER include/spdk/nvme_intel.h 00:03:41.697 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:41.697 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:41.697 TEST_HEADER include/spdk/nvme_spec.h 00:03:41.697 CC test/env/mem_callbacks/mem_callbacks.o 00:03:41.697 TEST_HEADER include/spdk/nvme_zns.h 00:03:41.697 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:41.697 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:41.697 TEST_HEADER include/spdk/nvmf.h 00:03:41.697 TEST_HEADER include/spdk/nvmf_spec.h 00:03:41.697 TEST_HEADER include/spdk/nvmf_transport.h 00:03:41.697 CC test/lvol/esnap/esnap.o 00:03:41.697 TEST_HEADER include/spdk/opal.h 00:03:41.697 TEST_HEADER include/spdk/opal_spec.h 00:03:41.697 TEST_HEADER include/spdk/pci_ids.h 00:03:41.697 TEST_HEADER include/spdk/pipe.h 00:03:41.697 TEST_HEADER include/spdk/queue.h 00:03:41.697 TEST_HEADER include/spdk/reduce.h 00:03:41.697 TEST_HEADER include/spdk/rpc.h 00:03:41.697 TEST_HEADER include/spdk/scheduler.h 00:03:41.697 TEST_HEADER include/spdk/scsi.h 00:03:41.697 TEST_HEADER include/spdk/scsi_spec.h 00:03:41.697 TEST_HEADER include/spdk/sock.h 00:03:41.697 TEST_HEADER include/spdk/stdinc.h 00:03:41.697 TEST_HEADER include/spdk/string.h 00:03:41.697 TEST_HEADER include/spdk/thread.h 00:03:41.697 TEST_HEADER include/spdk/trace.h 00:03:41.697 LINK spdk_lspci 00:03:41.697 TEST_HEADER include/spdk/trace_parser.h 00:03:41.697 TEST_HEADER include/spdk/tree.h 00:03:41.697 TEST_HEADER include/spdk/ublk.h 00:03:41.697 TEST_HEADER include/spdk/util.h 00:03:41.697 TEST_HEADER include/spdk/uuid.h 00:03:41.697 TEST_HEADER include/spdk/version.h 00:03:41.697 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:41.697 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:41.697 TEST_HEADER include/spdk/vhost.h 00:03:41.697 TEST_HEADER include/spdk/vmd.h 00:03:41.697 TEST_HEADER include/spdk/xor.h 00:03:41.697 TEST_HEADER include/spdk/zipf.h 00:03:41.697 CXX test/cpp_headers/accel.o 00:03:41.697 LINK lsvmd 00:03:41.959 LINK rpc_client_test 00:03:41.959 LINK led 00:03:41.959 LINK spdk_nvme_discover 00:03:41.959 LINK event_perf 00:03:41.959 LINK zipf 00:03:41.959 LINK poller_perf 00:03:41.959 LINK interrupt_tgt 00:03:41.959 LINK nvmf_tgt 00:03:41.959 LINK pmr_persistence 00:03:41.959 LINK cmb_copy 00:03:41.959 LINK vhost 00:03:41.959 LINK iscsi_tgt 00:03:41.959 LINK spdk_trace_record 00:03:41.959 LINK verify 00:03:41.959 LINK ioat_perf 00:03:41.959 LINK spdk_tgt 00:03:41.959 LINK bdev_svc 00:03:41.959 LINK hello_world 00:03:41.959 LINK hotplug 00:03:41.959 LINK mkfs 00:03:41.959 LINK mem_callbacks 00:03:41.959 LINK hello_sock 00:03:41.959 LINK hello_blob 00:03:42.224 LINK hello_bdev 00:03:42.224 LINK thread 00:03:42.224 LINK aer 00:03:42.224 CXX test/cpp_headers/accel_module.o 00:03:42.224 CXX test/cpp_headers/assert.o 00:03:42.224 LINK arbitration 00:03:42.224 CC app/fio/bdev/fio_plugin.o 00:03:42.224 LINK idxd_perf 00:03:42.224 LINK spdk_dd 00:03:42.224 CXX test/cpp_headers/barrier.o 00:03:42.224 LINK reconnect 00:03:42.224 LINK nvmf 00:03:42.224 CC test/event/reactor/reactor.o 00:03:42.224 CC test/env/vtophys/vtophys.o 00:03:42.224 LINK abort 00:03:42.224 CC test/nvme/reset/reset.o 00:03:42.224 CC test/event/reactor_perf/reactor_perf.o 00:03:42.224 CXX test/cpp_headers/base64.o 00:03:42.224 LINK spdk_trace 00:03:42.224 CC test/app/histogram_perf/histogram_perf.o 00:03:42.224 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:42.224 LINK dif 00:03:42.485 CXX test/cpp_headers/bdev.o 00:03:42.485 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:42.485 LINK bdevio 00:03:42.485 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:42.485 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:42.485 CC test/event/app_repeat/app_repeat.o 00:03:42.485 CC test/app/jsoncat/jsoncat.o 00:03:42.485 CC test/nvme/sgl/sgl.o 00:03:42.485 CXX test/cpp_headers/bdev_module.o 00:03:42.485 LINK test_dma 00:03:42.485 LINK accel_perf 00:03:42.485 CC test/env/memory/memory_ut.o 00:03:42.485 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:42.485 CC test/env/pci/pci_ut.o 00:03:42.485 CC test/nvme/e2edp/nvme_dp.o 00:03:42.485 LINK nvme_manage 00:03:42.485 CC test/app/stub/stub.o 00:03:42.485 CXX test/cpp_headers/bdev_zone.o 00:03:42.485 CXX test/cpp_headers/bit_array.o 00:03:42.485 LINK reactor 00:03:42.485 CC test/nvme/overhead/overhead.o 00:03:42.485 LINK vtophys 00:03:42.485 LINK blobcli 00:03:42.485 CXX test/cpp_headers/bit_pool.o 00:03:42.485 CC test/event/scheduler/scheduler.o 00:03:42.485 LINK reactor_perf 00:03:42.485 LINK spdk_nvme 00:03:42.485 LINK histogram_perf 00:03:42.485 CC test/nvme/err_injection/err_injection.o 00:03:42.750 CC test/nvme/reserve/reserve.o 00:03:42.750 CC test/nvme/startup/startup.o 00:03:42.750 CC test/nvme/simple_copy/simple_copy.o 00:03:42.750 CC test/nvme/connect_stress/connect_stress.o 00:03:42.750 CXX test/cpp_headers/blob_bdev.o 00:03:42.750 CC test/nvme/boot_partition/boot_partition.o 00:03:42.750 LINK env_dpdk_post_init 00:03:42.750 LINK jsoncat 00:03:42.750 CC test/nvme/compliance/nvme_compliance.o 00:03:42.750 LINK app_repeat 00:03:42.750 CC test/nvme/fused_ordering/fused_ordering.o 00:03:42.750 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:42.750 CXX test/cpp_headers/blobfs_bdev.o 00:03:42.750 CC test/nvme/cuse/cuse.o 00:03:42.750 CXX test/cpp_headers/blobfs.o 00:03:42.750 CC test/nvme/fdp/fdp.o 00:03:42.750 CXX test/cpp_headers/blob.o 00:03:42.750 CXX test/cpp_headers/conf.o 00:03:42.750 CXX test/cpp_headers/config.o 00:03:42.750 LINK reset 00:03:42.750 CXX test/cpp_headers/crc16.o 00:03:42.750 CXX test/cpp_headers/cpuset.o 00:03:42.750 CXX test/cpp_headers/crc32.o 00:03:42.750 CXX test/cpp_headers/crc64.o 00:03:42.750 LINK stub 00:03:42.750 CXX test/cpp_headers/dif.o 00:03:42.750 CXX test/cpp_headers/dma.o 00:03:43.009 CXX test/cpp_headers/endian.o 00:03:43.009 CXX test/cpp_headers/env_dpdk.o 00:03:43.009 CXX test/cpp_headers/env.o 00:03:43.009 CXX test/cpp_headers/event.o 00:03:43.009 LINK sgl 00:03:43.009 CXX test/cpp_headers/fd_group.o 00:03:43.009 CXX test/cpp_headers/fd.o 00:03:43.009 CXX test/cpp_headers/file.o 00:03:43.009 LINK connect_stress 00:03:43.009 LINK startup 00:03:43.009 LINK spdk_nvme_perf 00:03:43.009 CXX test/cpp_headers/ftl.o 00:03:43.009 LINK boot_partition 00:03:43.009 LINK err_injection 00:03:43.009 LINK nvme_dp 00:03:43.009 LINK scheduler 00:03:43.009 CXX test/cpp_headers/gpt_spec.o 00:03:43.009 LINK spdk_nvme_identify 00:03:43.009 LINK reserve 00:03:43.009 CXX test/cpp_headers/hexlify.o 00:03:43.009 LINK overhead 00:03:43.009 LINK spdk_top 00:03:43.009 LINK fused_ordering 00:03:43.009 CXX test/cpp_headers/histogram_data.o 00:03:43.009 LINK nvme_fuzz 00:03:43.009 LINK simple_copy 00:03:43.276 LINK bdevperf 00:03:43.276 LINK doorbell_aers 00:03:43.276 CXX test/cpp_headers/idxd.o 00:03:43.276 CXX test/cpp_headers/idxd_spec.o 00:03:43.276 CXX test/cpp_headers/init.o 00:03:43.276 CXX test/cpp_headers/ioat.o 00:03:43.276 CXX test/cpp_headers/ioat_spec.o 00:03:43.276 LINK pci_ut 00:03:43.276 CXX test/cpp_headers/iscsi_spec.o 00:03:43.276 CXX test/cpp_headers/json.o 00:03:43.276 LINK spdk_bdev 00:03:43.276 CXX test/cpp_headers/jsonrpc.o 00:03:43.276 CXX test/cpp_headers/likely.o 00:03:43.276 CXX test/cpp_headers/log.o 00:03:43.276 CXX test/cpp_headers/lvol.o 00:03:43.276 LINK vhost_fuzz 00:03:43.276 CXX test/cpp_headers/memory.o 00:03:43.276 CXX test/cpp_headers/mmio.o 00:03:43.276 CXX test/cpp_headers/nbd.o 00:03:43.276 CXX test/cpp_headers/notify.o 00:03:43.276 CXX test/cpp_headers/nvme.o 00:03:43.276 CXX test/cpp_headers/nvme_intel.o 00:03:43.276 CXX test/cpp_headers/nvme_ocssd.o 00:03:43.276 LINK nvme_compliance 00:03:43.276 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:43.276 CXX test/cpp_headers/nvme_zns.o 00:03:43.276 CXX test/cpp_headers/nvme_spec.o 00:03:43.276 CXX test/cpp_headers/nvmf_cmd.o 00:03:43.276 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:43.276 CXX test/cpp_headers/nvmf.o 00:03:43.276 CXX test/cpp_headers/nvmf_spec.o 00:03:43.276 CXX test/cpp_headers/nvmf_transport.o 00:03:43.276 CXX test/cpp_headers/opal.o 00:03:43.536 CXX test/cpp_headers/opal_spec.o 00:03:43.536 LINK fdp 00:03:43.536 CXX test/cpp_headers/pci_ids.o 00:03:43.536 LINK memory_ut 00:03:43.536 CXX test/cpp_headers/pipe.o 00:03:43.536 CXX test/cpp_headers/queue.o 00:03:43.536 CXX test/cpp_headers/reduce.o 00:03:43.536 CXX test/cpp_headers/rpc.o 00:03:43.536 CXX test/cpp_headers/scheduler.o 00:03:43.536 CXX test/cpp_headers/scsi.o 00:03:43.536 CXX test/cpp_headers/scsi_spec.o 00:03:43.536 CXX test/cpp_headers/sock.o 00:03:43.536 CXX test/cpp_headers/stdinc.o 00:03:43.536 CXX test/cpp_headers/string.o 00:03:43.536 CXX test/cpp_headers/thread.o 00:03:43.536 CXX test/cpp_headers/trace.o 00:03:43.536 CXX test/cpp_headers/trace_parser.o 00:03:43.536 CXX test/cpp_headers/tree.o 00:03:43.536 CXX test/cpp_headers/ublk.o 00:03:43.536 CXX test/cpp_headers/util.o 00:03:43.536 CXX test/cpp_headers/uuid.o 00:03:43.536 CXX test/cpp_headers/version.o 00:03:43.536 CXX test/cpp_headers/vfio_user_pci.o 00:03:43.536 CXX test/cpp_headers/vfio_user_spec.o 00:03:43.536 CXX test/cpp_headers/vhost.o 00:03:43.536 CXX test/cpp_headers/vmd.o 00:03:43.536 CXX test/cpp_headers/xor.o 00:03:43.536 CXX test/cpp_headers/zipf.o 00:03:44.470 LINK cuse 00:03:44.731 LINK iscsi_fuzz 00:03:47.263 LINK esnap 00:03:47.522 00:03:47.522 real 0m38.193s 00:03:47.522 user 7m14.834s 00:03:47.522 sys 1m38.618s 00:03:47.522 02:15:12 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:47.522 02:15:12 -- common/autotest_common.sh@10 -- $ set +x 00:03:47.522 ************************************ 00:03:47.522 END TEST make 00:03:47.522 ************************************ 00:03:47.522 02:15:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:47.522 02:15:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:47.522 02:15:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:47.781 02:15:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:47.782 02:15:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:47.782 02:15:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:47.782 02:15:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:47.782 02:15:12 -- scripts/common.sh@335 -- # IFS=.-: 00:03:47.782 02:15:12 -- scripts/common.sh@335 -- # read -ra ver1 00:03:47.782 02:15:12 -- scripts/common.sh@336 -- # IFS=.-: 00:03:47.782 02:15:12 -- scripts/common.sh@336 -- # read -ra ver2 00:03:47.782 02:15:12 -- scripts/common.sh@337 -- # local 'op=<' 00:03:47.782 02:15:12 -- scripts/common.sh@339 -- # ver1_l=2 00:03:47.782 02:15:12 -- scripts/common.sh@340 -- # ver2_l=1 00:03:47.782 02:15:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:47.782 02:15:12 -- scripts/common.sh@343 -- # case "$op" in 00:03:47.782 02:15:12 -- scripts/common.sh@344 -- # : 1 00:03:47.782 02:15:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:47.782 02:15:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:47.782 02:15:12 -- scripts/common.sh@364 -- # decimal 1 00:03:47.782 02:15:12 -- scripts/common.sh@352 -- # local d=1 00:03:47.782 02:15:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:47.782 02:15:12 -- scripts/common.sh@354 -- # echo 1 00:03:47.782 02:15:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:47.782 02:15:12 -- scripts/common.sh@365 -- # decimal 2 00:03:47.782 02:15:12 -- scripts/common.sh@352 -- # local d=2 00:03:47.782 02:15:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:47.782 02:15:12 -- scripts/common.sh@354 -- # echo 2 00:03:47.782 02:15:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:47.782 02:15:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:47.782 02:15:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:47.782 02:15:12 -- scripts/common.sh@367 -- # return 0 00:03:47.782 02:15:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:47.782 02:15:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.782 --rc genhtml_branch_coverage=1 00:03:47.782 --rc genhtml_function_coverage=1 00:03:47.782 --rc genhtml_legend=1 00:03:47.782 --rc geninfo_all_blocks=1 00:03:47.782 --rc geninfo_unexecuted_blocks=1 00:03:47.782 00:03:47.782 ' 00:03:47.782 02:15:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.782 --rc genhtml_branch_coverage=1 00:03:47.782 --rc genhtml_function_coverage=1 00:03:47.782 --rc genhtml_legend=1 00:03:47.782 --rc geninfo_all_blocks=1 00:03:47.782 --rc geninfo_unexecuted_blocks=1 00:03:47.782 00:03:47.782 ' 00:03:47.782 02:15:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.782 --rc genhtml_branch_coverage=1 00:03:47.782 --rc genhtml_function_coverage=1 00:03:47.782 --rc genhtml_legend=1 00:03:47.782 --rc geninfo_all_blocks=1 00:03:47.782 --rc geninfo_unexecuted_blocks=1 00:03:47.782 00:03:47.782 ' 00:03:47.782 02:15:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.782 --rc genhtml_branch_coverage=1 00:03:47.782 --rc genhtml_function_coverage=1 00:03:47.782 --rc genhtml_legend=1 00:03:47.782 --rc geninfo_all_blocks=1 00:03:47.782 --rc geninfo_unexecuted_blocks=1 00:03:47.782 00:03:47.782 ' 00:03:47.782 02:15:12 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:47.782 02:15:12 -- nvmf/common.sh@7 -- # uname -s 00:03:47.782 02:15:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:47.782 02:15:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:47.782 02:15:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:47.782 02:15:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:47.782 02:15:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:47.782 02:15:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:47.782 02:15:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:47.782 02:15:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:47.782 02:15:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:47.782 02:15:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:47.782 02:15:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:47.782 02:15:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:47.782 02:15:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:47.782 02:15:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:47.782 02:15:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:47.782 02:15:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:47.782 02:15:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:47.782 02:15:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:47.782 02:15:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:47.782 02:15:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.782 02:15:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.782 02:15:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.782 02:15:12 -- paths/export.sh@5 -- # export PATH 00:03:47.782 02:15:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.782 02:15:12 -- nvmf/common.sh@46 -- # : 0 00:03:47.782 02:15:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:47.782 02:15:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:47.782 02:15:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:47.782 02:15:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:47.782 02:15:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:47.782 02:15:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:47.782 02:15:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:47.782 02:15:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:47.782 02:15:12 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:47.782 02:15:12 -- spdk/autotest.sh@32 -- # uname -s 00:03:47.782 02:15:12 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:47.782 02:15:12 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:47.782 02:15:12 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:47.782 02:15:12 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:47.782 02:15:12 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:47.782 02:15:12 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:47.782 02:15:12 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:47.782 02:15:12 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:47.782 02:15:12 -- spdk/autotest.sh@48 -- # udevadm_pid=1914645 00:03:47.782 02:15:12 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:47.782 02:15:12 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:47.782 02:15:12 -- spdk/autotest.sh@54 -- # echo 1914647 00:03:47.782 02:15:12 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:47.782 02:15:12 -- spdk/autotest.sh@56 -- # echo 1914648 00:03:47.783 02:15:12 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:47.783 02:15:12 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:47.783 02:15:12 -- spdk/autotest.sh@60 -- # echo 1914649 00:03:47.783 02:15:12 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:47.783 02:15:12 -- spdk/autotest.sh@62 -- # echo 1914650 00:03:47.783 02:15:12 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:47.783 02:15:12 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:47.783 02:15:12 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:47.783 02:15:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:47.783 02:15:12 -- common/autotest_common.sh@10 -- # set +x 00:03:47.783 02:15:12 -- spdk/autotest.sh@70 -- # create_test_list 00:03:47.783 02:15:12 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:47.783 02:15:12 -- common/autotest_common.sh@10 -- # set +x 00:03:47.783 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:47.783 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:47.783 02:15:12 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:47.783 02:15:12 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:47.783 02:15:12 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:47.783 02:15:12 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:47.783 02:15:12 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:47.783 02:15:12 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:47.783 02:15:12 -- common/autotest_common.sh@1450 -- # uname 00:03:47.783 02:15:12 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:47.783 02:15:12 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:47.783 02:15:12 -- common/autotest_common.sh@1470 -- # uname 00:03:47.783 02:15:12 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:47.783 02:15:12 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:47.783 02:15:12 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:47.783 lcov: LCOV version 1.15 00:03:47.783 02:15:12 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:51.064 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:51.064 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:51.064 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:51.064 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:51.064 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:51.064 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:23.129 02:15:45 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:23.129 02:15:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:23.129 02:15:45 -- common/autotest_common.sh@10 -- # set +x 00:04:23.129 02:15:45 -- spdk/autotest.sh@89 -- # rm -f 00:04:23.129 02:15:45 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:23.129 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:23.129 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:23.129 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:23.129 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:23.129 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:23.129 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:23.129 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:23.129 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:23.129 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:23.129 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:23.129 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:23.129 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:23.129 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:23.129 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:23.129 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:23.129 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:23.129 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:23.129 02:15:47 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:23.129 02:15:47 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:23.129 02:15:47 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:23.129 02:15:47 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:23.129 02:15:47 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:23.129 02:15:47 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:23.129 02:15:47 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:23.129 02:15:47 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:23.129 02:15:47 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:23.129 02:15:47 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:23.129 02:15:47 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:23.129 02:15:47 -- spdk/autotest.sh@108 -- # grep -v p 00:04:23.129 02:15:47 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:23.129 02:15:47 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:23.129 02:15:47 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:23.129 02:15:47 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:23.129 02:15:47 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:23.129 No valid GPT data, bailing 00:04:23.129 02:15:47 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:23.129 02:15:47 -- scripts/common.sh@393 -- # pt= 00:04:23.129 02:15:47 -- scripts/common.sh@394 -- # return 1 00:04:23.129 02:15:47 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:23.129 1+0 records in 00:04:23.129 1+0 records out 00:04:23.129 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00233924 s, 448 MB/s 00:04:23.129 02:15:47 -- spdk/autotest.sh@116 -- # sync 00:04:23.129 02:15:47 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:23.129 02:15:47 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:23.129 02:15:47 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:25.030 02:15:49 -- spdk/autotest.sh@122 -- # uname -s 00:04:25.030 02:15:49 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:25.030 02:15:49 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:25.030 02:15:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.030 02:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:25.030 ************************************ 00:04:25.030 START TEST setup.sh 00:04:25.030 ************************************ 00:04:25.030 02:15:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:25.030 * Looking for test storage... 00:04:25.030 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:25.030 02:15:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:25.030 02:15:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:25.030 02:15:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:25.030 02:15:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:25.030 02:15:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:25.030 02:15:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:25.030 02:15:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:25.030 02:15:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:25.030 02:15:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:25.030 02:15:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:25.030 02:15:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:25.030 02:15:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:25.030 02:15:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:25.030 02:15:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:25.030 02:15:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:25.030 02:15:49 -- scripts/common.sh@344 -- # : 1 00:04:25.030 02:15:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:25.030 02:15:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:25.030 02:15:49 -- scripts/common.sh@364 -- # decimal 1 00:04:25.030 02:15:49 -- scripts/common.sh@352 -- # local d=1 00:04:25.030 02:15:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:25.030 02:15:49 -- scripts/common.sh@354 -- # echo 1 00:04:25.030 02:15:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:25.030 02:15:49 -- scripts/common.sh@365 -- # decimal 2 00:04:25.030 02:15:49 -- scripts/common.sh@352 -- # local d=2 00:04:25.030 02:15:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:25.030 02:15:49 -- scripts/common.sh@354 -- # echo 2 00:04:25.030 02:15:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:25.030 02:15:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:25.030 02:15:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:25.030 02:15:49 -- scripts/common.sh@367 -- # return 0 00:04:25.030 02:15:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:25.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.030 --rc genhtml_branch_coverage=1 00:04:25.030 --rc genhtml_function_coverage=1 00:04:25.030 --rc genhtml_legend=1 00:04:25.030 --rc geninfo_all_blocks=1 00:04:25.030 --rc geninfo_unexecuted_blocks=1 00:04:25.030 00:04:25.030 ' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:25.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.030 --rc genhtml_branch_coverage=1 00:04:25.030 --rc genhtml_function_coverage=1 00:04:25.030 --rc genhtml_legend=1 00:04:25.030 --rc geninfo_all_blocks=1 00:04:25.030 --rc geninfo_unexecuted_blocks=1 00:04:25.030 00:04:25.030 ' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:25.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.030 --rc genhtml_branch_coverage=1 00:04:25.030 --rc genhtml_function_coverage=1 00:04:25.030 --rc genhtml_legend=1 00:04:25.030 --rc geninfo_all_blocks=1 00:04:25.030 --rc geninfo_unexecuted_blocks=1 00:04:25.030 00:04:25.030 ' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:25.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.030 --rc genhtml_branch_coverage=1 00:04:25.030 --rc genhtml_function_coverage=1 00:04:25.030 --rc genhtml_legend=1 00:04:25.030 --rc geninfo_all_blocks=1 00:04:25.030 --rc geninfo_unexecuted_blocks=1 00:04:25.030 00:04:25.030 ' 00:04:25.030 02:15:49 -- setup/test-setup.sh@10 -- # uname -s 00:04:25.030 02:15:49 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:25.030 02:15:49 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:25.030 02:15:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.030 02:15:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.030 02:15:49 -- common/autotest_common.sh@10 -- # set +x 00:04:25.030 ************************************ 00:04:25.030 START TEST acl 00:04:25.031 ************************************ 00:04:25.031 02:15:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:25.031 * Looking for test storage... 00:04:25.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:25.031 02:15:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:25.031 02:15:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:25.031 02:15:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:25.031 02:15:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:25.031 02:15:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:25.031 02:15:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:25.031 02:15:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:25.031 02:15:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:25.031 02:15:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:25.031 02:15:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:25.031 02:15:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:25.031 02:15:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:25.031 02:15:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:25.031 02:15:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:25.031 02:15:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:25.031 02:15:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:25.031 02:15:49 -- scripts/common.sh@344 -- # : 1 00:04:25.031 02:15:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:25.031 02:15:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:25.031 02:15:49 -- scripts/common.sh@364 -- # decimal 1 00:04:25.031 02:15:49 -- scripts/common.sh@352 -- # local d=1 00:04:25.031 02:15:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:25.031 02:15:49 -- scripts/common.sh@354 -- # echo 1 00:04:25.031 02:15:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:25.031 02:15:49 -- scripts/common.sh@365 -- # decimal 2 00:04:25.031 02:15:49 -- scripts/common.sh@352 -- # local d=2 00:04:25.031 02:15:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:25.031 02:15:49 -- scripts/common.sh@354 -- # echo 2 00:04:25.031 02:15:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:25.031 02:15:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:25.031 02:15:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:25.031 02:15:49 -- scripts/common.sh@367 -- # return 0 00:04:25.031 02:15:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:25.031 02:15:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:25.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.031 --rc genhtml_branch_coverage=1 00:04:25.031 --rc genhtml_function_coverage=1 00:04:25.031 --rc genhtml_legend=1 00:04:25.031 --rc geninfo_all_blocks=1 00:04:25.031 --rc geninfo_unexecuted_blocks=1 00:04:25.031 00:04:25.031 ' 00:04:25.031 02:15:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:25.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.031 --rc genhtml_branch_coverage=1 00:04:25.031 --rc genhtml_function_coverage=1 00:04:25.031 --rc genhtml_legend=1 00:04:25.031 --rc geninfo_all_blocks=1 00:04:25.031 --rc geninfo_unexecuted_blocks=1 00:04:25.031 00:04:25.031 ' 00:04:25.031 02:15:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:25.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.031 --rc genhtml_branch_coverage=1 00:04:25.031 --rc genhtml_function_coverage=1 00:04:25.031 --rc genhtml_legend=1 00:04:25.031 --rc geninfo_all_blocks=1 00:04:25.031 --rc geninfo_unexecuted_blocks=1 00:04:25.031 00:04:25.031 ' 00:04:25.031 02:15:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:25.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:25.031 --rc genhtml_branch_coverage=1 00:04:25.031 --rc genhtml_function_coverage=1 00:04:25.031 --rc genhtml_legend=1 00:04:25.031 --rc geninfo_all_blocks=1 00:04:25.031 --rc geninfo_unexecuted_blocks=1 00:04:25.031 00:04:25.031 ' 00:04:25.031 02:15:49 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:25.031 02:15:49 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:25.031 02:15:49 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:25.031 02:15:49 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:25.031 02:15:49 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:25.031 02:15:49 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:25.031 02:15:49 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:25.031 02:15:49 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:25.031 02:15:49 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:25.031 02:15:49 -- setup/acl.sh@12 -- # devs=() 00:04:25.031 02:15:49 -- setup/acl.sh@12 -- # declare -a devs 00:04:25.031 02:15:49 -- setup/acl.sh@13 -- # drivers=() 00:04:25.031 02:15:49 -- setup/acl.sh@13 -- # declare -A drivers 00:04:25.031 02:15:49 -- setup/acl.sh@51 -- # setup reset 00:04:25.031 02:15:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:25.031 02:15:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.406 02:15:51 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:26.406 02:15:51 -- setup/acl.sh@16 -- # local dev driver 00:04:26.406 02:15:51 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:26.406 02:15:51 -- setup/acl.sh@15 -- # setup output status 00:04:26.406 02:15:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:26.406 02:15:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:27.840 Hugepages 00:04:27.840 node hugesize free / total 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 00:04:27.840 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # continue 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:27.840 02:15:52 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:27.840 02:15:52 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:27.840 02:15:52 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:27.840 02:15:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:27.840 02:15:52 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:27.840 02:15:52 -- setup/acl.sh@54 -- # run_test denied denied 00:04:27.840 02:15:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.840 02:15:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.840 02:15:52 -- common/autotest_common.sh@10 -- # set +x 00:04:27.840 ************************************ 00:04:27.840 START TEST denied 00:04:27.840 ************************************ 00:04:27.840 02:15:52 -- common/autotest_common.sh@1114 -- # denied 00:04:27.840 02:15:52 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:27.840 02:15:52 -- setup/acl.sh@38 -- # setup output config 00:04:27.840 02:15:52 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:27.840 02:15:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:27.840 02:15:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:29.226 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:29.226 02:15:53 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:29.226 02:15:53 -- setup/acl.sh@28 -- # local dev driver 00:04:29.226 02:15:53 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:29.226 02:15:53 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:29.226 02:15:53 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:29.226 02:15:53 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:29.226 02:15:53 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:29.226 02:15:53 -- setup/acl.sh@41 -- # setup reset 00:04:29.226 02:15:53 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:29.226 02:15:53 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:31.760 00:04:31.760 real 0m3.785s 00:04:31.760 user 0m1.093s 00:04:31.760 sys 0m1.829s 00:04:31.760 02:15:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.760 02:15:56 -- common/autotest_common.sh@10 -- # set +x 00:04:31.760 ************************************ 00:04:31.760 END TEST denied 00:04:31.760 ************************************ 00:04:31.760 02:15:56 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:31.760 02:15:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.760 02:15:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.760 02:15:56 -- common/autotest_common.sh@10 -- # set +x 00:04:31.760 ************************************ 00:04:31.760 START TEST allowed 00:04:31.760 ************************************ 00:04:31.760 02:15:56 -- common/autotest_common.sh@1114 -- # allowed 00:04:31.760 02:15:56 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:31.760 02:15:56 -- setup/acl.sh@45 -- # setup output config 00:04:31.760 02:15:56 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:31.761 02:15:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.761 02:15:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:34.294 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:34.294 02:15:58 -- setup/acl.sh@47 -- # verify 00:04:34.294 02:15:58 -- setup/acl.sh@28 -- # local dev driver 00:04:34.294 02:15:58 -- setup/acl.sh@48 -- # setup reset 00:04:34.294 02:15:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:34.294 02:15:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:35.702 00:04:35.702 real 0m3.940s 00:04:35.702 user 0m1.047s 00:04:35.702 sys 0m1.768s 00:04:35.702 02:15:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.702 02:15:59 -- common/autotest_common.sh@10 -- # set +x 00:04:35.702 ************************************ 00:04:35.702 END TEST allowed 00:04:35.702 ************************************ 00:04:35.702 00:04:35.702 real 0m10.522s 00:04:35.702 user 0m3.251s 00:04:35.702 sys 0m5.373s 00:04:35.702 02:15:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.702 02:15:59 -- common/autotest_common.sh@10 -- # set +x 00:04:35.702 ************************************ 00:04:35.702 END TEST acl 00:04:35.702 ************************************ 00:04:35.702 02:16:00 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:35.702 02:16:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.702 02:16:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.703 02:16:00 -- common/autotest_common.sh@10 -- # set +x 00:04:35.703 ************************************ 00:04:35.703 START TEST hugepages 00:04:35.703 ************************************ 00:04:35.703 02:16:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:35.703 * Looking for test storage... 00:04:35.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:35.703 02:16:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.703 02:16:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.703 02:16:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.703 02:16:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.703 02:16:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.703 02:16:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.703 02:16:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.703 02:16:00 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.703 02:16:00 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.703 02:16:00 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.703 02:16:00 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.703 02:16:00 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.703 02:16:00 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.703 02:16:00 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.703 02:16:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.703 02:16:00 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.703 02:16:00 -- scripts/common.sh@344 -- # : 1 00:04:35.703 02:16:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.703 02:16:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.703 02:16:00 -- scripts/common.sh@364 -- # decimal 1 00:04:35.703 02:16:00 -- scripts/common.sh@352 -- # local d=1 00:04:35.703 02:16:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.703 02:16:00 -- scripts/common.sh@354 -- # echo 1 00:04:35.703 02:16:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.703 02:16:00 -- scripts/common.sh@365 -- # decimal 2 00:04:35.703 02:16:00 -- scripts/common.sh@352 -- # local d=2 00:04:35.703 02:16:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.703 02:16:00 -- scripts/common.sh@354 -- # echo 2 00:04:35.703 02:16:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.703 02:16:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.703 02:16:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.703 02:16:00 -- scripts/common.sh@367 -- # return 0 00:04:35.703 02:16:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.703 02:16:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.703 --rc genhtml_branch_coverage=1 00:04:35.703 --rc genhtml_function_coverage=1 00:04:35.703 --rc genhtml_legend=1 00:04:35.703 --rc geninfo_all_blocks=1 00:04:35.703 --rc geninfo_unexecuted_blocks=1 00:04:35.703 00:04:35.703 ' 00:04:35.703 02:16:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.703 --rc genhtml_branch_coverage=1 00:04:35.703 --rc genhtml_function_coverage=1 00:04:35.703 --rc genhtml_legend=1 00:04:35.703 --rc geninfo_all_blocks=1 00:04:35.703 --rc geninfo_unexecuted_blocks=1 00:04:35.703 00:04:35.703 ' 00:04:35.703 02:16:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.703 --rc genhtml_branch_coverage=1 00:04:35.703 --rc genhtml_function_coverage=1 00:04:35.703 --rc genhtml_legend=1 00:04:35.703 --rc geninfo_all_blocks=1 00:04:35.703 --rc geninfo_unexecuted_blocks=1 00:04:35.703 00:04:35.703 ' 00:04:35.703 02:16:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.703 --rc genhtml_branch_coverage=1 00:04:35.703 --rc genhtml_function_coverage=1 00:04:35.703 --rc genhtml_legend=1 00:04:35.703 --rc geninfo_all_blocks=1 00:04:35.703 --rc geninfo_unexecuted_blocks=1 00:04:35.703 00:04:35.703 ' 00:04:35.703 02:16:00 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:35.703 02:16:00 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:35.703 02:16:00 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:35.703 02:16:00 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:35.703 02:16:00 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:35.703 02:16:00 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:35.703 02:16:00 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:35.703 02:16:00 -- setup/common.sh@18 -- # local node= 00:04:35.703 02:16:00 -- setup/common.sh@19 -- # local var val 00:04:35.703 02:16:00 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.703 02:16:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.703 02:16:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:35.703 02:16:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:35.703 02:16:00 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.703 02:16:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41620932 kB' 'MemAvailable: 45378008 kB' 'Buffers: 2708 kB' 'Cached: 12239800 kB' 'SwapCached: 0 kB' 'Active: 8931240 kB' 'Inactive: 3757844 kB' 'Active(anon): 8536408 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450240 kB' 'Mapped: 204108 kB' 'Shmem: 8089832 kB' 'KReclaimable: 195956 kB' 'Slab: 688152 kB' 'SReclaimable: 195956 kB' 'SUnreclaim: 492196 kB' 'KernelStack: 12816 kB' 'PageTables: 8060 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 9615808 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.703 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.703 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.704 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.704 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # continue 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.705 02:16:00 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.705 02:16:00 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:35.705 02:16:00 -- setup/common.sh@33 -- # echo 2048 00:04:35.705 02:16:00 -- setup/common.sh@33 -- # return 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:35.705 02:16:00 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:35.705 02:16:00 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:35.705 02:16:00 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:35.705 02:16:00 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:35.705 02:16:00 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:35.705 02:16:00 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:35.705 02:16:00 -- setup/hugepages.sh@207 -- # get_nodes 00:04:35.705 02:16:00 -- setup/hugepages.sh@27 -- # local node 00:04:35.705 02:16:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:35.705 02:16:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:35.705 02:16:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:35.705 02:16:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:35.705 02:16:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:35.705 02:16:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:35.705 02:16:00 -- setup/hugepages.sh@208 -- # clear_hp 00:04:35.705 02:16:00 -- setup/hugepages.sh@37 -- # local node hp 00:04:35.705 02:16:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:35.705 02:16:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:35.705 02:16:00 -- setup/hugepages.sh@41 -- # echo 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:35.705 02:16:00 -- setup/hugepages.sh@41 -- # echo 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:35.705 02:16:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:35.705 02:16:00 -- setup/hugepages.sh@41 -- # echo 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:35.705 02:16:00 -- setup/hugepages.sh@41 -- # echo 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:35.705 02:16:00 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:35.705 02:16:00 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:35.705 02:16:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.705 02:16:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.705 02:16:00 -- common/autotest_common.sh@10 -- # set +x 00:04:35.705 ************************************ 00:04:35.705 START TEST default_setup 00:04:35.705 ************************************ 00:04:35.705 02:16:00 -- common/autotest_common.sh@1114 -- # default_setup 00:04:35.705 02:16:00 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:35.705 02:16:00 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:35.705 02:16:00 -- setup/hugepages.sh@51 -- # shift 00:04:35.705 02:16:00 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:35.705 02:16:00 -- setup/hugepages.sh@52 -- # local node_ids 00:04:35.705 02:16:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:35.705 02:16:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:35.705 02:16:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:35.705 02:16:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:35.705 02:16:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:35.705 02:16:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:35.705 02:16:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:35.705 02:16:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:35.705 02:16:00 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:35.705 02:16:00 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:35.705 02:16:00 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:35.705 02:16:00 -- setup/hugepages.sh@73 -- # return 0 00:04:35.705 02:16:00 -- setup/hugepages.sh@137 -- # setup output 00:04:35.705 02:16:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:35.705 02:16:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:37.082 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:37.082 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:37.082 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:38.022 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:38.022 02:16:02 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:38.022 02:16:02 -- setup/hugepages.sh@89 -- # local node 00:04:38.022 02:16:02 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:38.022 02:16:02 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:38.022 02:16:02 -- setup/hugepages.sh@92 -- # local surp 00:04:38.022 02:16:02 -- setup/hugepages.sh@93 -- # local resv 00:04:38.022 02:16:02 -- setup/hugepages.sh@94 -- # local anon 00:04:38.022 02:16:02 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:38.022 02:16:02 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:38.022 02:16:02 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:38.022 02:16:02 -- setup/common.sh@18 -- # local node= 00:04:38.022 02:16:02 -- setup/common.sh@19 -- # local var val 00:04:38.022 02:16:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.022 02:16:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.022 02:16:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.022 02:16:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.022 02:16:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.022 02:16:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43752888 kB' 'MemAvailable: 47509972 kB' 'Buffers: 2708 kB' 'Cached: 12239888 kB' 'SwapCached: 0 kB' 'Active: 8933340 kB' 'Inactive: 3757844 kB' 'Active(anon): 8538508 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451888 kB' 'Mapped: 203604 kB' 'Shmem: 8089920 kB' 'KReclaimable: 195972 kB' 'Slab: 688028 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492056 kB' 'KernelStack: 12816 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9622936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.022 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.022 02:16:02 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:38.023 02:16:02 -- setup/common.sh@33 -- # echo 0 00:04:38.023 02:16:02 -- setup/common.sh@33 -- # return 0 00:04:38.023 02:16:02 -- setup/hugepages.sh@97 -- # anon=0 00:04:38.023 02:16:02 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:38.023 02:16:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:38.023 02:16:02 -- setup/common.sh@18 -- # local node= 00:04:38.023 02:16:02 -- setup/common.sh@19 -- # local var val 00:04:38.023 02:16:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.023 02:16:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.023 02:16:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.023 02:16:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.023 02:16:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.023 02:16:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43756684 kB' 'MemAvailable: 47513768 kB' 'Buffers: 2708 kB' 'Cached: 12239892 kB' 'SwapCached: 0 kB' 'Active: 8934696 kB' 'Inactive: 3757844 kB' 'Active(anon): 8539864 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453292 kB' 'Mapped: 203916 kB' 'Shmem: 8089924 kB' 'KReclaimable: 195972 kB' 'Slab: 688048 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492076 kB' 'KernelStack: 12784 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9625072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198252 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.023 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.023 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.024 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.024 02:16:02 -- setup/common.sh@33 -- # echo 0 00:04:38.024 02:16:02 -- setup/common.sh@33 -- # return 0 00:04:38.024 02:16:02 -- setup/hugepages.sh@99 -- # surp=0 00:04:38.024 02:16:02 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:38.024 02:16:02 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:38.024 02:16:02 -- setup/common.sh@18 -- # local node= 00:04:38.024 02:16:02 -- setup/common.sh@19 -- # local var val 00:04:38.024 02:16:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.024 02:16:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.024 02:16:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.024 02:16:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.024 02:16:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.024 02:16:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.024 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43757404 kB' 'MemAvailable: 47514488 kB' 'Buffers: 2708 kB' 'Cached: 12239904 kB' 'SwapCached: 0 kB' 'Active: 8928680 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533848 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447216 kB' 'Mapped: 203420 kB' 'Shmem: 8089936 kB' 'KReclaimable: 195972 kB' 'Slab: 688072 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492100 kB' 'KernelStack: 12768 kB' 'PageTables: 7928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9620060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.025 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.025 02:16:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:38.026 02:16:02 -- setup/common.sh@33 -- # echo 0 00:04:38.026 02:16:02 -- setup/common.sh@33 -- # return 0 00:04:38.026 02:16:02 -- setup/hugepages.sh@100 -- # resv=0 00:04:38.026 02:16:02 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:38.026 nr_hugepages=1024 00:04:38.026 02:16:02 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:38.026 resv_hugepages=0 00:04:38.026 02:16:02 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:38.026 surplus_hugepages=0 00:04:38.026 02:16:02 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:38.026 anon_hugepages=0 00:04:38.026 02:16:02 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:38.026 02:16:02 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:38.026 02:16:02 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:38.026 02:16:02 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:38.026 02:16:02 -- setup/common.sh@18 -- # local node= 00:04:38.026 02:16:02 -- setup/common.sh@19 -- # local var val 00:04:38.026 02:16:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.026 02:16:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.026 02:16:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.026 02:16:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.026 02:16:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.026 02:16:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43753908 kB' 'MemAvailable: 47510992 kB' 'Buffers: 2708 kB' 'Cached: 12239920 kB' 'SwapCached: 0 kB' 'Active: 8931724 kB' 'Inactive: 3757844 kB' 'Active(anon): 8536892 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450216 kB' 'Mapped: 203856 kB' 'Shmem: 8089952 kB' 'KReclaimable: 195972 kB' 'Slab: 688072 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492100 kB' 'KernelStack: 12816 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9623244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.026 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.026 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.027 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.027 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:38.027 02:16:02 -- setup/common.sh@33 -- # echo 1024 00:04:38.027 02:16:02 -- setup/common.sh@33 -- # return 0 00:04:38.027 02:16:02 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:38.027 02:16:02 -- setup/hugepages.sh@112 -- # get_nodes 00:04:38.027 02:16:02 -- setup/hugepages.sh@27 -- # local node 00:04:38.027 02:16:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.027 02:16:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:38.028 02:16:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.028 02:16:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:38.028 02:16:02 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:38.028 02:16:02 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:38.028 02:16:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:38.028 02:16:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:38.028 02:16:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:38.028 02:16:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:38.028 02:16:02 -- setup/common.sh@18 -- # local node=0 00:04:38.028 02:16:02 -- setup/common.sh@19 -- # local var val 00:04:38.028 02:16:02 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.028 02:16:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.028 02:16:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:38.028 02:16:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:38.028 02:16:02 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.028 02:16:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26050988 kB' 'MemUsed: 6774868 kB' 'SwapCached: 0 kB' 'Active: 3446520 kB' 'Inactive: 176984 kB' 'Active(anon): 3293652 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322168 kB' 'Mapped: 73508 kB' 'AnonPages: 304456 kB' 'Shmem: 2992316 kB' 'KernelStack: 7928 kB' 'PageTables: 4356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115548 kB' 'Slab: 391568 kB' 'SReclaimable: 115548 kB' 'SUnreclaim: 276020 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.028 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.028 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # continue 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.029 02:16:02 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.029 02:16:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:38.029 02:16:02 -- setup/common.sh@33 -- # echo 0 00:04:38.029 02:16:02 -- setup/common.sh@33 -- # return 0 00:04:38.029 02:16:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:38.029 02:16:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:38.029 02:16:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:38.029 02:16:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:38.029 02:16:02 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:38.029 node0=1024 expecting 1024 00:04:38.029 02:16:02 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:38.029 00:04:38.029 real 0m2.365s 00:04:38.029 user 0m0.629s 00:04:38.029 sys 0m0.874s 00:04:38.029 02:16:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.029 02:16:02 -- common/autotest_common.sh@10 -- # set +x 00:04:38.029 ************************************ 00:04:38.029 END TEST default_setup 00:04:38.029 ************************************ 00:04:38.029 02:16:02 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:38.029 02:16:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.029 02:16:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.029 02:16:02 -- common/autotest_common.sh@10 -- # set +x 00:04:38.029 ************************************ 00:04:38.029 START TEST per_node_1G_alloc 00:04:38.029 ************************************ 00:04:38.029 02:16:02 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:38.029 02:16:02 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:38.029 02:16:02 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:38.029 02:16:02 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:38.029 02:16:02 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:38.029 02:16:02 -- setup/hugepages.sh@51 -- # shift 00:04:38.029 02:16:02 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:38.029 02:16:02 -- setup/hugepages.sh@52 -- # local node_ids 00:04:38.029 02:16:02 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.029 02:16:02 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:38.029 02:16:02 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:38.029 02:16:02 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:38.029 02:16:02 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.029 02:16:02 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:38.029 02:16:02 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.029 02:16:02 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.029 02:16:02 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.029 02:16:02 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:38.029 02:16:02 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:38.029 02:16:02 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:38.029 02:16:02 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:38.029 02:16:02 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:38.029 02:16:02 -- setup/hugepages.sh@73 -- # return 0 00:04:38.029 02:16:02 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:38.029 02:16:02 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:38.029 02:16:02 -- setup/hugepages.sh@146 -- # setup output 00:04:38.029 02:16:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.029 02:16:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:39.409 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:39.409 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:39.409 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:39.409 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:39.409 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:39.409 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:39.409 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:39.409 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:39.409 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:39.409 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:39.409 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:39.409 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:39.409 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:39.409 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:39.409 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:39.409 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:39.409 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:39.409 02:16:03 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:39.409 02:16:03 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:39.409 02:16:03 -- setup/hugepages.sh@89 -- # local node 00:04:39.409 02:16:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:39.409 02:16:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:39.409 02:16:03 -- setup/hugepages.sh@92 -- # local surp 00:04:39.409 02:16:03 -- setup/hugepages.sh@93 -- # local resv 00:04:39.409 02:16:03 -- setup/hugepages.sh@94 -- # local anon 00:04:39.409 02:16:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:39.409 02:16:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:39.409 02:16:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:39.410 02:16:03 -- setup/common.sh@18 -- # local node= 00:04:39.410 02:16:03 -- setup/common.sh@19 -- # local var val 00:04:39.410 02:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.410 02:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.410 02:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.410 02:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.410 02:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.410 02:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43740916 kB' 'MemAvailable: 47498000 kB' 'Buffers: 2708 kB' 'Cached: 12239980 kB' 'SwapCached: 0 kB' 'Active: 8928788 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533956 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447176 kB' 'Mapped: 203040 kB' 'Shmem: 8090012 kB' 'KReclaimable: 195972 kB' 'Slab: 688088 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492116 kB' 'KernelStack: 12832 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.410 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.410 02:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:39.411 02:16:03 -- setup/common.sh@33 -- # echo 0 00:04:39.411 02:16:03 -- setup/common.sh@33 -- # return 0 00:04:39.411 02:16:03 -- setup/hugepages.sh@97 -- # anon=0 00:04:39.411 02:16:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:39.411 02:16:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.411 02:16:03 -- setup/common.sh@18 -- # local node= 00:04:39.411 02:16:03 -- setup/common.sh@19 -- # local var val 00:04:39.411 02:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.411 02:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.411 02:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.411 02:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.411 02:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.411 02:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43742896 kB' 'MemAvailable: 47499980 kB' 'Buffers: 2708 kB' 'Cached: 12239980 kB' 'SwapCached: 0 kB' 'Active: 8928848 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534016 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447224 kB' 'Mapped: 203040 kB' 'Shmem: 8090012 kB' 'KReclaimable: 195972 kB' 'Slab: 688048 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492076 kB' 'KernelStack: 12800 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.411 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.411 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.412 02:16:03 -- setup/common.sh@33 -- # echo 0 00:04:39.412 02:16:03 -- setup/common.sh@33 -- # return 0 00:04:39.412 02:16:03 -- setup/hugepages.sh@99 -- # surp=0 00:04:39.412 02:16:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:39.412 02:16:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:39.412 02:16:03 -- setup/common.sh@18 -- # local node= 00:04:39.412 02:16:03 -- setup/common.sh@19 -- # local var val 00:04:39.412 02:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.412 02:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.412 02:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.412 02:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.412 02:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.412 02:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.412 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.412 02:16:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43742848 kB' 'MemAvailable: 47499932 kB' 'Buffers: 2708 kB' 'Cached: 12239992 kB' 'SwapCached: 0 kB' 'Active: 8928880 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534048 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447252 kB' 'Mapped: 203012 kB' 'Shmem: 8090024 kB' 'KReclaimable: 195972 kB' 'Slab: 688052 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492080 kB' 'KernelStack: 12896 kB' 'PageTables: 8072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9621072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.412 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.413 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.413 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:39.414 02:16:03 -- setup/common.sh@33 -- # echo 0 00:04:39.414 02:16:03 -- setup/common.sh@33 -- # return 0 00:04:39.414 02:16:03 -- setup/hugepages.sh@100 -- # resv=0 00:04:39.414 02:16:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:39.414 nr_hugepages=1024 00:04:39.414 02:16:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:39.414 resv_hugepages=0 00:04:39.414 02:16:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:39.414 surplus_hugepages=0 00:04:39.414 02:16:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:39.414 anon_hugepages=0 00:04:39.414 02:16:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:39.414 02:16:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:39.414 02:16:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:39.414 02:16:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:39.414 02:16:03 -- setup/common.sh@18 -- # local node= 00:04:39.414 02:16:03 -- setup/common.sh@19 -- # local var val 00:04:39.414 02:16:03 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.414 02:16:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.414 02:16:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.414 02:16:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.414 02:16:03 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.414 02:16:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.414 02:16:03 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43743448 kB' 'MemAvailable: 47500532 kB' 'Buffers: 2708 kB' 'Cached: 12240008 kB' 'SwapCached: 0 kB' 'Active: 8928732 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533900 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447124 kB' 'Mapped: 203012 kB' 'Shmem: 8090040 kB' 'KReclaimable: 195972 kB' 'Slab: 688112 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492140 kB' 'KernelStack: 12832 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619204 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.414 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.414 02:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.415 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.415 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:39.416 02:16:04 -- setup/common.sh@33 -- # echo 1024 00:04:39.416 02:16:04 -- setup/common.sh@33 -- # return 0 00:04:39.416 02:16:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:39.416 02:16:04 -- setup/hugepages.sh@112 -- # get_nodes 00:04:39.416 02:16:04 -- setup/hugepages.sh@27 -- # local node 00:04:39.416 02:16:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.416 02:16:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:39.416 02:16:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.416 02:16:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:39.416 02:16:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:39.416 02:16:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:39.416 02:16:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:39.416 02:16:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:39.416 02:16:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:39.416 02:16:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.416 02:16:04 -- setup/common.sh@18 -- # local node=0 00:04:39.416 02:16:04 -- setup/common.sh@19 -- # local var val 00:04:39.416 02:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.416 02:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.416 02:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:39.416 02:16:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:39.416 02:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.416 02:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27108916 kB' 'MemUsed: 5716940 kB' 'SwapCached: 0 kB' 'Active: 3447020 kB' 'Inactive: 176984 kB' 'Active(anon): 3294152 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322180 kB' 'Mapped: 73364 kB' 'AnonPages: 304972 kB' 'Shmem: 2992328 kB' 'KernelStack: 7960 kB' 'PageTables: 4400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115548 kB' 'Slab: 391460 kB' 'SReclaimable: 115548 kB' 'SUnreclaim: 275912 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.416 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.416 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.417 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.417 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.677 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.677 02:16:04 -- setup/common.sh@33 -- # echo 0 00:04:39.677 02:16:04 -- setup/common.sh@33 -- # return 0 00:04:39.677 02:16:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:39.677 02:16:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:39.677 02:16:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:39.677 02:16:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:39.677 02:16:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:39.677 02:16:04 -- setup/common.sh@18 -- # local node=1 00:04:39.677 02:16:04 -- setup/common.sh@19 -- # local var val 00:04:39.677 02:16:04 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.677 02:16:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.677 02:16:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:39.677 02:16:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:39.677 02:16:04 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.677 02:16:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.677 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16635028 kB' 'MemUsed: 11074764 kB' 'SwapCached: 0 kB' 'Active: 5481364 kB' 'Inactive: 3580860 kB' 'Active(anon): 5239400 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3580860 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8920552 kB' 'Mapped: 129648 kB' 'AnonPages: 141776 kB' 'Shmem: 5097728 kB' 'KernelStack: 4888 kB' 'PageTables: 3548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 80424 kB' 'Slab: 296652 kB' 'SReclaimable: 80424 kB' 'SUnreclaim: 216228 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # continue 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.678 02:16:04 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.678 02:16:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:39.678 02:16:04 -- setup/common.sh@33 -- # echo 0 00:04:39.678 02:16:04 -- setup/common.sh@33 -- # return 0 00:04:39.678 02:16:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:39.678 02:16:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:39.678 02:16:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:39.679 02:16:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:39.679 02:16:04 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:39.679 node0=512 expecting 512 00:04:39.679 02:16:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:39.679 02:16:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:39.679 02:16:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:39.679 02:16:04 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:39.679 node1=512 expecting 512 00:04:39.679 02:16:04 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:39.679 00:04:39.679 real 0m1.476s 00:04:39.679 user 0m0.582s 00:04:39.679 sys 0m0.862s 00:04:39.679 02:16:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.679 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:39.679 ************************************ 00:04:39.679 END TEST per_node_1G_alloc 00:04:39.679 ************************************ 00:04:39.679 02:16:04 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:39.679 02:16:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.679 02:16:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.679 02:16:04 -- common/autotest_common.sh@10 -- # set +x 00:04:39.679 ************************************ 00:04:39.679 START TEST even_2G_alloc 00:04:39.679 ************************************ 00:04:39.679 02:16:04 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:39.679 02:16:04 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:39.679 02:16:04 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:39.679 02:16:04 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:39.679 02:16:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:39.679 02:16:04 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:39.679 02:16:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:39.679 02:16:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:39.679 02:16:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:39.679 02:16:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:39.679 02:16:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:39.679 02:16:04 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:39.679 02:16:04 -- setup/hugepages.sh@83 -- # : 512 00:04:39.679 02:16:04 -- setup/hugepages.sh@84 -- # : 1 00:04:39.679 02:16:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:39.679 02:16:04 -- setup/hugepages.sh@83 -- # : 0 00:04:39.679 02:16:04 -- setup/hugepages.sh@84 -- # : 0 00:04:39.679 02:16:04 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:39.679 02:16:04 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:39.679 02:16:04 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:39.679 02:16:04 -- setup/hugepages.sh@153 -- # setup output 00:04:39.679 02:16:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.679 02:16:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:40.616 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:40.616 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:40.616 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:40.616 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:40.616 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:40.616 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:40.616 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:40.616 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:40.878 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:40.878 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:40.878 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:40.878 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:40.878 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:40.878 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:40.878 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:40.878 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:40.878 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:40.878 02:16:05 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:40.878 02:16:05 -- setup/hugepages.sh@89 -- # local node 00:04:40.878 02:16:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:40.878 02:16:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:40.878 02:16:05 -- setup/hugepages.sh@92 -- # local surp 00:04:40.878 02:16:05 -- setup/hugepages.sh@93 -- # local resv 00:04:40.878 02:16:05 -- setup/hugepages.sh@94 -- # local anon 00:04:40.878 02:16:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:40.878 02:16:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:40.878 02:16:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:40.878 02:16:05 -- setup/common.sh@18 -- # local node= 00:04:40.878 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:40.878 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.878 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.878 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.878 02:16:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.878 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.878 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43764772 kB' 'MemAvailable: 47521856 kB' 'Buffers: 2708 kB' 'Cached: 12240068 kB' 'SwapCached: 0 kB' 'Active: 8928988 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534156 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447272 kB' 'Mapped: 203032 kB' 'Shmem: 8090100 kB' 'KReclaimable: 195972 kB' 'Slab: 687940 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 491968 kB' 'KernelStack: 12832 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.878 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.878 02:16:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.879 02:16:05 -- setup/common.sh@33 -- # echo 0 00:04:40.879 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:40.879 02:16:05 -- setup/hugepages.sh@97 -- # anon=0 00:04:40.879 02:16:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:40.879 02:16:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.879 02:16:05 -- setup/common.sh@18 -- # local node= 00:04:40.879 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:40.879 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.879 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.879 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.879 02:16:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.879 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.879 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43770940 kB' 'MemAvailable: 47528024 kB' 'Buffers: 2708 kB' 'Cached: 12240072 kB' 'SwapCached: 0 kB' 'Active: 8929664 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534832 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447944 kB' 'Mapped: 203112 kB' 'Shmem: 8090104 kB' 'KReclaimable: 195972 kB' 'Slab: 687988 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 492016 kB' 'KernelStack: 12848 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.879 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.879 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.880 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.880 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.881 02:16:05 -- setup/common.sh@33 -- # echo 0 00:04:40.881 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:40.881 02:16:05 -- setup/hugepages.sh@99 -- # surp=0 00:04:40.881 02:16:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:40.881 02:16:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:40.881 02:16:05 -- setup/common.sh@18 -- # local node= 00:04:40.881 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:40.881 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.881 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.881 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.881 02:16:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.881 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.881 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43772164 kB' 'MemAvailable: 47529248 kB' 'Buffers: 2708 kB' 'Cached: 12240084 kB' 'SwapCached: 0 kB' 'Active: 8928884 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534052 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447160 kB' 'Mapped: 203016 kB' 'Shmem: 8090116 kB' 'KReclaimable: 195972 kB' 'Slab: 687964 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 491992 kB' 'KernelStack: 12896 kB' 'PageTables: 8000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.881 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.881 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # continue 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.882 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.882 02:16:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.143 02:16:05 -- setup/common.sh@33 -- # echo 0 00:04:41.143 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:41.143 02:16:05 -- setup/hugepages.sh@100 -- # resv=0 00:04:41.143 02:16:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:41.143 nr_hugepages=1024 00:04:41.143 02:16:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:41.143 resv_hugepages=0 00:04:41.143 02:16:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:41.143 surplus_hugepages=0 00:04:41.143 02:16:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:41.143 anon_hugepages=0 00:04:41.143 02:16:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:41.143 02:16:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:41.143 02:16:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:41.143 02:16:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:41.143 02:16:05 -- setup/common.sh@18 -- # local node= 00:04:41.143 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:41.143 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.143 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.143 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.143 02:16:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.143 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.143 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43771672 kB' 'MemAvailable: 47528756 kB' 'Buffers: 2708 kB' 'Cached: 12240084 kB' 'SwapCached: 0 kB' 'Active: 8928564 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533732 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446840 kB' 'Mapped: 203016 kB' 'Shmem: 8090116 kB' 'KReclaimable: 195972 kB' 'Slab: 687964 kB' 'SReclaimable: 195972 kB' 'SUnreclaim: 491992 kB' 'KernelStack: 12880 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9619424 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.143 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.143 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.144 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.144 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.144 02:16:05 -- setup/common.sh@33 -- # echo 1024 00:04:41.144 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:41.144 02:16:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:41.144 02:16:05 -- setup/hugepages.sh@112 -- # get_nodes 00:04:41.144 02:16:05 -- setup/hugepages.sh@27 -- # local node 00:04:41.144 02:16:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:41.144 02:16:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:41.144 02:16:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:41.144 02:16:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:41.144 02:16:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:41.144 02:16:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:41.144 02:16:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:41.144 02:16:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:41.144 02:16:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:41.144 02:16:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:41.144 02:16:05 -- setup/common.sh@18 -- # local node=0 00:04:41.144 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:41.144 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.144 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.144 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:41.145 02:16:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:41.145 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.145 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27122228 kB' 'MemUsed: 5703628 kB' 'SwapCached: 0 kB' 'Active: 3446716 kB' 'Inactive: 176984 kB' 'Active(anon): 3293848 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322180 kB' 'Mapped: 73368 kB' 'AnonPages: 304636 kB' 'Shmem: 2992328 kB' 'KernelStack: 7944 kB' 'PageTables: 4352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115548 kB' 'Slab: 391444 kB' 'SReclaimable: 115548 kB' 'SUnreclaim: 275896 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.145 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.145 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.145 02:16:05 -- setup/common.sh@33 -- # echo 0 00:04:41.146 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:41.146 02:16:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:41.146 02:16:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:41.146 02:16:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:41.146 02:16:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:41.146 02:16:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:41.146 02:16:05 -- setup/common.sh@18 -- # local node=1 00:04:41.146 02:16:05 -- setup/common.sh@19 -- # local var val 00:04:41.146 02:16:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.146 02:16:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.146 02:16:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:41.146 02:16:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:41.146 02:16:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.146 02:16:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16649696 kB' 'MemUsed: 11060096 kB' 'SwapCached: 0 kB' 'Active: 5482156 kB' 'Inactive: 3580860 kB' 'Active(anon): 5240192 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3580860 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8920652 kB' 'Mapped: 129648 kB' 'AnonPages: 142520 kB' 'Shmem: 5097828 kB' 'KernelStack: 4952 kB' 'PageTables: 3648 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 80424 kB' 'Slab: 296520 kB' 'SReclaimable: 80424 kB' 'SUnreclaim: 216096 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.146 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.146 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # continue 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.147 02:16:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.147 02:16:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.147 02:16:05 -- setup/common.sh@33 -- # echo 0 00:04:41.147 02:16:05 -- setup/common.sh@33 -- # return 0 00:04:41.147 02:16:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:41.147 02:16:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:41.147 02:16:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:41.147 02:16:05 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:41.147 node0=512 expecting 512 00:04:41.147 02:16:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:41.147 02:16:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:41.147 02:16:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:41.147 02:16:05 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:41.147 node1=512 expecting 512 00:04:41.147 02:16:05 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:41.147 00:04:41.147 real 0m1.493s 00:04:41.147 user 0m0.595s 00:04:41.147 sys 0m0.841s 00:04:41.147 02:16:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.147 02:16:05 -- common/autotest_common.sh@10 -- # set +x 00:04:41.147 ************************************ 00:04:41.147 END TEST even_2G_alloc 00:04:41.147 ************************************ 00:04:41.147 02:16:05 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:41.147 02:16:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.147 02:16:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.147 02:16:05 -- common/autotest_common.sh@10 -- # set +x 00:04:41.147 ************************************ 00:04:41.147 START TEST odd_alloc 00:04:41.147 ************************************ 00:04:41.147 02:16:05 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:41.147 02:16:05 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:41.147 02:16:05 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:41.147 02:16:05 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:41.147 02:16:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:41.147 02:16:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:41.147 02:16:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:41.147 02:16:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:41.147 02:16:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:41.147 02:16:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:41.147 02:16:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:41.147 02:16:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:41.147 02:16:05 -- setup/hugepages.sh@83 -- # : 513 00:04:41.147 02:16:05 -- setup/hugepages.sh@84 -- # : 1 00:04:41.147 02:16:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:41.147 02:16:05 -- setup/hugepages.sh@83 -- # : 0 00:04:41.147 02:16:05 -- setup/hugepages.sh@84 -- # : 0 00:04:41.147 02:16:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:41.147 02:16:05 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:41.147 02:16:05 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:41.147 02:16:05 -- setup/hugepages.sh@160 -- # setup output 00:04:41.147 02:16:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.147 02:16:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:42.528 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:42.528 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:42.528 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:42.528 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:42.528 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:42.528 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:42.528 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:42.528 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:42.528 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:42.528 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:42.528 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:42.528 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:42.528 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:42.528 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:42.528 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:42.528 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:42.528 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:42.528 02:16:06 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:42.528 02:16:06 -- setup/hugepages.sh@89 -- # local node 00:04:42.528 02:16:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:42.528 02:16:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:42.528 02:16:06 -- setup/hugepages.sh@92 -- # local surp 00:04:42.528 02:16:06 -- setup/hugepages.sh@93 -- # local resv 00:04:42.528 02:16:06 -- setup/hugepages.sh@94 -- # local anon 00:04:42.528 02:16:06 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:42.528 02:16:06 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:42.528 02:16:06 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:42.528 02:16:06 -- setup/common.sh@18 -- # local node= 00:04:42.528 02:16:06 -- setup/common.sh@19 -- # local var val 00:04:42.528 02:16:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.528 02:16:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.528 02:16:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.528 02:16:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.528 02:16:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.528 02:16:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43764296 kB' 'MemAvailable: 47521376 kB' 'Buffers: 2708 kB' 'Cached: 12240156 kB' 'SwapCached: 0 kB' 'Active: 8928168 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533336 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446332 kB' 'Mapped: 201944 kB' 'Shmem: 8090188 kB' 'KReclaimable: 195964 kB' 'Slab: 688316 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492352 kB' 'KernelStack: 12896 kB' 'PageTables: 8228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 9606032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:06 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.528 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.528 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.529 02:16:07 -- setup/common.sh@33 -- # echo 0 00:04:42.529 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.529 02:16:07 -- setup/hugepages.sh@97 -- # anon=0 00:04:42.529 02:16:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:42.529 02:16:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.529 02:16:07 -- setup/common.sh@18 -- # local node= 00:04:42.529 02:16:07 -- setup/common.sh@19 -- # local var val 00:04:42.529 02:16:07 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.529 02:16:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.529 02:16:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.529 02:16:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.529 02:16:07 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.529 02:16:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43764440 kB' 'MemAvailable: 47521520 kB' 'Buffers: 2708 kB' 'Cached: 12240160 kB' 'SwapCached: 0 kB' 'Active: 8929204 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534372 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447504 kB' 'Mapped: 202380 kB' 'Shmem: 8090192 kB' 'KReclaimable: 195964 kB' 'Slab: 688316 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492352 kB' 'KernelStack: 12848 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 9608352 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.529 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.529 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.530 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.530 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.531 02:16:07 -- setup/common.sh@33 -- # echo 0 00:04:42.531 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.531 02:16:07 -- setup/hugepages.sh@99 -- # surp=0 00:04:42.531 02:16:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:42.531 02:16:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:42.531 02:16:07 -- setup/common.sh@18 -- # local node= 00:04:42.531 02:16:07 -- setup/common.sh@19 -- # local var val 00:04:42.531 02:16:07 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.531 02:16:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.531 02:16:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.531 02:16:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.531 02:16:07 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.531 02:16:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43758332 kB' 'MemAvailable: 47515412 kB' 'Buffers: 2708 kB' 'Cached: 12240160 kB' 'SwapCached: 0 kB' 'Active: 8932628 kB' 'Inactive: 3757844 kB' 'Active(anon): 8537796 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450956 kB' 'Mapped: 202432 kB' 'Shmem: 8090192 kB' 'KReclaimable: 195964 kB' 'Slab: 688308 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492344 kB' 'KernelStack: 12864 kB' 'PageTables: 8364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 9611812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.531 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.531 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.532 02:16:07 -- setup/common.sh@33 -- # echo 0 00:04:42.532 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.532 02:16:07 -- setup/hugepages.sh@100 -- # resv=0 00:04:42.532 02:16:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:42.532 nr_hugepages=1025 00:04:42.532 02:16:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:42.532 resv_hugepages=0 00:04:42.532 02:16:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:42.532 surplus_hugepages=0 00:04:42.532 02:16:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:42.532 anon_hugepages=0 00:04:42.532 02:16:07 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:42.532 02:16:07 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:42.532 02:16:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:42.532 02:16:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:42.532 02:16:07 -- setup/common.sh@18 -- # local node= 00:04:42.532 02:16:07 -- setup/common.sh@19 -- # local var val 00:04:42.532 02:16:07 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.532 02:16:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.532 02:16:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.532 02:16:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.532 02:16:07 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.532 02:16:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43759204 kB' 'MemAvailable: 47516284 kB' 'Buffers: 2708 kB' 'Cached: 12240192 kB' 'SwapCached: 0 kB' 'Active: 8932612 kB' 'Inactive: 3757844 kB' 'Active(anon): 8537780 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450388 kB' 'Mapped: 202788 kB' 'Shmem: 8090224 kB' 'KReclaimable: 195964 kB' 'Slab: 688300 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492336 kB' 'KernelStack: 12864 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 9611832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198364 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.532 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.532 02:16:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.533 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.533 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.534 02:16:07 -- setup/common.sh@33 -- # echo 1025 00:04:42.534 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.534 02:16:07 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:42.534 02:16:07 -- setup/hugepages.sh@112 -- # get_nodes 00:04:42.534 02:16:07 -- setup/hugepages.sh@27 -- # local node 00:04:42.534 02:16:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.534 02:16:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:42.534 02:16:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.534 02:16:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:42.534 02:16:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.534 02:16:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.534 02:16:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.534 02:16:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.534 02:16:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:42.534 02:16:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.534 02:16:07 -- setup/common.sh@18 -- # local node=0 00:04:42.534 02:16:07 -- setup/common.sh@19 -- # local var val 00:04:42.534 02:16:07 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.534 02:16:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.534 02:16:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:42.534 02:16:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:42.534 02:16:07 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.534 02:16:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27116544 kB' 'MemUsed: 5709312 kB' 'SwapCached: 0 kB' 'Active: 3449172 kB' 'Inactive: 176984 kB' 'Active(anon): 3296304 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322188 kB' 'Mapped: 72364 kB' 'AnonPages: 307128 kB' 'Shmem: 2992336 kB' 'KernelStack: 7992 kB' 'PageTables: 4740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115548 kB' 'Slab: 391660 kB' 'SReclaimable: 115548 kB' 'SUnreclaim: 276112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.534 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.534 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@33 -- # echo 0 00:04:42.535 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.535 02:16:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.535 02:16:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.535 02:16:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.535 02:16:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:42.535 02:16:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.535 02:16:07 -- setup/common.sh@18 -- # local node=1 00:04:42.535 02:16:07 -- setup/common.sh@19 -- # local var val 00:04:42.535 02:16:07 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.535 02:16:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.535 02:16:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:42.535 02:16:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:42.535 02:16:07 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.535 02:16:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 16640176 kB' 'MemUsed: 11069616 kB' 'SwapCached: 0 kB' 'Active: 5480684 kB' 'Inactive: 3580860 kB' 'Active(anon): 5238720 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3580860 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8920740 kB' 'Mapped: 130184 kB' 'AnonPages: 140916 kB' 'Shmem: 5097916 kB' 'KernelStack: 4872 kB' 'PageTables: 3316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 80416 kB' 'Slab: 296632 kB' 'SReclaimable: 80416 kB' 'SUnreclaim: 216216 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.535 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.535 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # continue 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.536 02:16:07 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.536 02:16:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.536 02:16:07 -- setup/common.sh@33 -- # echo 0 00:04:42.536 02:16:07 -- setup/common.sh@33 -- # return 0 00:04:42.536 02:16:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.536 02:16:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.536 02:16:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.536 02:16:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.536 02:16:07 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:42.536 node0=512 expecting 513 00:04:42.536 02:16:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.536 02:16:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.536 02:16:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.536 02:16:07 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:42.536 node1=513 expecting 512 00:04:42.536 02:16:07 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:42.536 00:04:42.536 real 0m1.525s 00:04:42.536 user 0m0.587s 00:04:42.536 sys 0m0.902s 00:04:42.536 02:16:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.536 02:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:42.536 ************************************ 00:04:42.536 END TEST odd_alloc 00:04:42.536 ************************************ 00:04:42.796 02:16:07 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:42.796 02:16:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.796 02:16:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.796 02:16:07 -- common/autotest_common.sh@10 -- # set +x 00:04:42.796 ************************************ 00:04:42.796 START TEST custom_alloc 00:04:42.796 ************************************ 00:04:42.796 02:16:07 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:42.796 02:16:07 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:42.796 02:16:07 -- setup/hugepages.sh@169 -- # local node 00:04:42.796 02:16:07 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:42.796 02:16:07 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:42.796 02:16:07 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:42.796 02:16:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:42.796 02:16:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:42.796 02:16:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.796 02:16:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:42.796 02:16:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.796 02:16:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:42.796 02:16:07 -- setup/hugepages.sh@83 -- # : 256 00:04:42.796 02:16:07 -- setup/hugepages.sh@84 -- # : 1 00:04:42.796 02:16:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:42.796 02:16:07 -- setup/hugepages.sh@83 -- # : 0 00:04:42.796 02:16:07 -- setup/hugepages.sh@84 -- # : 0 00:04:42.796 02:16:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:42.796 02:16:07 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:42.796 02:16:07 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:42.796 02:16:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:42.796 02:16:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.796 02:16:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:42.796 02:16:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.796 02:16:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:42.796 02:16:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:42.796 02:16:07 -- setup/hugepages.sh@78 -- # return 0 00:04:42.796 02:16:07 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:42.796 02:16:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:42.796 02:16:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:42.796 02:16:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:42.796 02:16:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:42.796 02:16:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.796 02:16:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:42.796 02:16:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.796 02:16:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.796 02:16:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:42.796 02:16:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:42.796 02:16:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:42.796 02:16:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:42.796 02:16:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:42.796 02:16:07 -- setup/hugepages.sh@78 -- # return 0 00:04:42.796 02:16:07 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:42.796 02:16:07 -- setup/hugepages.sh@187 -- # setup output 00:04:42.796 02:16:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.796 02:16:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.730 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.730 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:43.730 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.730 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.730 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.730 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.730 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.730 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.730 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.730 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.730 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.730 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.730 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.730 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.730 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.730 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.730 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.992 02:16:08 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:43.992 02:16:08 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:43.992 02:16:08 -- setup/hugepages.sh@89 -- # local node 00:04:43.992 02:16:08 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:43.992 02:16:08 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:43.992 02:16:08 -- setup/hugepages.sh@92 -- # local surp 00:04:43.992 02:16:08 -- setup/hugepages.sh@93 -- # local resv 00:04:43.992 02:16:08 -- setup/hugepages.sh@94 -- # local anon 00:04:43.992 02:16:08 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:43.992 02:16:08 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:43.992 02:16:08 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:43.992 02:16:08 -- setup/common.sh@18 -- # local node= 00:04:43.992 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:43.992 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.992 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.992 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.992 02:16:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.992 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.992 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42724004 kB' 'MemAvailable: 46481084 kB' 'Buffers: 2708 kB' 'Cached: 12240264 kB' 'SwapCached: 0 kB' 'Active: 8927572 kB' 'Inactive: 3757844 kB' 'Active(anon): 8532740 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445664 kB' 'Mapped: 201968 kB' 'Shmem: 8090296 kB' 'KReclaimable: 195964 kB' 'Slab: 688192 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492228 kB' 'KernelStack: 12864 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 9606272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.992 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.992 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.993 02:16:08 -- setup/common.sh@33 -- # echo 0 00:04:43.993 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:43.993 02:16:08 -- setup/hugepages.sh@97 -- # anon=0 00:04:43.993 02:16:08 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:43.993 02:16:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.993 02:16:08 -- setup/common.sh@18 -- # local node= 00:04:43.993 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:43.993 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.993 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.993 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.993 02:16:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.993 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.993 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42724212 kB' 'MemAvailable: 46481292 kB' 'Buffers: 2708 kB' 'Cached: 12240268 kB' 'SwapCached: 0 kB' 'Active: 8927884 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533052 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445968 kB' 'Mapped: 201968 kB' 'Shmem: 8090300 kB' 'KReclaimable: 195964 kB' 'Slab: 688168 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492204 kB' 'KernelStack: 12832 kB' 'PageTables: 7484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 9606284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.993 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.993 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.994 02:16:08 -- setup/common.sh@33 -- # echo 0 00:04:43.994 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:43.994 02:16:08 -- setup/hugepages.sh@99 -- # surp=0 00:04:43.994 02:16:08 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:43.994 02:16:08 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:43.994 02:16:08 -- setup/common.sh@18 -- # local node= 00:04:43.994 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:43.994 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.994 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.994 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.994 02:16:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.994 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.994 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42723876 kB' 'MemAvailable: 46480956 kB' 'Buffers: 2708 kB' 'Cached: 12240280 kB' 'SwapCached: 0 kB' 'Active: 8926848 kB' 'Inactive: 3757844 kB' 'Active(anon): 8532016 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 444940 kB' 'Mapped: 201940 kB' 'Shmem: 8090312 kB' 'KReclaimable: 195964 kB' 'Slab: 688200 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492236 kB' 'KernelStack: 12896 kB' 'PageTables: 7616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 9606300 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.994 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.994 02:16:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.995 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.995 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.996 02:16:08 -- setup/common.sh@33 -- # echo 0 00:04:43.996 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:43.996 02:16:08 -- setup/hugepages.sh@100 -- # resv=0 00:04:43.996 02:16:08 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:43.996 nr_hugepages=1536 00:04:43.996 02:16:08 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:43.996 resv_hugepages=0 00:04:43.996 02:16:08 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:43.996 surplus_hugepages=0 00:04:43.996 02:16:08 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:43.996 anon_hugepages=0 00:04:43.996 02:16:08 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:43.996 02:16:08 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:43.996 02:16:08 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:43.996 02:16:08 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:43.996 02:16:08 -- setup/common.sh@18 -- # local node= 00:04:43.996 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:43.996 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.996 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.996 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.996 02:16:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.996 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.996 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 42724292 kB' 'MemAvailable: 46481372 kB' 'Buffers: 2708 kB' 'Cached: 12240292 kB' 'SwapCached: 0 kB' 'Active: 8927028 kB' 'Inactive: 3757844 kB' 'Active(anon): 8532196 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 445152 kB' 'Mapped: 201940 kB' 'Shmem: 8090324 kB' 'KReclaimable: 195964 kB' 'Slab: 688220 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492256 kB' 'KernelStack: 12912 kB' 'PageTables: 7680 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 9606316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.996 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.996 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.997 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.997 02:16:08 -- setup/common.sh@33 -- # echo 1536 00:04:43.997 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:43.997 02:16:08 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:43.997 02:16:08 -- setup/hugepages.sh@112 -- # get_nodes 00:04:43.997 02:16:08 -- setup/hugepages.sh@27 -- # local node 00:04:43.997 02:16:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.997 02:16:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.997 02:16:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.997 02:16:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:43.997 02:16:08 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:43.997 02:16:08 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:43.997 02:16:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.997 02:16:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.997 02:16:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:43.997 02:16:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.997 02:16:08 -- setup/common.sh@18 -- # local node=0 00:04:43.997 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:43.997 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.997 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.997 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:43.997 02:16:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:43.997 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.997 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.997 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27121324 kB' 'MemUsed: 5704532 kB' 'SwapCached: 0 kB' 'Active: 3445888 kB' 'Inactive: 176984 kB' 'Active(anon): 3293020 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322192 kB' 'Mapped: 72368 kB' 'AnonPages: 303800 kB' 'Shmem: 2992340 kB' 'KernelStack: 8040 kB' 'PageTables: 4272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115548 kB' 'Slab: 391616 kB' 'SReclaimable: 115548 kB' 'SUnreclaim: 276068 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # continue 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.998 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.998 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.998 02:16:08 -- setup/common.sh@33 -- # echo 0 00:04:43.998 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:43.998 02:16:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.998 02:16:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.998 02:16:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.259 02:16:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:44.259 02:16:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.259 02:16:08 -- setup/common.sh@18 -- # local node=1 00:04:44.259 02:16:08 -- setup/common.sh@19 -- # local var val 00:04:44.259 02:16:08 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.259 02:16:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.259 02:16:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:44.259 02:16:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:44.259 02:16:08 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.259 02:16:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15602968 kB' 'MemUsed: 12106824 kB' 'SwapCached: 0 kB' 'Active: 5481208 kB' 'Inactive: 3580860 kB' 'Active(anon): 5239244 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3580860 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8920836 kB' 'Mapped: 129572 kB' 'AnonPages: 141360 kB' 'Shmem: 5098012 kB' 'KernelStack: 4872 kB' 'PageTables: 3408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 80416 kB' 'Slab: 296604 kB' 'SReclaimable: 80416 kB' 'SUnreclaim: 216188 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.259 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.259 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # continue 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.260 02:16:08 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.260 02:16:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.260 02:16:08 -- setup/common.sh@33 -- # echo 0 00:04:44.260 02:16:08 -- setup/common.sh@33 -- # return 0 00:04:44.260 02:16:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.260 02:16:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.260 02:16:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.260 02:16:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.260 02:16:08 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:44.260 node0=512 expecting 512 00:04:44.260 02:16:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.260 02:16:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.260 02:16:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.260 02:16:08 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:44.260 node1=1024 expecting 1024 00:04:44.260 02:16:08 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:44.260 00:04:44.260 real 0m1.477s 00:04:44.260 user 0m0.607s 00:04:44.260 sys 0m0.836s 00:04:44.260 02:16:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.260 02:16:08 -- common/autotest_common.sh@10 -- # set +x 00:04:44.260 ************************************ 00:04:44.260 END TEST custom_alloc 00:04:44.260 ************************************ 00:04:44.260 02:16:08 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:44.260 02:16:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.260 02:16:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.260 02:16:08 -- common/autotest_common.sh@10 -- # set +x 00:04:44.260 ************************************ 00:04:44.260 START TEST no_shrink_alloc 00:04:44.260 ************************************ 00:04:44.260 02:16:08 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:44.260 02:16:08 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:44.260 02:16:08 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:44.260 02:16:08 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:44.260 02:16:08 -- setup/hugepages.sh@51 -- # shift 00:04:44.260 02:16:08 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:44.260 02:16:08 -- setup/hugepages.sh@52 -- # local node_ids 00:04:44.260 02:16:08 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:44.260 02:16:08 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:44.260 02:16:08 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:44.260 02:16:08 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:44.260 02:16:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:44.260 02:16:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:44.260 02:16:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:44.260 02:16:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:44.260 02:16:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:44.260 02:16:08 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:44.260 02:16:08 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:44.260 02:16:08 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:44.260 02:16:08 -- setup/hugepages.sh@73 -- # return 0 00:04:44.260 02:16:08 -- setup/hugepages.sh@198 -- # setup output 00:04:44.260 02:16:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:44.260 02:16:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:45.195 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.195 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:45.195 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.195 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.195 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.195 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.195 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.195 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.195 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.457 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.457 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.457 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.457 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.457 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.457 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.457 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.457 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.457 02:16:10 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:45.457 02:16:10 -- setup/hugepages.sh@89 -- # local node 00:04:45.457 02:16:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:45.457 02:16:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:45.457 02:16:10 -- setup/hugepages.sh@92 -- # local surp 00:04:45.457 02:16:10 -- setup/hugepages.sh@93 -- # local resv 00:04:45.457 02:16:10 -- setup/hugepages.sh@94 -- # local anon 00:04:45.457 02:16:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:45.457 02:16:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:45.457 02:16:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:45.457 02:16:10 -- setup/common.sh@18 -- # local node= 00:04:45.457 02:16:10 -- setup/common.sh@19 -- # local var val 00:04:45.457 02:16:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.457 02:16:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.457 02:16:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.457 02:16:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.457 02:16:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.457 02:16:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43775032 kB' 'MemAvailable: 47532112 kB' 'Buffers: 2708 kB' 'Cached: 12240348 kB' 'SwapCached: 0 kB' 'Active: 8928160 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533328 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446296 kB' 'Mapped: 202036 kB' 'Shmem: 8090380 kB' 'KReclaimable: 195964 kB' 'Slab: 688096 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492132 kB' 'KernelStack: 12976 kB' 'PageTables: 7840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.457 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.457 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.458 02:16:10 -- setup/common.sh@33 -- # echo 0 00:04:45.458 02:16:10 -- setup/common.sh@33 -- # return 0 00:04:45.458 02:16:10 -- setup/hugepages.sh@97 -- # anon=0 00:04:45.458 02:16:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:45.458 02:16:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.458 02:16:10 -- setup/common.sh@18 -- # local node= 00:04:45.458 02:16:10 -- setup/common.sh@19 -- # local var val 00:04:45.458 02:16:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.458 02:16:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.458 02:16:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.458 02:16:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.458 02:16:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.458 02:16:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43777304 kB' 'MemAvailable: 47534384 kB' 'Buffers: 2708 kB' 'Cached: 12240352 kB' 'SwapCached: 0 kB' 'Active: 8928456 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533624 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446928 kB' 'Mapped: 202112 kB' 'Shmem: 8090384 kB' 'KReclaimable: 195964 kB' 'Slab: 688144 kB' 'SReclaimable: 195964 kB' 'SUnreclaim: 492180 kB' 'KernelStack: 12912 kB' 'PageTables: 7640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.458 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.458 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.459 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.459 02:16:10 -- setup/common.sh@33 -- # echo 0 00:04:45.459 02:16:10 -- setup/common.sh@33 -- # return 0 00:04:45.459 02:16:10 -- setup/hugepages.sh@99 -- # surp=0 00:04:45.459 02:16:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:45.459 02:16:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:45.459 02:16:10 -- setup/common.sh@18 -- # local node= 00:04:45.459 02:16:10 -- setup/common.sh@19 -- # local var val 00:04:45.459 02:16:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.459 02:16:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.459 02:16:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.459 02:16:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.459 02:16:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.459 02:16:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.459 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43780520 kB' 'MemAvailable: 47537608 kB' 'Buffers: 2708 kB' 'Cached: 12240364 kB' 'SwapCached: 0 kB' 'Active: 8930008 kB' 'Inactive: 3757844 kB' 'Active(anon): 8535176 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448160 kB' 'Mapped: 202036 kB' 'Shmem: 8090396 kB' 'KReclaimable: 195980 kB' 'Slab: 688160 kB' 'SReclaimable: 195980 kB' 'SUnreclaim: 492180 kB' 'KernelStack: 12896 kB' 'PageTables: 7604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.460 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.460 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.719 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.719 02:16:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.720 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.720 02:16:10 -- setup/common.sh@33 -- # echo 0 00:04:45.720 02:16:10 -- setup/common.sh@33 -- # return 0 00:04:45.720 02:16:10 -- setup/hugepages.sh@100 -- # resv=0 00:04:45.720 02:16:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:45.720 nr_hugepages=1024 00:04:45.720 02:16:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:45.720 resv_hugepages=0 00:04:45.720 02:16:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:45.720 surplus_hugepages=0 00:04:45.720 02:16:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:45.720 anon_hugepages=0 00:04:45.720 02:16:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.720 02:16:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:45.720 02:16:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:45.720 02:16:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:45.720 02:16:10 -- setup/common.sh@18 -- # local node= 00:04:45.720 02:16:10 -- setup/common.sh@19 -- # local var val 00:04:45.720 02:16:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.720 02:16:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.720 02:16:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.720 02:16:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.720 02:16:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.720 02:16:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.720 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43780552 kB' 'MemAvailable: 47537640 kB' 'Buffers: 2708 kB' 'Cached: 12240376 kB' 'SwapCached: 0 kB' 'Active: 8929404 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534572 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447548 kB' 'Mapped: 202036 kB' 'Shmem: 8090408 kB' 'KReclaimable: 195980 kB' 'Slab: 688128 kB' 'SReclaimable: 195980 kB' 'SUnreclaim: 492148 kB' 'KernelStack: 12880 kB' 'PageTables: 7552 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.721 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.721 02:16:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.722 02:16:10 -- setup/common.sh@33 -- # echo 1024 00:04:45.722 02:16:10 -- setup/common.sh@33 -- # return 0 00:04:45.722 02:16:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.722 02:16:10 -- setup/hugepages.sh@112 -- # get_nodes 00:04:45.722 02:16:10 -- setup/hugepages.sh@27 -- # local node 00:04:45.722 02:16:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.722 02:16:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:45.722 02:16:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.722 02:16:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:45.722 02:16:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.722 02:16:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.722 02:16:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.722 02:16:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.722 02:16:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:45.722 02:16:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.722 02:16:10 -- setup/common.sh@18 -- # local node=0 00:04:45.722 02:16:10 -- setup/common.sh@19 -- # local var val 00:04:45.722 02:16:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.722 02:16:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.722 02:16:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:45.722 02:16:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:45.722 02:16:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.722 02:16:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26073744 kB' 'MemUsed: 6752112 kB' 'SwapCached: 0 kB' 'Active: 3448548 kB' 'Inactive: 176984 kB' 'Active(anon): 3295680 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322236 kB' 'Mapped: 72464 kB' 'AnonPages: 306632 kB' 'Shmem: 2992384 kB' 'KernelStack: 8008 kB' 'PageTables: 4272 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115564 kB' 'Slab: 391632 kB' 'SReclaimable: 115564 kB' 'SUnreclaim: 276068 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.722 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.722 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.723 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.723 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # continue 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.724 02:16:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.724 02:16:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.724 02:16:10 -- setup/common.sh@33 -- # echo 0 00:04:45.724 02:16:10 -- setup/common.sh@33 -- # return 0 00:04:45.724 02:16:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.724 02:16:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.724 02:16:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.724 02:16:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.724 02:16:10 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:45.724 node0=1024 expecting 1024 00:04:45.724 02:16:10 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:45.724 02:16:10 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:45.724 02:16:10 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:45.724 02:16:10 -- setup/hugepages.sh@202 -- # setup output 00:04:45.724 02:16:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.724 02:16:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.102 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.102 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:47.102 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.102 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.102 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.102 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.102 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.102 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.102 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.102 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.102 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.102 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.102 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.102 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.102 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.102 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.102 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.102 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:47.102 02:16:11 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:47.102 02:16:11 -- setup/hugepages.sh@89 -- # local node 00:04:47.102 02:16:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.102 02:16:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.102 02:16:11 -- setup/hugepages.sh@92 -- # local surp 00:04:47.102 02:16:11 -- setup/hugepages.sh@93 -- # local resv 00:04:47.102 02:16:11 -- setup/hugepages.sh@94 -- # local anon 00:04:47.102 02:16:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.102 02:16:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.102 02:16:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.102 02:16:11 -- setup/common.sh@18 -- # local node= 00:04:47.102 02:16:11 -- setup/common.sh@19 -- # local var val 00:04:47.102 02:16:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.102 02:16:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.102 02:16:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.102 02:16:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.102 02:16:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.102 02:16:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43783228 kB' 'MemAvailable: 47540300 kB' 'Buffers: 2708 kB' 'Cached: 12240432 kB' 'SwapCached: 0 kB' 'Active: 8929664 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534832 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447516 kB' 'Mapped: 202140 kB' 'Shmem: 8090464 kB' 'KReclaimable: 195948 kB' 'Slab: 687864 kB' 'SReclaimable: 195948 kB' 'SUnreclaim: 491916 kB' 'KernelStack: 13408 kB' 'PageTables: 8980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9609360 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198808 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.102 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.102 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.103 02:16:11 -- setup/common.sh@33 -- # echo 0 00:04:47.103 02:16:11 -- setup/common.sh@33 -- # return 0 00:04:47.103 02:16:11 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.103 02:16:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.103 02:16:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.103 02:16:11 -- setup/common.sh@18 -- # local node= 00:04:47.103 02:16:11 -- setup/common.sh@19 -- # local var val 00:04:47.103 02:16:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.103 02:16:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.103 02:16:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.103 02:16:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.103 02:16:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.103 02:16:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43787632 kB' 'MemAvailable: 47544704 kB' 'Buffers: 2708 kB' 'Cached: 12240436 kB' 'SwapCached: 0 kB' 'Active: 8930124 kB' 'Inactive: 3757844 kB' 'Active(anon): 8535292 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447936 kB' 'Mapped: 201980 kB' 'Shmem: 8090468 kB' 'KReclaimable: 195948 kB' 'Slab: 687808 kB' 'SReclaimable: 195948 kB' 'SUnreclaim: 491860 kB' 'KernelStack: 13312 kB' 'PageTables: 9208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9610764 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198824 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.103 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.103 02:16:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.104 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.104 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.105 02:16:11 -- setup/common.sh@33 -- # echo 0 00:04:47.105 02:16:11 -- setup/common.sh@33 -- # return 0 00:04:47.105 02:16:11 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.105 02:16:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.105 02:16:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.105 02:16:11 -- setup/common.sh@18 -- # local node= 00:04:47.105 02:16:11 -- setup/common.sh@19 -- # local var val 00:04:47.105 02:16:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.105 02:16:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.105 02:16:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.105 02:16:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.105 02:16:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.105 02:16:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43786908 kB' 'MemAvailable: 47543980 kB' 'Buffers: 2708 kB' 'Cached: 12240448 kB' 'SwapCached: 0 kB' 'Active: 8929564 kB' 'Inactive: 3757844 kB' 'Active(anon): 8534732 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447852 kB' 'Mapped: 202012 kB' 'Shmem: 8090480 kB' 'KReclaimable: 195948 kB' 'Slab: 687808 kB' 'SReclaimable: 195948 kB' 'SUnreclaim: 491860 kB' 'KernelStack: 13120 kB' 'PageTables: 9492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606728 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.105 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.105 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.106 02:16:11 -- setup/common.sh@33 -- # echo 0 00:04:47.106 02:16:11 -- setup/common.sh@33 -- # return 0 00:04:47.106 02:16:11 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.106 02:16:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:47.106 nr_hugepages=1024 00:04:47.106 02:16:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.106 resv_hugepages=0 00:04:47.106 02:16:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.106 surplus_hugepages=0 00:04:47.106 02:16:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.106 anon_hugepages=0 00:04:47.106 02:16:11 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.106 02:16:11 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:47.106 02:16:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.106 02:16:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.106 02:16:11 -- setup/common.sh@18 -- # local node= 00:04:47.106 02:16:11 -- setup/common.sh@19 -- # local var val 00:04:47.106 02:16:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.106 02:16:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.106 02:16:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.106 02:16:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.106 02:16:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.106 02:16:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43788072 kB' 'MemAvailable: 47545144 kB' 'Buffers: 2708 kB' 'Cached: 12240460 kB' 'SwapCached: 0 kB' 'Active: 8928100 kB' 'Inactive: 3757844 kB' 'Active(anon): 8533268 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446040 kB' 'Mapped: 202036 kB' 'Shmem: 8090492 kB' 'KReclaimable: 195948 kB' 'Slab: 687820 kB' 'SReclaimable: 195948 kB' 'SUnreclaim: 491872 kB' 'KernelStack: 12928 kB' 'PageTables: 7684 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 9606744 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1726044 kB' 'DirectMap2M: 12873728 kB' 'DirectMap1G: 55574528 kB' 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.106 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.106 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.107 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.107 02:16:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.108 02:16:11 -- setup/common.sh@33 -- # echo 1024 00:04:47.108 02:16:11 -- setup/common.sh@33 -- # return 0 00:04:47.108 02:16:11 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.108 02:16:11 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.108 02:16:11 -- setup/hugepages.sh@27 -- # local node 00:04:47.108 02:16:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.108 02:16:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:47.108 02:16:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.108 02:16:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:47.108 02:16:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.108 02:16:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.108 02:16:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.108 02:16:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.108 02:16:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.108 02:16:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.108 02:16:11 -- setup/common.sh@18 -- # local node=0 00:04:47.108 02:16:11 -- setup/common.sh@19 -- # local var val 00:04:47.108 02:16:11 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.108 02:16:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.108 02:16:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.108 02:16:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.108 02:16:11 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.108 02:16:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26068272 kB' 'MemUsed: 6757584 kB' 'SwapCached: 0 kB' 'Active: 3446876 kB' 'Inactive: 176984 kB' 'Active(anon): 3294008 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176984 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3322268 kB' 'Mapped: 72388 kB' 'AnonPages: 304704 kB' 'Shmem: 2992416 kB' 'KernelStack: 8008 kB' 'PageTables: 4316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115540 kB' 'Slab: 391296 kB' 'SReclaimable: 115540 kB' 'SUnreclaim: 275756 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.108 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.108 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # continue 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.109 02:16:11 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.109 02:16:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.109 02:16:11 -- setup/common.sh@33 -- # echo 0 00:04:47.109 02:16:11 -- setup/common.sh@33 -- # return 0 00:04:47.109 02:16:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.109 02:16:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.109 02:16:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.109 02:16:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.109 02:16:11 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:47.109 node0=1024 expecting 1024 00:04:47.109 02:16:11 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:47.109 00:04:47.109 real 0m2.922s 00:04:47.109 user 0m1.222s 00:04:47.109 sys 0m1.626s 00:04:47.109 02:16:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.109 02:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 ************************************ 00:04:47.109 END TEST no_shrink_alloc 00:04:47.109 ************************************ 00:04:47.109 02:16:11 -- setup/hugepages.sh@217 -- # clear_hp 00:04:47.109 02:16:11 -- setup/hugepages.sh@37 -- # local node hp 00:04:47.109 02:16:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:47.109 02:16:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:47.109 02:16:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:47.109 02:16:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:47.109 02:16:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:47.109 02:16:11 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:47.109 02:16:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:47.109 02:16:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:47.109 02:16:11 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:47.109 02:16:11 -- setup/hugepages.sh@41 -- # echo 0 00:04:47.109 02:16:11 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:47.109 02:16:11 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:47.109 00:04:47.109 real 0m11.612s 00:04:47.109 user 0m4.407s 00:04:47.109 sys 0m6.147s 00:04:47.109 02:16:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.109 02:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 ************************************ 00:04:47.109 END TEST hugepages 00:04:47.109 ************************************ 00:04:47.109 02:16:11 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:47.109 02:16:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.109 02:16:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.109 02:16:11 -- common/autotest_common.sh@10 -- # set +x 00:04:47.109 ************************************ 00:04:47.109 START TEST driver 00:04:47.109 ************************************ 00:04:47.109 02:16:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:47.109 * Looking for test storage... 00:04:47.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:47.109 02:16:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:47.109 02:16:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:47.109 02:16:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:47.368 02:16:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:47.368 02:16:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:47.368 02:16:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:47.368 02:16:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:47.368 02:16:11 -- scripts/common.sh@335 -- # IFS=.-: 00:04:47.368 02:16:11 -- scripts/common.sh@335 -- # read -ra ver1 00:04:47.368 02:16:11 -- scripts/common.sh@336 -- # IFS=.-: 00:04:47.368 02:16:11 -- scripts/common.sh@336 -- # read -ra ver2 00:04:47.368 02:16:11 -- scripts/common.sh@337 -- # local 'op=<' 00:04:47.368 02:16:11 -- scripts/common.sh@339 -- # ver1_l=2 00:04:47.368 02:16:11 -- scripts/common.sh@340 -- # ver2_l=1 00:04:47.368 02:16:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:47.368 02:16:11 -- scripts/common.sh@343 -- # case "$op" in 00:04:47.368 02:16:11 -- scripts/common.sh@344 -- # : 1 00:04:47.368 02:16:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:47.368 02:16:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:47.368 02:16:11 -- scripts/common.sh@364 -- # decimal 1 00:04:47.368 02:16:11 -- scripts/common.sh@352 -- # local d=1 00:04:47.368 02:16:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:47.368 02:16:11 -- scripts/common.sh@354 -- # echo 1 00:04:47.368 02:16:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:47.368 02:16:11 -- scripts/common.sh@365 -- # decimal 2 00:04:47.368 02:16:11 -- scripts/common.sh@352 -- # local d=2 00:04:47.368 02:16:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:47.368 02:16:11 -- scripts/common.sh@354 -- # echo 2 00:04:47.368 02:16:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:47.368 02:16:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:47.368 02:16:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:47.368 02:16:11 -- scripts/common.sh@367 -- # return 0 00:04:47.368 02:16:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:47.368 02:16:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:47.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.368 --rc genhtml_branch_coverage=1 00:04:47.368 --rc genhtml_function_coverage=1 00:04:47.368 --rc genhtml_legend=1 00:04:47.368 --rc geninfo_all_blocks=1 00:04:47.368 --rc geninfo_unexecuted_blocks=1 00:04:47.368 00:04:47.368 ' 00:04:47.368 02:16:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:47.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.368 --rc genhtml_branch_coverage=1 00:04:47.368 --rc genhtml_function_coverage=1 00:04:47.368 --rc genhtml_legend=1 00:04:47.368 --rc geninfo_all_blocks=1 00:04:47.368 --rc geninfo_unexecuted_blocks=1 00:04:47.368 00:04:47.368 ' 00:04:47.368 02:16:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:47.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.368 --rc genhtml_branch_coverage=1 00:04:47.368 --rc genhtml_function_coverage=1 00:04:47.368 --rc genhtml_legend=1 00:04:47.368 --rc geninfo_all_blocks=1 00:04:47.368 --rc geninfo_unexecuted_blocks=1 00:04:47.368 00:04:47.368 ' 00:04:47.368 02:16:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:47.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.368 --rc genhtml_branch_coverage=1 00:04:47.368 --rc genhtml_function_coverage=1 00:04:47.368 --rc genhtml_legend=1 00:04:47.368 --rc geninfo_all_blocks=1 00:04:47.368 --rc geninfo_unexecuted_blocks=1 00:04:47.368 00:04:47.368 ' 00:04:47.368 02:16:11 -- setup/driver.sh@68 -- # setup reset 00:04:47.368 02:16:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:47.368 02:16:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:49.901 02:16:14 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:49.901 02:16:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.901 02:16:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.901 02:16:14 -- common/autotest_common.sh@10 -- # set +x 00:04:49.901 ************************************ 00:04:49.901 START TEST guess_driver 00:04:49.901 ************************************ 00:04:49.901 02:16:14 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:49.901 02:16:14 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:49.901 02:16:14 -- setup/driver.sh@47 -- # local fail=0 00:04:49.901 02:16:14 -- setup/driver.sh@49 -- # pick_driver 00:04:49.901 02:16:14 -- setup/driver.sh@36 -- # vfio 00:04:49.901 02:16:14 -- setup/driver.sh@21 -- # local iommu_grups 00:04:49.901 02:16:14 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:49.901 02:16:14 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:49.901 02:16:14 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:49.901 02:16:14 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:49.901 02:16:14 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:49.901 02:16:14 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:49.901 02:16:14 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:49.901 02:16:14 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:49.901 02:16:14 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:49.901 02:16:14 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:49.901 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:49.901 02:16:14 -- setup/driver.sh@30 -- # return 0 00:04:49.901 02:16:14 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:49.901 02:16:14 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:49.901 02:16:14 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:49.901 02:16:14 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:49.901 Looking for driver=vfio-pci 00:04:49.901 02:16:14 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:49.901 02:16:14 -- setup/driver.sh@45 -- # setup output config 00:04:49.901 02:16:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.901 02:16:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.278 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.278 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.278 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:51.279 02:16:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:51.279 02:16:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:51.279 02:16:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:52.217 02:16:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:52.217 02:16:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:52.217 02:16:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:52.217 02:16:16 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:52.217 02:16:16 -- setup/driver.sh@65 -- # setup reset 00:04:52.217 02:16:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:52.217 02:16:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:54.758 00:04:54.758 real 0m4.778s 00:04:54.758 user 0m1.138s 00:04:54.758 sys 0m1.886s 00:04:54.758 02:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.758 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:04:54.758 ************************************ 00:04:54.758 END TEST guess_driver 00:04:54.758 ************************************ 00:04:54.758 00:04:54.758 real 0m7.433s 00:04:54.758 user 0m1.796s 00:04:54.758 sys 0m2.955s 00:04:54.758 02:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.758 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:04:54.758 ************************************ 00:04:54.758 END TEST driver 00:04:54.758 ************************************ 00:04:54.758 02:16:19 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:54.758 02:16:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.758 02:16:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.759 02:16:19 -- common/autotest_common.sh@10 -- # set +x 00:04:54.759 ************************************ 00:04:54.759 START TEST devices 00:04:54.759 ************************************ 00:04:54.759 02:16:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:54.759 * Looking for test storage... 00:04:54.759 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:54.759 02:16:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:54.759 02:16:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:54.759 02:16:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:54.759 02:16:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:54.759 02:16:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:54.759 02:16:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:54.759 02:16:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:54.759 02:16:19 -- scripts/common.sh@335 -- # IFS=.-: 00:04:54.759 02:16:19 -- scripts/common.sh@335 -- # read -ra ver1 00:04:54.759 02:16:19 -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.759 02:16:19 -- scripts/common.sh@336 -- # read -ra ver2 00:04:54.759 02:16:19 -- scripts/common.sh@337 -- # local 'op=<' 00:04:54.759 02:16:19 -- scripts/common.sh@339 -- # ver1_l=2 00:04:54.759 02:16:19 -- scripts/common.sh@340 -- # ver2_l=1 00:04:54.759 02:16:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:54.759 02:16:19 -- scripts/common.sh@343 -- # case "$op" in 00:04:54.759 02:16:19 -- scripts/common.sh@344 -- # : 1 00:04:54.759 02:16:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:54.759 02:16:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.759 02:16:19 -- scripts/common.sh@364 -- # decimal 1 00:04:54.759 02:16:19 -- scripts/common.sh@352 -- # local d=1 00:04:54.759 02:16:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.759 02:16:19 -- scripts/common.sh@354 -- # echo 1 00:04:54.759 02:16:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:54.759 02:16:19 -- scripts/common.sh@365 -- # decimal 2 00:04:54.759 02:16:19 -- scripts/common.sh@352 -- # local d=2 00:04:54.759 02:16:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.759 02:16:19 -- scripts/common.sh@354 -- # echo 2 00:04:54.760 02:16:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:54.760 02:16:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:54.760 02:16:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:54.760 02:16:19 -- scripts/common.sh@367 -- # return 0 00:04:54.760 02:16:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.760 02:16:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:54.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.760 --rc genhtml_branch_coverage=1 00:04:54.760 --rc genhtml_function_coverage=1 00:04:54.760 --rc genhtml_legend=1 00:04:54.760 --rc geninfo_all_blocks=1 00:04:54.760 --rc geninfo_unexecuted_blocks=1 00:04:54.760 00:04:54.760 ' 00:04:54.760 02:16:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:54.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.760 --rc genhtml_branch_coverage=1 00:04:54.760 --rc genhtml_function_coverage=1 00:04:54.760 --rc genhtml_legend=1 00:04:54.760 --rc geninfo_all_blocks=1 00:04:54.760 --rc geninfo_unexecuted_blocks=1 00:04:54.760 00:04:54.760 ' 00:04:54.760 02:16:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:54.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.760 --rc genhtml_branch_coverage=1 00:04:54.760 --rc genhtml_function_coverage=1 00:04:54.760 --rc genhtml_legend=1 00:04:54.760 --rc geninfo_all_blocks=1 00:04:54.760 --rc geninfo_unexecuted_blocks=1 00:04:54.760 00:04:54.760 ' 00:04:54.760 02:16:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:54.760 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.760 --rc genhtml_branch_coverage=1 00:04:54.760 --rc genhtml_function_coverage=1 00:04:54.760 --rc genhtml_legend=1 00:04:54.760 --rc geninfo_all_blocks=1 00:04:54.761 --rc geninfo_unexecuted_blocks=1 00:04:54.761 00:04:54.761 ' 00:04:54.761 02:16:19 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:54.761 02:16:19 -- setup/devices.sh@192 -- # setup reset 00:04:54.761 02:16:19 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:54.761 02:16:19 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:56.168 02:16:20 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:56.168 02:16:20 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:56.168 02:16:20 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:56.168 02:16:20 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:56.168 02:16:20 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:56.168 02:16:20 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:56.168 02:16:20 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:56.168 02:16:20 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:56.168 02:16:20 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:56.168 02:16:20 -- setup/devices.sh@196 -- # blocks=() 00:04:56.168 02:16:20 -- setup/devices.sh@196 -- # declare -a blocks 00:04:56.168 02:16:20 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:56.168 02:16:20 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:56.168 02:16:20 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:56.168 02:16:20 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:56.168 02:16:20 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:56.168 02:16:20 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:56.168 02:16:20 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:56.168 02:16:20 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:56.168 02:16:20 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:56.168 02:16:20 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:56.168 02:16:20 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:56.168 No valid GPT data, bailing 00:04:56.168 02:16:20 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:56.427 02:16:20 -- scripts/common.sh@393 -- # pt= 00:04:56.427 02:16:20 -- scripts/common.sh@394 -- # return 1 00:04:56.427 02:16:20 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:56.427 02:16:20 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:56.427 02:16:20 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:56.427 02:16:20 -- setup/common.sh@80 -- # echo 1000204886016 00:04:56.427 02:16:20 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:56.427 02:16:20 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:56.427 02:16:20 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:56.427 02:16:20 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:56.427 02:16:20 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:56.427 02:16:20 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:56.427 02:16:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.427 02:16:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.427 02:16:20 -- common/autotest_common.sh@10 -- # set +x 00:04:56.427 ************************************ 00:04:56.427 START TEST nvme_mount 00:04:56.427 ************************************ 00:04:56.427 02:16:20 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:56.427 02:16:20 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:56.428 02:16:20 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:56.428 02:16:20 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:56.428 02:16:20 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:56.428 02:16:20 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:56.428 02:16:20 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:56.428 02:16:20 -- setup/common.sh@40 -- # local part_no=1 00:04:56.428 02:16:20 -- setup/common.sh@41 -- # local size=1073741824 00:04:56.428 02:16:20 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:56.428 02:16:20 -- setup/common.sh@44 -- # parts=() 00:04:56.428 02:16:20 -- setup/common.sh@44 -- # local parts 00:04:56.428 02:16:20 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:56.428 02:16:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:56.428 02:16:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:56.428 02:16:20 -- setup/common.sh@46 -- # (( part++ )) 00:04:56.428 02:16:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:56.428 02:16:20 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:56.428 02:16:20 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:56.428 02:16:20 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:57.364 Creating new GPT entries in memory. 00:04:57.364 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:57.365 other utilities. 00:04:57.365 02:16:21 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:57.365 02:16:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:57.365 02:16:21 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:57.365 02:16:21 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:57.365 02:16:21 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:58.302 Creating new GPT entries in memory. 00:04:58.302 The operation has completed successfully. 00:04:58.302 02:16:22 -- setup/common.sh@57 -- # (( part++ )) 00:04:58.302 02:16:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:58.302 02:16:22 -- setup/common.sh@62 -- # wait 1934714 00:04:58.302 02:16:22 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.302 02:16:22 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:58.302 02:16:22 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.302 02:16:22 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:58.302 02:16:22 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:58.302 02:16:22 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.562 02:16:22 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:58.562 02:16:22 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:58.562 02:16:22 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:58.562 02:16:22 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.562 02:16:22 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:58.562 02:16:22 -- setup/devices.sh@53 -- # local found=0 00:04:58.562 02:16:22 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:58.562 02:16:22 -- setup/devices.sh@56 -- # : 00:04:58.562 02:16:22 -- setup/devices.sh@59 -- # local pci status 00:04:58.562 02:16:22 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.562 02:16:22 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:58.562 02:16:22 -- setup/devices.sh@47 -- # setup output config 00:04:58.562 02:16:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:58.562 02:16:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:59.499 02:16:23 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:23 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:59.499 02:16:23 -- setup/devices.sh@63 -- # found=1 00:04:59.499 02:16:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.499 02:16:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.499 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.758 02:16:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:59.758 02:16:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:59.758 02:16:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.758 02:16:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:59.758 02:16:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:59.758 02:16:24 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:59.758 02:16:24 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.758 02:16:24 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.758 02:16:24 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:59.758 02:16:24 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:59.758 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:59.758 02:16:24 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:59.758 02:16:24 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:00.017 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:00.017 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:00.017 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:00.017 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:00.017 02:16:24 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:00.017 02:16:24 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:00.017 02:16:24 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.017 02:16:24 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:00.017 02:16:24 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:00.017 02:16:24 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.017 02:16:24 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:00.017 02:16:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:00.017 02:16:24 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:00.017 02:16:24 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.017 02:16:24 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:00.017 02:16:24 -- setup/devices.sh@53 -- # local found=0 00:05:00.017 02:16:24 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:00.017 02:16:24 -- setup/devices.sh@56 -- # : 00:05:00.017 02:16:24 -- setup/devices.sh@59 -- # local pci status 00:05:00.017 02:16:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:00.017 02:16:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:00.017 02:16:24 -- setup/devices.sh@47 -- # setup output config 00:05:00.017 02:16:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:00.017 02:16:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:01.395 02:16:25 -- setup/devices.sh@63 -- # found=1 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:01.395 02:16:25 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:01.395 02:16:25 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.395 02:16:25 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:01.395 02:16:25 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:01.395 02:16:25 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.395 02:16:25 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:01.395 02:16:25 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:01.395 02:16:25 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:01.395 02:16:25 -- setup/devices.sh@50 -- # local mount_point= 00:05:01.395 02:16:25 -- setup/devices.sh@51 -- # local test_file= 00:05:01.395 02:16:25 -- setup/devices.sh@53 -- # local found=0 00:05:01.395 02:16:25 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:01.395 02:16:25 -- setup/devices.sh@59 -- # local pci status 00:05:01.395 02:16:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.395 02:16:25 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:01.395 02:16:25 -- setup/devices.sh@47 -- # setup output config 00:05:01.395 02:16:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.395 02:16:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:02.772 02:16:27 -- setup/devices.sh@63 -- # found=1 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.772 02:16:27 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:02.772 02:16:27 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:02.772 02:16:27 -- setup/devices.sh@68 -- # return 0 00:05:02.772 02:16:27 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:02.772 02:16:27 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.772 02:16:27 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:02.772 02:16:27 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:02.772 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:02.772 00:05:02.772 real 0m6.503s 00:05:02.772 user 0m1.541s 00:05:02.772 sys 0m2.542s 00:05:02.772 02:16:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.772 02:16:27 -- common/autotest_common.sh@10 -- # set +x 00:05:02.772 ************************************ 00:05:02.772 END TEST nvme_mount 00:05:02.772 ************************************ 00:05:02.772 02:16:27 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:02.772 02:16:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.772 02:16:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.772 02:16:27 -- common/autotest_common.sh@10 -- # set +x 00:05:02.772 ************************************ 00:05:02.772 START TEST dm_mount 00:05:02.772 ************************************ 00:05:02.772 02:16:27 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:02.772 02:16:27 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:02.772 02:16:27 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:02.772 02:16:27 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:02.772 02:16:27 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:02.772 02:16:27 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:02.772 02:16:27 -- setup/common.sh@40 -- # local part_no=2 00:05:02.772 02:16:27 -- setup/common.sh@41 -- # local size=1073741824 00:05:02.772 02:16:27 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:02.772 02:16:27 -- setup/common.sh@44 -- # parts=() 00:05:02.772 02:16:27 -- setup/common.sh@44 -- # local parts 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:02.772 02:16:27 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part++ )) 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:02.772 02:16:27 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part++ )) 00:05:02.772 02:16:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:02.772 02:16:27 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:02.772 02:16:27 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:02.772 02:16:27 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:03.710 Creating new GPT entries in memory. 00:05:03.710 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:03.710 other utilities. 00:05:03.710 02:16:28 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:03.710 02:16:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:03.710 02:16:28 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:03.710 02:16:28 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:03.710 02:16:28 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:05.089 Creating new GPT entries in memory. 00:05:05.089 The operation has completed successfully. 00:05:05.089 02:16:29 -- setup/common.sh@57 -- # (( part++ )) 00:05:05.089 02:16:29 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:05.089 02:16:29 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:05.089 02:16:29 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:05.089 02:16:29 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:06.028 The operation has completed successfully. 00:05:06.028 02:16:30 -- setup/common.sh@57 -- # (( part++ )) 00:05:06.028 02:16:30 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.028 02:16:30 -- setup/common.sh@62 -- # wait 1937179 00:05:06.028 02:16:30 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:06.028 02:16:30 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:06.028 02:16:30 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.028 02:16:30 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:06.028 02:16:30 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:06.028 02:16:30 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.028 02:16:30 -- setup/devices.sh@161 -- # break 00:05:06.028 02:16:30 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.028 02:16:30 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:06.028 02:16:30 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:06.028 02:16:30 -- setup/devices.sh@166 -- # dm=dm-0 00:05:06.028 02:16:30 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:06.028 02:16:30 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:06.028 02:16:30 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:06.028 02:16:30 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:06.028 02:16:30 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:06.028 02:16:30 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.028 02:16:30 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:06.028 02:16:30 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:06.028 02:16:30 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.028 02:16:30 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:06.028 02:16:30 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:06.028 02:16:30 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:06.028 02:16:30 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.028 02:16:30 -- setup/devices.sh@53 -- # local found=0 00:05:06.028 02:16:30 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:06.028 02:16:30 -- setup/devices.sh@56 -- # : 00:05:06.028 02:16:30 -- setup/devices.sh@59 -- # local pci status 00:05:06.028 02:16:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.028 02:16:30 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:06.028 02:16:30 -- setup/devices.sh@47 -- # setup output config 00:05:06.028 02:16:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:06.028 02:16:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:06.964 02:16:31 -- setup/devices.sh@63 -- # found=1 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.964 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.964 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.223 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.223 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.223 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.223 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:07.223 02:16:31 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:07.223 02:16:31 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:07.223 02:16:31 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:07.223 02:16:31 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:07.223 02:16:31 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:07.223 02:16:31 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:07.223 02:16:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:07.223 02:16:31 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:07.223 02:16:31 -- setup/devices.sh@50 -- # local mount_point= 00:05:07.223 02:16:31 -- setup/devices.sh@51 -- # local test_file= 00:05:07.223 02:16:31 -- setup/devices.sh@53 -- # local found=0 00:05:07.223 02:16:31 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:07.223 02:16:31 -- setup/devices.sh@59 -- # local pci status 00:05:07.223 02:16:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.223 02:16:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:07.223 02:16:31 -- setup/devices.sh@47 -- # setup output config 00:05:07.223 02:16:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:07.223 02:16:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:08.599 02:16:32 -- setup/devices.sh@63 -- # found=1 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:08.599 02:16:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.599 02:16:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:08.599 02:16:33 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:08.599 02:16:33 -- setup/devices.sh@68 -- # return 0 00:05:08.599 02:16:33 -- setup/devices.sh@187 -- # cleanup_dm 00:05:08.599 02:16:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.599 02:16:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:08.599 02:16:33 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:08.599 02:16:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:08.599 02:16:33 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:08.599 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:08.599 02:16:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:08.599 02:16:33 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:08.599 00:05:08.599 real 0m5.901s 00:05:08.599 user 0m0.978s 00:05:08.599 sys 0m1.808s 00:05:08.600 02:16:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.600 02:16:33 -- common/autotest_common.sh@10 -- # set +x 00:05:08.600 ************************************ 00:05:08.600 END TEST dm_mount 00:05:08.600 ************************************ 00:05:08.858 02:16:33 -- setup/devices.sh@1 -- # cleanup 00:05:08.858 02:16:33 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:08.858 02:16:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.858 02:16:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:08.858 02:16:33 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:08.858 02:16:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:08.858 02:16:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:09.117 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:09.117 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:09.117 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:09.117 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:09.117 02:16:33 -- setup/devices.sh@12 -- # cleanup_dm 00:05:09.117 02:16:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.117 02:16:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:09.117 02:16:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:09.117 02:16:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:09.117 02:16:33 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:09.117 02:16:33 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:09.117 00:05:09.117 real 0m14.412s 00:05:09.117 user 0m3.254s 00:05:09.117 sys 0m5.398s 00:05:09.117 02:16:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.117 02:16:33 -- common/autotest_common.sh@10 -- # set +x 00:05:09.117 ************************************ 00:05:09.117 END TEST devices 00:05:09.117 ************************************ 00:05:09.117 00:05:09.117 real 0m44.229s 00:05:09.117 user 0m12.842s 00:05:09.117 sys 0m20.014s 00:05:09.117 02:16:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.117 02:16:33 -- common/autotest_common.sh@10 -- # set +x 00:05:09.117 ************************************ 00:05:09.117 END TEST setup.sh 00:05:09.117 ************************************ 00:05:09.117 02:16:33 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:10.053 Hugepages 00:05:10.053 node hugesize free / total 00:05:10.053 node0 1048576kB 0 / 0 00:05:10.053 node0 2048kB 2048 / 2048 00:05:10.053 node1 1048576kB 0 / 0 00:05:10.053 node1 2048kB 0 / 0 00:05:10.053 00:05:10.053 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:10.053 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:10.053 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:10.053 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:10.053 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:10.053 02:16:34 -- spdk/autotest.sh@128 -- # uname -s 00:05:10.053 02:16:34 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:10.053 02:16:34 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:10.053 02:16:34 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:11.429 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:11.429 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:11.429 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:12.366 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:12.624 02:16:37 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:13.558 02:16:38 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:13.558 02:16:38 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:13.558 02:16:38 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:13.558 02:16:38 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:13.558 02:16:38 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:13.558 02:16:38 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:13.558 02:16:38 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:13.558 02:16:38 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:13.558 02:16:38 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:13.558 02:16:38 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:13.558 02:16:38 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:13.558 02:16:38 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:14.933 Waiting for block devices as requested 00:05:14.933 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:14.933 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:14.933 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:15.191 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:15.191 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:15.191 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:15.191 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:15.449 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:15.449 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:15.449 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:15.449 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:15.707 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:15.707 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:15.707 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:15.707 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:15.965 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:15.965 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:15.965 02:16:40 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:15.965 02:16:40 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:15.965 02:16:40 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:15.965 02:16:40 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:15.965 02:16:40 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:15.965 02:16:40 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:15.965 02:16:40 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:15.965 02:16:40 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:15.965 02:16:40 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:15.965 02:16:40 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:15.965 02:16:40 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:15.965 02:16:40 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:15.965 02:16:40 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:15.965 02:16:40 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:15.965 02:16:40 -- common/autotest_common.sh@1552 -- # continue 00:05:15.965 02:16:40 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:15.965 02:16:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:15.965 02:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:16.223 02:16:40 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:16.223 02:16:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:16.223 02:16:40 -- common/autotest_common.sh@10 -- # set +x 00:05:16.223 02:16:40 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:17.157 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:17.414 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:17.414 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:18.348 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:18.348 02:16:42 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:18.348 02:16:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.348 02:16:42 -- common/autotest_common.sh@10 -- # set +x 00:05:18.348 02:16:42 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:18.348 02:16:42 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:18.348 02:16:42 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:18.348 02:16:42 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:18.348 02:16:42 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:18.348 02:16:42 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:18.348 02:16:42 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:18.348 02:16:42 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:18.348 02:16:42 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:18.348 02:16:42 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:18.606 02:16:42 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:18.606 02:16:43 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:18.606 02:16:43 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:18.606 02:16:43 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:18.606 02:16:43 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:18.606 02:16:43 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:18.606 02:16:43 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:18.606 02:16:43 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:18.606 02:16:43 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:18.606 02:16:43 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:18.606 02:16:43 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1942477 00:05:18.606 02:16:43 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:18.606 02:16:43 -- common/autotest_common.sh@1593 -- # waitforlisten 1942477 00:05:18.606 02:16:43 -- common/autotest_common.sh@829 -- # '[' -z 1942477 ']' 00:05:18.606 02:16:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.606 02:16:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.606 02:16:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.606 02:16:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.606 02:16:43 -- common/autotest_common.sh@10 -- # set +x 00:05:18.606 [2024-11-27 02:16:43.100495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:18.606 [2024-11-27 02:16:43.100597] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1942477 ] 00:05:18.606 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.606 [2024-11-27 02:16:43.161753] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.863 [2024-11-27 02:16:43.251989] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.863 [2024-11-27 02:16:43.252151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.429 02:16:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.429 02:16:44 -- common/autotest_common.sh@862 -- # return 0 00:05:19.429 02:16:44 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:19.429 02:16:44 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:19.429 02:16:44 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:22.715 nvme0n1 00:05:22.715 02:16:47 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:22.974 [2024-11-27 02:16:47.384572] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:22.974 [2024-11-27 02:16:47.384624] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:22.974 request: 00:05:22.974 { 00:05:22.974 "nvme_ctrlr_name": "nvme0", 00:05:22.974 "password": "test", 00:05:22.974 "method": "bdev_nvme_opal_revert", 00:05:22.974 "req_id": 1 00:05:22.974 } 00:05:22.974 Got JSON-RPC error response 00:05:22.974 response: 00:05:22.974 { 00:05:22.974 "code": -32603, 00:05:22.974 "message": "Internal error" 00:05:22.974 } 00:05:22.974 02:16:47 -- common/autotest_common.sh@1599 -- # true 00:05:22.974 02:16:47 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:22.974 02:16:47 -- common/autotest_common.sh@1603 -- # killprocess 1942477 00:05:22.974 02:16:47 -- common/autotest_common.sh@936 -- # '[' -z 1942477 ']' 00:05:22.974 02:16:47 -- common/autotest_common.sh@940 -- # kill -0 1942477 00:05:22.974 02:16:47 -- common/autotest_common.sh@941 -- # uname 00:05:22.974 02:16:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:22.974 02:16:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1942477 00:05:22.974 02:16:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:22.974 02:16:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:22.974 02:16:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1942477' 00:05:22.974 killing process with pid 1942477 00:05:22.974 02:16:47 -- common/autotest_common.sh@955 -- # kill 1942477 00:05:22.974 02:16:47 -- common/autotest_common.sh@960 -- # wait 1942477 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.974 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:22.975 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:24.938 02:16:49 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:24.938 02:16:49 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:24.938 02:16:49 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:24.938 02:16:49 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:24.938 02:16:49 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:24.938 02:16:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:24.938 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.938 02:16:49 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:24.938 02:16:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.938 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.938 ************************************ 00:05:24.938 START TEST env 00:05:24.938 ************************************ 00:05:24.938 02:16:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:24.938 * Looking for test storage... 00:05:24.938 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:24.938 02:16:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:24.938 02:16:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:24.938 02:16:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:24.938 02:16:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:24.938 02:16:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:24.938 02:16:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:24.938 02:16:49 -- scripts/common.sh@335 -- # IFS=.-: 00:05:24.938 02:16:49 -- scripts/common.sh@335 -- # read -ra ver1 00:05:24.938 02:16:49 -- scripts/common.sh@336 -- # IFS=.-: 00:05:24.938 02:16:49 -- scripts/common.sh@336 -- # read -ra ver2 00:05:24.938 02:16:49 -- scripts/common.sh@337 -- # local 'op=<' 00:05:24.938 02:16:49 -- scripts/common.sh@339 -- # ver1_l=2 00:05:24.938 02:16:49 -- scripts/common.sh@340 -- # ver2_l=1 00:05:24.938 02:16:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:24.938 02:16:49 -- scripts/common.sh@343 -- # case "$op" in 00:05:24.938 02:16:49 -- scripts/common.sh@344 -- # : 1 00:05:24.938 02:16:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:24.938 02:16:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:24.938 02:16:49 -- scripts/common.sh@364 -- # decimal 1 00:05:24.938 02:16:49 -- scripts/common.sh@352 -- # local d=1 00:05:24.938 02:16:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:24.938 02:16:49 -- scripts/common.sh@354 -- # echo 1 00:05:24.938 02:16:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:24.938 02:16:49 -- scripts/common.sh@365 -- # decimal 2 00:05:24.938 02:16:49 -- scripts/common.sh@352 -- # local d=2 00:05:24.938 02:16:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:24.938 02:16:49 -- scripts/common.sh@354 -- # echo 2 00:05:24.938 02:16:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:24.938 02:16:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:24.938 02:16:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:24.938 02:16:49 -- scripts/common.sh@367 -- # return 0 00:05:24.938 02:16:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:24.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.938 --rc genhtml_branch_coverage=1 00:05:24.938 --rc genhtml_function_coverage=1 00:05:24.938 --rc genhtml_legend=1 00:05:24.938 --rc geninfo_all_blocks=1 00:05:24.938 --rc geninfo_unexecuted_blocks=1 00:05:24.938 00:05:24.938 ' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:24.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.938 --rc genhtml_branch_coverage=1 00:05:24.938 --rc genhtml_function_coverage=1 00:05:24.938 --rc genhtml_legend=1 00:05:24.938 --rc geninfo_all_blocks=1 00:05:24.938 --rc geninfo_unexecuted_blocks=1 00:05:24.938 00:05:24.938 ' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:24.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.938 --rc genhtml_branch_coverage=1 00:05:24.938 --rc genhtml_function_coverage=1 00:05:24.938 --rc genhtml_legend=1 00:05:24.938 --rc geninfo_all_blocks=1 00:05:24.938 --rc geninfo_unexecuted_blocks=1 00:05:24.938 00:05:24.938 ' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:24.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.938 --rc genhtml_branch_coverage=1 00:05:24.938 --rc genhtml_function_coverage=1 00:05:24.938 --rc genhtml_legend=1 00:05:24.938 --rc geninfo_all_blocks=1 00:05:24.938 --rc geninfo_unexecuted_blocks=1 00:05:24.938 00:05:24.938 ' 00:05:24.938 02:16:49 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:24.938 02:16:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.938 02:16:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.938 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.938 ************************************ 00:05:24.938 START TEST env_memory 00:05:24.938 ************************************ 00:05:24.938 02:16:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:24.938 00:05:24.938 00:05:24.938 CUnit - A unit testing framework for C - Version 2.1-3 00:05:24.938 http://cunit.sourceforge.net/ 00:05:24.938 00:05:24.938 00:05:24.938 Suite: memory 00:05:24.939 Test: alloc and free memory map ...[2024-11-27 02:16:49.430231] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:24.939 passed 00:05:24.939 Test: mem map translation ...[2024-11-27 02:16:49.450230] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:24.939 [2024-11-27 02:16:49.450253] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:24.939 [2024-11-27 02:16:49.450301] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:24.939 [2024-11-27 02:16:49.450313] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:24.939 passed 00:05:24.939 Test: mem map registration ...[2024-11-27 02:16:49.490962] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:24.939 [2024-11-27 02:16:49.490986] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:24.939 passed 00:05:24.939 Test: mem map adjacent registrations ...passed 00:05:24.939 00:05:24.939 Run Summary: Type Total Ran Passed Failed Inactive 00:05:24.939 suites 1 1 n/a 0 0 00:05:24.939 tests 4 4 4 0 0 00:05:24.939 asserts 152 152 152 0 n/a 00:05:24.939 00:05:24.939 Elapsed time = 0.144 seconds 00:05:24.939 00:05:24.939 real 0m0.152s 00:05:24.939 user 0m0.143s 00:05:24.939 sys 0m0.008s 00:05:24.939 02:16:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.939 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:24.939 ************************************ 00:05:24.939 END TEST env_memory 00:05:24.939 ************************************ 00:05:24.939 02:16:49 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:24.939 02:16:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.939 02:16:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.198 02:16:49 -- common/autotest_common.sh@10 -- # set +x 00:05:25.198 ************************************ 00:05:25.198 START TEST env_vtophys 00:05:25.198 ************************************ 00:05:25.198 02:16:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:25.198 EAL: lib.eal log level changed from notice to debug 00:05:25.198 EAL: Detected lcore 0 as core 0 on socket 0 00:05:25.198 EAL: Detected lcore 1 as core 1 on socket 0 00:05:25.198 EAL: Detected lcore 2 as core 2 on socket 0 00:05:25.198 EAL: Detected lcore 3 as core 3 on socket 0 00:05:25.198 EAL: Detected lcore 4 as core 4 on socket 0 00:05:25.198 EAL: Detected lcore 5 as core 5 on socket 0 00:05:25.198 EAL: Detected lcore 6 as core 8 on socket 0 00:05:25.198 EAL: Detected lcore 7 as core 9 on socket 0 00:05:25.198 EAL: Detected lcore 8 as core 10 on socket 0 00:05:25.198 EAL: Detected lcore 9 as core 11 on socket 0 00:05:25.198 EAL: Detected lcore 10 as core 12 on socket 0 00:05:25.198 EAL: Detected lcore 11 as core 13 on socket 0 00:05:25.198 EAL: Detected lcore 12 as core 0 on socket 1 00:05:25.198 EAL: Detected lcore 13 as core 1 on socket 1 00:05:25.198 EAL: Detected lcore 14 as core 2 on socket 1 00:05:25.198 EAL: Detected lcore 15 as core 3 on socket 1 00:05:25.198 EAL: Detected lcore 16 as core 4 on socket 1 00:05:25.198 EAL: Detected lcore 17 as core 5 on socket 1 00:05:25.198 EAL: Detected lcore 18 as core 8 on socket 1 00:05:25.198 EAL: Detected lcore 19 as core 9 on socket 1 00:05:25.198 EAL: Detected lcore 20 as core 10 on socket 1 00:05:25.198 EAL: Detected lcore 21 as core 11 on socket 1 00:05:25.198 EAL: Detected lcore 22 as core 12 on socket 1 00:05:25.198 EAL: Detected lcore 23 as core 13 on socket 1 00:05:25.198 EAL: Detected lcore 24 as core 0 on socket 0 00:05:25.198 EAL: Detected lcore 25 as core 1 on socket 0 00:05:25.198 EAL: Detected lcore 26 as core 2 on socket 0 00:05:25.198 EAL: Detected lcore 27 as core 3 on socket 0 00:05:25.198 EAL: Detected lcore 28 as core 4 on socket 0 00:05:25.198 EAL: Detected lcore 29 as core 5 on socket 0 00:05:25.198 EAL: Detected lcore 30 as core 8 on socket 0 00:05:25.198 EAL: Detected lcore 31 as core 9 on socket 0 00:05:25.198 EAL: Detected lcore 32 as core 10 on socket 0 00:05:25.198 EAL: Detected lcore 33 as core 11 on socket 0 00:05:25.198 EAL: Detected lcore 34 as core 12 on socket 0 00:05:25.198 EAL: Detected lcore 35 as core 13 on socket 0 00:05:25.198 EAL: Detected lcore 36 as core 0 on socket 1 00:05:25.198 EAL: Detected lcore 37 as core 1 on socket 1 00:05:25.198 EAL: Detected lcore 38 as core 2 on socket 1 00:05:25.198 EAL: Detected lcore 39 as core 3 on socket 1 00:05:25.198 EAL: Detected lcore 40 as core 4 on socket 1 00:05:25.198 EAL: Detected lcore 41 as core 5 on socket 1 00:05:25.198 EAL: Detected lcore 42 as core 8 on socket 1 00:05:25.198 EAL: Detected lcore 43 as core 9 on socket 1 00:05:25.198 EAL: Detected lcore 44 as core 10 on socket 1 00:05:25.198 EAL: Detected lcore 45 as core 11 on socket 1 00:05:25.198 EAL: Detected lcore 46 as core 12 on socket 1 00:05:25.198 EAL: Detected lcore 47 as core 13 on socket 1 00:05:25.198 EAL: Maximum logical cores by configuration: 128 00:05:25.198 EAL: Detected CPU lcores: 48 00:05:25.198 EAL: Detected NUMA nodes: 2 00:05:25.198 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:25.198 EAL: Detected shared linkage of DPDK 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:25.198 EAL: Registered [vdev] bus. 00:05:25.198 EAL: bus.vdev log level changed from disabled to notice 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:25.198 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:25.198 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:25.198 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:25.198 EAL: No shared files mode enabled, IPC will be disabled 00:05:25.198 EAL: No shared files mode enabled, IPC is disabled 00:05:25.198 EAL: Bus pci wants IOVA as 'DC' 00:05:25.198 EAL: Bus vdev wants IOVA as 'DC' 00:05:25.198 EAL: Buses did not request a specific IOVA mode. 00:05:25.198 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:25.198 EAL: Selected IOVA mode 'VA' 00:05:25.198 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.198 EAL: Probing VFIO support... 00:05:25.198 EAL: IOMMU type 1 (Type 1) is supported 00:05:25.198 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:25.198 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:25.198 EAL: VFIO support initialized 00:05:25.198 EAL: Ask a virtual area of 0x2e000 bytes 00:05:25.198 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:25.198 EAL: Setting up physically contiguous memory... 00:05:25.198 EAL: Setting maximum number of open files to 524288 00:05:25.198 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:25.198 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:25.198 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:25.198 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:25.198 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.198 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:25.198 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:25.198 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.198 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:25.198 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:25.199 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.199 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:25.199 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:25.199 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.199 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:25.199 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:25.199 EAL: Ask a virtual area of 0x61000 bytes 00:05:25.199 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:25.199 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:25.199 EAL: Ask a virtual area of 0x400000000 bytes 00:05:25.199 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:25.199 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:25.199 EAL: Hugepages will be freed exactly as allocated. 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: TSC frequency is ~2700000 KHz 00:05:25.199 EAL: Main lcore 0 is ready (tid=7f1398028a00;cpuset=[0]) 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 0 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 2MB 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:25.199 EAL: Mem event callback 'spdk:(nil)' registered 00:05:25.199 00:05:25.199 00:05:25.199 CUnit - A unit testing framework for C - Version 2.1-3 00:05:25.199 http://cunit.sourceforge.net/ 00:05:25.199 00:05:25.199 00:05:25.199 Suite: components_suite 00:05:25.199 Test: vtophys_malloc_test ...passed 00:05:25.199 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 4MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 4MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 6MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 6MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 10MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 10MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 18MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 18MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 34MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 34MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 66MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 66MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.199 EAL: Restoring previous memory policy: 4 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was expanded by 130MB 00:05:25.199 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.199 EAL: request: mp_malloc_sync 00:05:25.199 EAL: No shared files mode enabled, IPC is disabled 00:05:25.199 EAL: Heap on socket 0 was shrunk by 130MB 00:05:25.199 EAL: Trying to obtain current memory policy. 00:05:25.199 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.458 EAL: Restoring previous memory policy: 4 00:05:25.458 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.458 EAL: request: mp_malloc_sync 00:05:25.458 EAL: No shared files mode enabled, IPC is disabled 00:05:25.458 EAL: Heap on socket 0 was expanded by 258MB 00:05:25.458 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.458 EAL: request: mp_malloc_sync 00:05:25.458 EAL: No shared files mode enabled, IPC is disabled 00:05:25.458 EAL: Heap on socket 0 was shrunk by 258MB 00:05:25.458 EAL: Trying to obtain current memory policy. 00:05:25.458 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:25.715 EAL: Restoring previous memory policy: 4 00:05:25.715 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.715 EAL: request: mp_malloc_sync 00:05:25.716 EAL: No shared files mode enabled, IPC is disabled 00:05:25.716 EAL: Heap on socket 0 was expanded by 514MB 00:05:25.716 EAL: Calling mem event callback 'spdk:(nil)' 00:05:25.716 EAL: request: mp_malloc_sync 00:05:25.716 EAL: No shared files mode enabled, IPC is disabled 00:05:25.716 EAL: Heap on socket 0 was shrunk by 514MB 00:05:25.716 EAL: Trying to obtain current memory policy. 00:05:25.716 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:26.281 EAL: Restoring previous memory policy: 4 00:05:26.281 EAL: Calling mem event callback 'spdk:(nil)' 00:05:26.281 EAL: request: mp_malloc_sync 00:05:26.281 EAL: No shared files mode enabled, IPC is disabled 00:05:26.281 EAL: Heap on socket 0 was expanded by 1026MB 00:05:26.281 EAL: Calling mem event callback 'spdk:(nil)' 00:05:26.539 EAL: request: mp_malloc_sync 00:05:26.539 EAL: No shared files mode enabled, IPC is disabled 00:05:26.539 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:26.539 passed 00:05:26.539 00:05:26.539 Run Summary: Type Total Ran Passed Failed Inactive 00:05:26.539 suites 1 1 n/a 0 0 00:05:26.539 tests 2 2 2 0 0 00:05:26.539 asserts 497 497 497 0 n/a 00:05:26.539 00:05:26.539 Elapsed time = 1.374 seconds 00:05:26.539 EAL: Calling mem event callback 'spdk:(nil)' 00:05:26.539 EAL: request: mp_malloc_sync 00:05:26.539 EAL: No shared files mode enabled, IPC is disabled 00:05:26.539 EAL: Heap on socket 0 was shrunk by 2MB 00:05:26.539 EAL: No shared files mode enabled, IPC is disabled 00:05:26.539 EAL: No shared files mode enabled, IPC is disabled 00:05:26.539 EAL: No shared files mode enabled, IPC is disabled 00:05:26.539 00:05:26.539 real 0m1.489s 00:05:26.539 user 0m0.849s 00:05:26.539 sys 0m0.610s 00:05:26.539 02:16:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.539 02:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.539 ************************************ 00:05:26.539 END TEST env_vtophys 00:05:26.539 ************************************ 00:05:26.539 02:16:51 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:26.539 02:16:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.539 02:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.539 02:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.539 ************************************ 00:05:26.539 START TEST env_pci 00:05:26.539 ************************************ 00:05:26.539 02:16:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:26.539 00:05:26.539 00:05:26.539 CUnit - A unit testing framework for C - Version 2.1-3 00:05:26.539 http://cunit.sourceforge.net/ 00:05:26.539 00:05:26.539 00:05:26.539 Suite: pci 00:05:26.539 Test: pci_hook ...[2024-11-27 02:16:51.103049] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1943525 has claimed it 00:05:26.539 EAL: Cannot find device (10000:00:01.0) 00:05:26.539 EAL: Failed to attach device on primary process 00:05:26.539 passed 00:05:26.539 00:05:26.539 Run Summary: Type Total Ran Passed Failed Inactive 00:05:26.539 suites 1 1 n/a 0 0 00:05:26.539 tests 1 1 1 0 0 00:05:26.539 asserts 25 25 25 0 n/a 00:05:26.539 00:05:26.539 Elapsed time = 0.021 seconds 00:05:26.539 00:05:26.539 real 0m0.034s 00:05:26.539 user 0m0.007s 00:05:26.539 sys 0m0.026s 00:05:26.539 02:16:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.539 02:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.539 ************************************ 00:05:26.539 END TEST env_pci 00:05:26.539 ************************************ 00:05:26.539 02:16:51 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:26.539 02:16:51 -- env/env.sh@15 -- # uname 00:05:26.539 02:16:51 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:26.539 02:16:51 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:26.539 02:16:51 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:26.539 02:16:51 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:26.539 02:16:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.539 02:16:51 -- common/autotest_common.sh@10 -- # set +x 00:05:26.539 ************************************ 00:05:26.539 START TEST env_dpdk_post_init 00:05:26.539 ************************************ 00:05:26.539 02:16:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:26.798 EAL: Detected CPU lcores: 48 00:05:26.798 EAL: Detected NUMA nodes: 2 00:05:26.798 EAL: Detected shared linkage of DPDK 00:05:26.798 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:26.798 EAL: Selected IOVA mode 'VA' 00:05:26.798 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.798 EAL: VFIO support initialized 00:05:26.798 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:26.798 EAL: Using IOMMU type 1 (Type 1) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:26.798 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:27.056 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:27.056 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:27.056 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:27.623 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:31.021 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:31.021 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:31.021 Starting DPDK initialization... 00:05:31.021 Starting SPDK post initialization... 00:05:31.021 SPDK NVMe probe 00:05:31.021 Attaching to 0000:88:00.0 00:05:31.021 Attached to 0000:88:00.0 00:05:31.021 Cleaning up... 00:05:31.021 00:05:31.021 real 0m4.383s 00:05:31.021 user 0m3.254s 00:05:31.021 sys 0m0.185s 00:05:31.021 02:16:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.021 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.021 ************************************ 00:05:31.021 END TEST env_dpdk_post_init 00:05:31.021 ************************************ 00:05:31.021 02:16:55 -- env/env.sh@26 -- # uname 00:05:31.021 02:16:55 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:31.021 02:16:55 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:31.021 02:16:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.021 02:16:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.021 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.021 ************************************ 00:05:31.021 START TEST env_mem_callbacks 00:05:31.021 ************************************ 00:05:31.021 02:16:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:31.021 EAL: Detected CPU lcores: 48 00:05:31.021 EAL: Detected NUMA nodes: 2 00:05:31.021 EAL: Detected shared linkage of DPDK 00:05:31.021 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:31.021 EAL: Selected IOVA mode 'VA' 00:05:31.021 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.021 EAL: VFIO support initialized 00:05:31.021 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:31.021 00:05:31.021 00:05:31.021 CUnit - A unit testing framework for C - Version 2.1-3 00:05:31.021 http://cunit.sourceforge.net/ 00:05:31.021 00:05:31.021 00:05:31.021 Suite: memory 00:05:31.021 Test: test ... 00:05:31.021 register 0x200000200000 2097152 00:05:31.021 malloc 3145728 00:05:31.021 register 0x200000400000 4194304 00:05:31.021 buf 0x200000500000 len 3145728 PASSED 00:05:31.021 malloc 64 00:05:31.021 buf 0x2000004fff40 len 64 PASSED 00:05:31.021 malloc 4194304 00:05:31.021 register 0x200000800000 6291456 00:05:31.021 buf 0x200000a00000 len 4194304 PASSED 00:05:31.021 free 0x200000500000 3145728 00:05:31.021 free 0x2000004fff40 64 00:05:31.021 unregister 0x200000400000 4194304 PASSED 00:05:31.021 free 0x200000a00000 4194304 00:05:31.021 unregister 0x200000800000 6291456 PASSED 00:05:31.021 malloc 8388608 00:05:31.021 register 0x200000400000 10485760 00:05:31.021 buf 0x200000600000 len 8388608 PASSED 00:05:31.021 free 0x200000600000 8388608 00:05:31.021 unregister 0x200000400000 10485760 PASSED 00:05:31.021 passed 00:05:31.021 00:05:31.021 Run Summary: Type Total Ran Passed Failed Inactive 00:05:31.021 suites 1 1 n/a 0 0 00:05:31.021 tests 1 1 1 0 0 00:05:31.021 asserts 15 15 15 0 n/a 00:05:31.021 00:05:31.021 Elapsed time = 0.005 seconds 00:05:31.021 00:05:31.021 real 0m0.049s 00:05:31.021 user 0m0.010s 00:05:31.021 sys 0m0.038s 00:05:31.021 02:16:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.021 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.021 ************************************ 00:05:31.021 END TEST env_mem_callbacks 00:05:31.021 ************************************ 00:05:31.021 00:05:31.021 real 0m6.385s 00:05:31.021 user 0m4.401s 00:05:31.021 sys 0m1.036s 00:05:31.021 02:16:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.021 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.021 ************************************ 00:05:31.021 END TEST env 00:05:31.021 ************************************ 00:05:31.278 02:16:55 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:31.278 02:16:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.278 02:16:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.278 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.278 ************************************ 00:05:31.278 START TEST rpc 00:05:31.278 ************************************ 00:05:31.278 02:16:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:31.278 * Looking for test storage... 00:05:31.278 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:31.278 02:16:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:31.278 02:16:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:31.278 02:16:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:31.279 02:16:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:31.279 02:16:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:31.279 02:16:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:31.279 02:16:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:31.279 02:16:55 -- scripts/common.sh@335 -- # IFS=.-: 00:05:31.279 02:16:55 -- scripts/common.sh@335 -- # read -ra ver1 00:05:31.279 02:16:55 -- scripts/common.sh@336 -- # IFS=.-: 00:05:31.279 02:16:55 -- scripts/common.sh@336 -- # read -ra ver2 00:05:31.279 02:16:55 -- scripts/common.sh@337 -- # local 'op=<' 00:05:31.279 02:16:55 -- scripts/common.sh@339 -- # ver1_l=2 00:05:31.279 02:16:55 -- scripts/common.sh@340 -- # ver2_l=1 00:05:31.279 02:16:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:31.279 02:16:55 -- scripts/common.sh@343 -- # case "$op" in 00:05:31.279 02:16:55 -- scripts/common.sh@344 -- # : 1 00:05:31.279 02:16:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:31.279 02:16:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:31.279 02:16:55 -- scripts/common.sh@364 -- # decimal 1 00:05:31.279 02:16:55 -- scripts/common.sh@352 -- # local d=1 00:05:31.279 02:16:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:31.279 02:16:55 -- scripts/common.sh@354 -- # echo 1 00:05:31.279 02:16:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:31.279 02:16:55 -- scripts/common.sh@365 -- # decimal 2 00:05:31.279 02:16:55 -- scripts/common.sh@352 -- # local d=2 00:05:31.279 02:16:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:31.279 02:16:55 -- scripts/common.sh@354 -- # echo 2 00:05:31.279 02:16:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:31.279 02:16:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:31.279 02:16:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:31.279 02:16:55 -- scripts/common.sh@367 -- # return 0 00:05:31.279 02:16:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:31.279 02:16:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:31.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.279 --rc genhtml_branch_coverage=1 00:05:31.279 --rc genhtml_function_coverage=1 00:05:31.279 --rc genhtml_legend=1 00:05:31.279 --rc geninfo_all_blocks=1 00:05:31.279 --rc geninfo_unexecuted_blocks=1 00:05:31.279 00:05:31.279 ' 00:05:31.279 02:16:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:31.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.279 --rc genhtml_branch_coverage=1 00:05:31.279 --rc genhtml_function_coverage=1 00:05:31.279 --rc genhtml_legend=1 00:05:31.279 --rc geninfo_all_blocks=1 00:05:31.279 --rc geninfo_unexecuted_blocks=1 00:05:31.279 00:05:31.279 ' 00:05:31.279 02:16:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:31.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.279 --rc genhtml_branch_coverage=1 00:05:31.279 --rc genhtml_function_coverage=1 00:05:31.279 --rc genhtml_legend=1 00:05:31.279 --rc geninfo_all_blocks=1 00:05:31.279 --rc geninfo_unexecuted_blocks=1 00:05:31.279 00:05:31.279 ' 00:05:31.279 02:16:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:31.279 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.279 --rc genhtml_branch_coverage=1 00:05:31.279 --rc genhtml_function_coverage=1 00:05:31.279 --rc genhtml_legend=1 00:05:31.279 --rc geninfo_all_blocks=1 00:05:31.279 --rc geninfo_unexecuted_blocks=1 00:05:31.279 00:05:31.279 ' 00:05:31.279 02:16:55 -- rpc/rpc.sh@65 -- # spdk_pid=1944201 00:05:31.279 02:16:55 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:31.279 02:16:55 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:31.279 02:16:55 -- rpc/rpc.sh@67 -- # waitforlisten 1944201 00:05:31.279 02:16:55 -- common/autotest_common.sh@829 -- # '[' -z 1944201 ']' 00:05:31.279 02:16:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:31.279 02:16:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.279 02:16:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:31.279 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:31.279 02:16:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.279 02:16:55 -- common/autotest_common.sh@10 -- # set +x 00:05:31.279 [2024-11-27 02:16:55.849632] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:31.279 [2024-11-27 02:16:55.849720] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1944201 ] 00:05:31.279 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.279 [2024-11-27 02:16:55.911637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.536 [2024-11-27 02:16:56.005215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.536 [2024-11-27 02:16:56.005395] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:31.536 [2024-11-27 02:16:56.005416] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1944201' to capture a snapshot of events at runtime. 00:05:31.536 [2024-11-27 02:16:56.005431] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1944201 for offline analysis/debug. 00:05:31.536 [2024-11-27 02:16:56.005476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.470 02:16:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.470 02:16:56 -- common/autotest_common.sh@862 -- # return 0 00:05:32.470 02:16:56 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:32.470 02:16:56 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:32.470 02:16:56 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:32.470 02:16:56 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:32.470 02:16:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.470 02:16:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 ************************************ 00:05:32.470 START TEST rpc_integrity 00:05:32.470 ************************************ 00:05:32.470 02:16:56 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:32.470 02:16:56 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:32.470 02:16:56 -- rpc/rpc.sh@13 -- # jq length 00:05:32.470 02:16:56 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:32.470 02:16:56 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:32.470 02:16:56 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:32.470 { 00:05:32.470 "name": "Malloc0", 00:05:32.470 "aliases": [ 00:05:32.470 "96d45f33-056b-4c3b-bb39-84e69838ea06" 00:05:32.470 ], 00:05:32.470 "product_name": "Malloc disk", 00:05:32.470 "block_size": 512, 00:05:32.470 "num_blocks": 16384, 00:05:32.470 "uuid": "96d45f33-056b-4c3b-bb39-84e69838ea06", 00:05:32.470 "assigned_rate_limits": { 00:05:32.470 "rw_ios_per_sec": 0, 00:05:32.470 "rw_mbytes_per_sec": 0, 00:05:32.470 "r_mbytes_per_sec": 0, 00:05:32.470 "w_mbytes_per_sec": 0 00:05:32.470 }, 00:05:32.470 "claimed": false, 00:05:32.470 "zoned": false, 00:05:32.470 "supported_io_types": { 00:05:32.470 "read": true, 00:05:32.470 "write": true, 00:05:32.470 "unmap": true, 00:05:32.470 "write_zeroes": true, 00:05:32.470 "flush": true, 00:05:32.470 "reset": true, 00:05:32.470 "compare": false, 00:05:32.470 "compare_and_write": false, 00:05:32.470 "abort": true, 00:05:32.470 "nvme_admin": false, 00:05:32.470 "nvme_io": false 00:05:32.470 }, 00:05:32.470 "memory_domains": [ 00:05:32.470 { 00:05:32.470 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.470 "dma_device_type": 2 00:05:32.470 } 00:05:32.470 ], 00:05:32.470 "driver_specific": {} 00:05:32.470 } 00:05:32.470 ]' 00:05:32.470 02:16:56 -- rpc/rpc.sh@17 -- # jq length 00:05:32.470 02:16:56 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:32.470 02:16:56 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 [2024-11-27 02:16:56.935168] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:32.470 [2024-11-27 02:16:56.935221] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:32.470 [2024-11-27 02:16:56.935246] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1d08b20 00:05:32.470 [2024-11-27 02:16:56.935262] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:32.470 [2024-11-27 02:16:56.936726] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:32.470 [2024-11-27 02:16:56.936752] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:32.470 Passthru0 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:32.470 { 00:05:32.470 "name": "Malloc0", 00:05:32.470 "aliases": [ 00:05:32.470 "96d45f33-056b-4c3b-bb39-84e69838ea06" 00:05:32.470 ], 00:05:32.470 "product_name": "Malloc disk", 00:05:32.470 "block_size": 512, 00:05:32.470 "num_blocks": 16384, 00:05:32.470 "uuid": "96d45f33-056b-4c3b-bb39-84e69838ea06", 00:05:32.470 "assigned_rate_limits": { 00:05:32.470 "rw_ios_per_sec": 0, 00:05:32.470 "rw_mbytes_per_sec": 0, 00:05:32.470 "r_mbytes_per_sec": 0, 00:05:32.470 "w_mbytes_per_sec": 0 00:05:32.470 }, 00:05:32.470 "claimed": true, 00:05:32.470 "claim_type": "exclusive_write", 00:05:32.470 "zoned": false, 00:05:32.470 "supported_io_types": { 00:05:32.470 "read": true, 00:05:32.470 "write": true, 00:05:32.470 "unmap": true, 00:05:32.470 "write_zeroes": true, 00:05:32.470 "flush": true, 00:05:32.470 "reset": true, 00:05:32.470 "compare": false, 00:05:32.470 "compare_and_write": false, 00:05:32.470 "abort": true, 00:05:32.470 "nvme_admin": false, 00:05:32.470 "nvme_io": false 00:05:32.470 }, 00:05:32.470 "memory_domains": [ 00:05:32.470 { 00:05:32.470 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.470 "dma_device_type": 2 00:05:32.470 } 00:05:32.470 ], 00:05:32.470 "driver_specific": {} 00:05:32.470 }, 00:05:32.470 { 00:05:32.470 "name": "Passthru0", 00:05:32.470 "aliases": [ 00:05:32.470 "42f8594a-16ea-58c5-aa40-60b3528fb31b" 00:05:32.470 ], 00:05:32.470 "product_name": "passthru", 00:05:32.470 "block_size": 512, 00:05:32.470 "num_blocks": 16384, 00:05:32.470 "uuid": "42f8594a-16ea-58c5-aa40-60b3528fb31b", 00:05:32.470 "assigned_rate_limits": { 00:05:32.470 "rw_ios_per_sec": 0, 00:05:32.470 "rw_mbytes_per_sec": 0, 00:05:32.470 "r_mbytes_per_sec": 0, 00:05:32.470 "w_mbytes_per_sec": 0 00:05:32.470 }, 00:05:32.470 "claimed": false, 00:05:32.470 "zoned": false, 00:05:32.470 "supported_io_types": { 00:05:32.470 "read": true, 00:05:32.470 "write": true, 00:05:32.470 "unmap": true, 00:05:32.470 "write_zeroes": true, 00:05:32.470 "flush": true, 00:05:32.470 "reset": true, 00:05:32.470 "compare": false, 00:05:32.470 "compare_and_write": false, 00:05:32.470 "abort": true, 00:05:32.470 "nvme_admin": false, 00:05:32.470 "nvme_io": false 00:05:32.470 }, 00:05:32.470 "memory_domains": [ 00:05:32.470 { 00:05:32.470 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.470 "dma_device_type": 2 00:05:32.470 } 00:05:32.470 ], 00:05:32.470 "driver_specific": { 00:05:32.470 "passthru": { 00:05:32.470 "name": "Passthru0", 00:05:32.470 "base_bdev_name": "Malloc0" 00:05:32.470 } 00:05:32.470 } 00:05:32.470 } 00:05:32.470 ]' 00:05:32.470 02:16:56 -- rpc/rpc.sh@21 -- # jq length 00:05:32.470 02:16:56 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:32.470 02:16:56 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:56 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:32.470 02:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:56 -- common/autotest_common.sh@10 -- # set +x 00:05:32.470 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.470 02:16:57 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:32.470 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.470 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.471 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.471 02:16:57 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:32.471 02:16:57 -- rpc/rpc.sh@26 -- # jq length 00:05:32.471 02:16:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:32.471 00:05:32.471 real 0m0.219s 00:05:32.471 user 0m0.146s 00:05:32.471 sys 0m0.018s 00:05:32.471 02:16:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.471 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.471 ************************************ 00:05:32.471 END TEST rpc_integrity 00:05:32.471 ************************************ 00:05:32.471 02:16:57 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:32.471 02:16:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.471 02:16:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.471 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.471 ************************************ 00:05:32.471 START TEST rpc_plugins 00:05:32.471 ************************************ 00:05:32.471 02:16:57 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:32.471 02:16:57 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:32.471 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.471 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.471 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.471 02:16:57 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:32.471 02:16:57 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:32.471 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.471 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.471 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.471 02:16:57 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:32.471 { 00:05:32.471 "name": "Malloc1", 00:05:32.471 "aliases": [ 00:05:32.471 "20e94a83-5e6d-45c4-be16-035f1710974e" 00:05:32.471 ], 00:05:32.471 "product_name": "Malloc disk", 00:05:32.471 "block_size": 4096, 00:05:32.471 "num_blocks": 256, 00:05:32.471 "uuid": "20e94a83-5e6d-45c4-be16-035f1710974e", 00:05:32.471 "assigned_rate_limits": { 00:05:32.471 "rw_ios_per_sec": 0, 00:05:32.471 "rw_mbytes_per_sec": 0, 00:05:32.471 "r_mbytes_per_sec": 0, 00:05:32.471 "w_mbytes_per_sec": 0 00:05:32.471 }, 00:05:32.471 "claimed": false, 00:05:32.471 "zoned": false, 00:05:32.471 "supported_io_types": { 00:05:32.471 "read": true, 00:05:32.471 "write": true, 00:05:32.471 "unmap": true, 00:05:32.471 "write_zeroes": true, 00:05:32.471 "flush": true, 00:05:32.471 "reset": true, 00:05:32.471 "compare": false, 00:05:32.471 "compare_and_write": false, 00:05:32.471 "abort": true, 00:05:32.471 "nvme_admin": false, 00:05:32.471 "nvme_io": false 00:05:32.471 }, 00:05:32.471 "memory_domains": [ 00:05:32.471 { 00:05:32.471 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.471 "dma_device_type": 2 00:05:32.471 } 00:05:32.471 ], 00:05:32.471 "driver_specific": {} 00:05:32.471 } 00:05:32.471 ]' 00:05:32.471 02:16:57 -- rpc/rpc.sh@32 -- # jq length 00:05:32.729 02:16:57 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:32.729 02:16:57 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:32.729 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.729 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.729 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.729 02:16:57 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:32.729 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.729 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.729 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.729 02:16:57 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:32.729 02:16:57 -- rpc/rpc.sh@36 -- # jq length 00:05:32.729 02:16:57 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:32.729 00:05:32.729 real 0m0.112s 00:05:32.729 user 0m0.079s 00:05:32.729 sys 0m0.005s 00:05:32.729 02:16:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.729 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.729 ************************************ 00:05:32.729 END TEST rpc_plugins 00:05:32.729 ************************************ 00:05:32.729 02:16:57 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:32.729 02:16:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.729 02:16:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.729 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.729 ************************************ 00:05:32.729 START TEST rpc_trace_cmd_test 00:05:32.729 ************************************ 00:05:32.729 02:16:57 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:32.729 02:16:57 -- rpc/rpc.sh@40 -- # local info 00:05:32.729 02:16:57 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:32.729 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.729 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.729 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.729 02:16:57 -- rpc/rpc.sh@42 -- # info='{ 00:05:32.729 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1944201", 00:05:32.729 "tpoint_group_mask": "0x8", 00:05:32.729 "iscsi_conn": { 00:05:32.729 "mask": "0x2", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "scsi": { 00:05:32.729 "mask": "0x4", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "bdev": { 00:05:32.729 "mask": "0x8", 00:05:32.729 "tpoint_mask": "0xffffffffffffffff" 00:05:32.729 }, 00:05:32.729 "nvmf_rdma": { 00:05:32.729 "mask": "0x10", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "nvmf_tcp": { 00:05:32.729 "mask": "0x20", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "ftl": { 00:05:32.729 "mask": "0x40", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "blobfs": { 00:05:32.729 "mask": "0x80", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "dsa": { 00:05:32.729 "mask": "0x200", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "thread": { 00:05:32.729 "mask": "0x400", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "nvme_pcie": { 00:05:32.729 "mask": "0x800", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "iaa": { 00:05:32.729 "mask": "0x1000", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "nvme_tcp": { 00:05:32.729 "mask": "0x2000", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 }, 00:05:32.729 "bdev_nvme": { 00:05:32.729 "mask": "0x4000", 00:05:32.729 "tpoint_mask": "0x0" 00:05:32.729 } 00:05:32.729 }' 00:05:32.729 02:16:57 -- rpc/rpc.sh@43 -- # jq length 00:05:32.729 02:16:57 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:32.729 02:16:57 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:32.729 02:16:57 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:32.729 02:16:57 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:32.729 02:16:57 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:32.729 02:16:57 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:32.988 02:16:57 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:32.988 02:16:57 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:32.988 02:16:57 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:32.988 00:05:32.988 real 0m0.198s 00:05:32.988 user 0m0.175s 00:05:32.988 sys 0m0.014s 00:05:32.988 02:16:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 ************************************ 00:05:32.988 END TEST rpc_trace_cmd_test 00:05:32.988 ************************************ 00:05:32.988 02:16:57 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:32.988 02:16:57 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:32.988 02:16:57 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:32.988 02:16:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.988 02:16:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 ************************************ 00:05:32.988 START TEST rpc_daemon_integrity 00:05:32.988 ************************************ 00:05:32.988 02:16:57 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:32.988 02:16:57 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:32.988 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.988 02:16:57 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:32.988 02:16:57 -- rpc/rpc.sh@13 -- # jq length 00:05:32.988 02:16:57 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:32.988 02:16:57 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:32.988 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.988 02:16:57 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:32.988 02:16:57 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:32.988 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.988 02:16:57 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:32.988 { 00:05:32.988 "name": "Malloc2", 00:05:32.988 "aliases": [ 00:05:32.988 "41065def-e54a-4e8c-a266-138ad75907f1" 00:05:32.988 ], 00:05:32.988 "product_name": "Malloc disk", 00:05:32.988 "block_size": 512, 00:05:32.988 "num_blocks": 16384, 00:05:32.988 "uuid": "41065def-e54a-4e8c-a266-138ad75907f1", 00:05:32.988 "assigned_rate_limits": { 00:05:32.988 "rw_ios_per_sec": 0, 00:05:32.988 "rw_mbytes_per_sec": 0, 00:05:32.988 "r_mbytes_per_sec": 0, 00:05:32.988 "w_mbytes_per_sec": 0 00:05:32.988 }, 00:05:32.988 "claimed": false, 00:05:32.988 "zoned": false, 00:05:32.988 "supported_io_types": { 00:05:32.988 "read": true, 00:05:32.988 "write": true, 00:05:32.988 "unmap": true, 00:05:32.988 "write_zeroes": true, 00:05:32.988 "flush": true, 00:05:32.988 "reset": true, 00:05:32.988 "compare": false, 00:05:32.988 "compare_and_write": false, 00:05:32.988 "abort": true, 00:05:32.988 "nvme_admin": false, 00:05:32.988 "nvme_io": false 00:05:32.988 }, 00:05:32.988 "memory_domains": [ 00:05:32.988 { 00:05:32.988 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.988 "dma_device_type": 2 00:05:32.988 } 00:05:32.988 ], 00:05:32.988 "driver_specific": {} 00:05:32.988 } 00:05:32.988 ]' 00:05:32.988 02:16:57 -- rpc/rpc.sh@17 -- # jq length 00:05:32.988 02:16:57 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:32.988 02:16:57 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:32.988 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.988 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.988 [2024-11-27 02:16:57.533538] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:32.988 [2024-11-27 02:16:57.533604] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:32.989 [2024-11-27 02:16:57.533632] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1d07ec0 00:05:32.989 [2024-11-27 02:16:57.533647] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:32.989 [2024-11-27 02:16:57.534977] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:32.989 [2024-11-27 02:16:57.535005] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:32.989 Passthru0 00:05:32.989 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.989 02:16:57 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:32.989 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.989 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.989 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.989 02:16:57 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:32.989 { 00:05:32.989 "name": "Malloc2", 00:05:32.989 "aliases": [ 00:05:32.989 "41065def-e54a-4e8c-a266-138ad75907f1" 00:05:32.989 ], 00:05:32.989 "product_name": "Malloc disk", 00:05:32.989 "block_size": 512, 00:05:32.989 "num_blocks": 16384, 00:05:32.989 "uuid": "41065def-e54a-4e8c-a266-138ad75907f1", 00:05:32.989 "assigned_rate_limits": { 00:05:32.989 "rw_ios_per_sec": 0, 00:05:32.989 "rw_mbytes_per_sec": 0, 00:05:32.989 "r_mbytes_per_sec": 0, 00:05:32.989 "w_mbytes_per_sec": 0 00:05:32.989 }, 00:05:32.989 "claimed": true, 00:05:32.989 "claim_type": "exclusive_write", 00:05:32.989 "zoned": false, 00:05:32.989 "supported_io_types": { 00:05:32.989 "read": true, 00:05:32.989 "write": true, 00:05:32.989 "unmap": true, 00:05:32.989 "write_zeroes": true, 00:05:32.989 "flush": true, 00:05:32.989 "reset": true, 00:05:32.989 "compare": false, 00:05:32.989 "compare_and_write": false, 00:05:32.989 "abort": true, 00:05:32.989 "nvme_admin": false, 00:05:32.989 "nvme_io": false 00:05:32.989 }, 00:05:32.989 "memory_domains": [ 00:05:32.989 { 00:05:32.989 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.989 "dma_device_type": 2 00:05:32.989 } 00:05:32.989 ], 00:05:32.989 "driver_specific": {} 00:05:32.989 }, 00:05:32.989 { 00:05:32.989 "name": "Passthru0", 00:05:32.989 "aliases": [ 00:05:32.989 "0f7aaa63-16c8-5afd-873d-2eb3ee1624b9" 00:05:32.989 ], 00:05:32.989 "product_name": "passthru", 00:05:32.989 "block_size": 512, 00:05:32.989 "num_blocks": 16384, 00:05:32.989 "uuid": "0f7aaa63-16c8-5afd-873d-2eb3ee1624b9", 00:05:32.989 "assigned_rate_limits": { 00:05:32.989 "rw_ios_per_sec": 0, 00:05:32.989 "rw_mbytes_per_sec": 0, 00:05:32.989 "r_mbytes_per_sec": 0, 00:05:32.989 "w_mbytes_per_sec": 0 00:05:32.989 }, 00:05:32.989 "claimed": false, 00:05:32.989 "zoned": false, 00:05:32.989 "supported_io_types": { 00:05:32.989 "read": true, 00:05:32.989 "write": true, 00:05:32.989 "unmap": true, 00:05:32.989 "write_zeroes": true, 00:05:32.989 "flush": true, 00:05:32.989 "reset": true, 00:05:32.989 "compare": false, 00:05:32.989 "compare_and_write": false, 00:05:32.989 "abort": true, 00:05:32.989 "nvme_admin": false, 00:05:32.989 "nvme_io": false 00:05:32.989 }, 00:05:32.989 "memory_domains": [ 00:05:32.989 { 00:05:32.989 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:32.989 "dma_device_type": 2 00:05:32.989 } 00:05:32.989 ], 00:05:32.989 "driver_specific": { 00:05:32.989 "passthru": { 00:05:32.989 "name": "Passthru0", 00:05:32.989 "base_bdev_name": "Malloc2" 00:05:32.989 } 00:05:32.989 } 00:05:32.989 } 00:05:32.989 ]' 00:05:32.989 02:16:57 -- rpc/rpc.sh@21 -- # jq length 00:05:32.989 02:16:57 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:32.989 02:16:57 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:32.989 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.989 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.989 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.989 02:16:57 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:32.989 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.989 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.989 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.989 02:16:57 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:32.989 02:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:32.989 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:32.989 02:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:32.989 02:16:57 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:32.989 02:16:57 -- rpc/rpc.sh@26 -- # jq length 00:05:33.247 02:16:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:33.247 00:05:33.247 real 0m0.215s 00:05:33.247 user 0m0.141s 00:05:33.247 sys 0m0.021s 00:05:33.247 02:16:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.247 02:16:57 -- common/autotest_common.sh@10 -- # set +x 00:05:33.247 ************************************ 00:05:33.247 END TEST rpc_daemon_integrity 00:05:33.247 ************************************ 00:05:33.247 02:16:57 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:33.247 02:16:57 -- rpc/rpc.sh@84 -- # killprocess 1944201 00:05:33.247 02:16:57 -- common/autotest_common.sh@936 -- # '[' -z 1944201 ']' 00:05:33.247 02:16:57 -- common/autotest_common.sh@940 -- # kill -0 1944201 00:05:33.247 02:16:57 -- common/autotest_common.sh@941 -- # uname 00:05:33.247 02:16:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:33.247 02:16:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1944201 00:05:33.247 02:16:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:33.247 02:16:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:33.247 02:16:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1944201' 00:05:33.247 killing process with pid 1944201 00:05:33.247 02:16:57 -- common/autotest_common.sh@955 -- # kill 1944201 00:05:33.247 02:16:57 -- common/autotest_common.sh@960 -- # wait 1944201 00:05:33.506 00:05:33.506 real 0m2.455s 00:05:33.506 user 0m3.121s 00:05:33.506 sys 0m0.590s 00:05:33.506 02:16:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.506 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.506 ************************************ 00:05:33.506 END TEST rpc 00:05:33.506 ************************************ 00:05:33.506 02:16:58 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:33.764 02:16:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.764 02:16:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.764 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.764 ************************************ 00:05:33.764 START TEST rpc_client 00:05:33.764 ************************************ 00:05:33.764 02:16:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:33.764 * Looking for test storage... 00:05:33.764 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:33.764 02:16:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.764 02:16:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.764 02:16:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.764 02:16:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.764 02:16:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.765 02:16:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.765 02:16:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.765 02:16:58 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.765 02:16:58 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.765 02:16:58 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.765 02:16:58 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.765 02:16:58 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.765 02:16:58 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.765 02:16:58 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.765 02:16:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.765 02:16:58 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.765 02:16:58 -- scripts/common.sh@344 -- # : 1 00:05:33.765 02:16:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.765 02:16:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.765 02:16:58 -- scripts/common.sh@364 -- # decimal 1 00:05:33.765 02:16:58 -- scripts/common.sh@352 -- # local d=1 00:05:33.765 02:16:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.765 02:16:58 -- scripts/common.sh@354 -- # echo 1 00:05:33.765 02:16:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.765 02:16:58 -- scripts/common.sh@365 -- # decimal 2 00:05:33.765 02:16:58 -- scripts/common.sh@352 -- # local d=2 00:05:33.765 02:16:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.765 02:16:58 -- scripts/common.sh@354 -- # echo 2 00:05:33.765 02:16:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.765 02:16:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.765 02:16:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.765 02:16:58 -- scripts/common.sh@367 -- # return 0 00:05:33.765 02:16:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.765 02:16:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.765 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.765 --rc genhtml_branch_coverage=1 00:05:33.765 --rc genhtml_function_coverage=1 00:05:33.765 --rc genhtml_legend=1 00:05:33.765 --rc geninfo_all_blocks=1 00:05:33.765 --rc geninfo_unexecuted_blocks=1 00:05:33.765 00:05:33.765 ' 00:05:33.765 02:16:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.765 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.765 --rc genhtml_branch_coverage=1 00:05:33.765 --rc genhtml_function_coverage=1 00:05:33.765 --rc genhtml_legend=1 00:05:33.765 --rc geninfo_all_blocks=1 00:05:33.765 --rc geninfo_unexecuted_blocks=1 00:05:33.765 00:05:33.765 ' 00:05:33.765 02:16:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.765 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.765 --rc genhtml_branch_coverage=1 00:05:33.765 --rc genhtml_function_coverage=1 00:05:33.765 --rc genhtml_legend=1 00:05:33.765 --rc geninfo_all_blocks=1 00:05:33.765 --rc geninfo_unexecuted_blocks=1 00:05:33.765 00:05:33.765 ' 00:05:33.765 02:16:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.765 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.765 --rc genhtml_branch_coverage=1 00:05:33.765 --rc genhtml_function_coverage=1 00:05:33.765 --rc genhtml_legend=1 00:05:33.765 --rc geninfo_all_blocks=1 00:05:33.765 --rc geninfo_unexecuted_blocks=1 00:05:33.765 00:05:33.765 ' 00:05:33.765 02:16:58 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:33.765 OK 00:05:33.765 02:16:58 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:33.765 00:05:33.765 real 0m0.154s 00:05:33.765 user 0m0.106s 00:05:33.765 sys 0m0.057s 00:05:33.765 02:16:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.765 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.765 ************************************ 00:05:33.765 END TEST rpc_client 00:05:33.765 ************************************ 00:05:33.765 02:16:58 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:33.765 02:16:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.765 02:16:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.765 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:33.765 ************************************ 00:05:33.765 START TEST json_config 00:05:33.765 ************************************ 00:05:33.765 02:16:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:33.765 02:16:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.765 02:16:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.765 02:16:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.024 02:16:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.024 02:16:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.024 02:16:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.024 02:16:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.024 02:16:58 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.024 02:16:58 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.024 02:16:58 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.024 02:16:58 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.024 02:16:58 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.024 02:16:58 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.024 02:16:58 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.024 02:16:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.024 02:16:58 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.024 02:16:58 -- scripts/common.sh@344 -- # : 1 00:05:34.024 02:16:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.024 02:16:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.024 02:16:58 -- scripts/common.sh@364 -- # decimal 1 00:05:34.024 02:16:58 -- scripts/common.sh@352 -- # local d=1 00:05:34.024 02:16:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.024 02:16:58 -- scripts/common.sh@354 -- # echo 1 00:05:34.024 02:16:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.024 02:16:58 -- scripts/common.sh@365 -- # decimal 2 00:05:34.024 02:16:58 -- scripts/common.sh@352 -- # local d=2 00:05:34.024 02:16:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.024 02:16:58 -- scripts/common.sh@354 -- # echo 2 00:05:34.024 02:16:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.024 02:16:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.024 02:16:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.024 02:16:58 -- scripts/common.sh@367 -- # return 0 00:05:34.024 02:16:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.024 02:16:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.024 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.024 --rc genhtml_branch_coverage=1 00:05:34.024 --rc genhtml_function_coverage=1 00:05:34.024 --rc genhtml_legend=1 00:05:34.024 --rc geninfo_all_blocks=1 00:05:34.024 --rc geninfo_unexecuted_blocks=1 00:05:34.024 00:05:34.024 ' 00:05:34.024 02:16:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.025 --rc genhtml_branch_coverage=1 00:05:34.025 --rc genhtml_function_coverage=1 00:05:34.025 --rc genhtml_legend=1 00:05:34.025 --rc geninfo_all_blocks=1 00:05:34.025 --rc geninfo_unexecuted_blocks=1 00:05:34.025 00:05:34.025 ' 00:05:34.025 02:16:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.025 --rc genhtml_branch_coverage=1 00:05:34.025 --rc genhtml_function_coverage=1 00:05:34.025 --rc genhtml_legend=1 00:05:34.025 --rc geninfo_all_blocks=1 00:05:34.025 --rc geninfo_unexecuted_blocks=1 00:05:34.025 00:05:34.025 ' 00:05:34.025 02:16:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.025 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.025 --rc genhtml_branch_coverage=1 00:05:34.025 --rc genhtml_function_coverage=1 00:05:34.025 --rc genhtml_legend=1 00:05:34.025 --rc geninfo_all_blocks=1 00:05:34.025 --rc geninfo_unexecuted_blocks=1 00:05:34.025 00:05:34.025 ' 00:05:34.025 02:16:58 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:34.025 02:16:58 -- nvmf/common.sh@7 -- # uname -s 00:05:34.025 02:16:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:34.025 02:16:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:34.025 02:16:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:34.025 02:16:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:34.025 02:16:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:34.025 02:16:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:34.025 02:16:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:34.025 02:16:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:34.025 02:16:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:34.025 02:16:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:34.025 02:16:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:34.025 02:16:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:34.025 02:16:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:34.025 02:16:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:34.025 02:16:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:34.025 02:16:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:34.025 02:16:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:34.025 02:16:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:34.025 02:16:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:34.025 02:16:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.025 02:16:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.025 02:16:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.025 02:16:58 -- paths/export.sh@5 -- # export PATH 00:05:34.025 02:16:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.025 02:16:58 -- nvmf/common.sh@46 -- # : 0 00:05:34.025 02:16:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:34.025 02:16:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:34.025 02:16:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:34.025 02:16:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:34.025 02:16:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:34.025 02:16:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:34.025 02:16:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:34.025 02:16:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:34.025 02:16:58 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:34.025 02:16:58 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:34.025 02:16:58 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:34.025 02:16:58 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:34.025 02:16:58 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:34.025 02:16:58 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:34.025 02:16:58 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:34.025 02:16:58 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:34.025 02:16:58 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:34.025 02:16:58 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:34.025 02:16:58 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:34.025 02:16:58 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:34.025 INFO: JSON configuration test init 00:05:34.025 02:16:58 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:34.025 02:16:58 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:34.025 02:16:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:34.025 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:34.025 02:16:58 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:34.025 02:16:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:34.025 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:34.025 02:16:58 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:34.025 02:16:58 -- json_config/json_config.sh@98 -- # local app=target 00:05:34.025 02:16:58 -- json_config/json_config.sh@99 -- # shift 00:05:34.025 02:16:58 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:34.025 02:16:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:34.025 02:16:58 -- json_config/json_config.sh@111 -- # app_pid[$app]=1944698 00:05:34.025 02:16:58 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:34.025 02:16:58 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:34.025 Waiting for target to run... 00:05:34.025 02:16:58 -- json_config/json_config.sh@114 -- # waitforlisten 1944698 /var/tmp/spdk_tgt.sock 00:05:34.025 02:16:58 -- common/autotest_common.sh@829 -- # '[' -z 1944698 ']' 00:05:34.025 02:16:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:34.025 02:16:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.025 02:16:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:34.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:34.025 02:16:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.025 02:16:58 -- common/autotest_common.sh@10 -- # set +x 00:05:34.025 [2024-11-27 02:16:58.522336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:34.025 [2024-11-27 02:16:58.522446] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1944698 ] 00:05:34.025 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.592 [2024-11-27 02:16:59.024726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.592 [2024-11-27 02:16:59.104434] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.592 [2024-11-27 02:16:59.104644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.849 02:16:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.849 02:16:59 -- common/autotest_common.sh@862 -- # return 0 00:05:34.849 02:16:59 -- json_config/json_config.sh@115 -- # echo '' 00:05:34.849 00:05:34.849 02:16:59 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:34.849 02:16:59 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:34.849 02:16:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:34.849 02:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:34.849 02:16:59 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:34.850 02:16:59 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:34.850 02:16:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:34.850 02:16:59 -- common/autotest_common.sh@10 -- # set +x 00:05:35.107 02:16:59 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:35.107 02:16:59 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:35.107 02:16:59 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:38.390 02:17:02 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:38.390 02:17:02 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:38.390 02:17:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:38.390 02:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.390 02:17:02 -- json_config/json_config.sh@48 -- # local ret=0 00:05:38.390 02:17:02 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:38.390 02:17:02 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:38.390 02:17:02 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:38.390 02:17:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:38.390 02:17:02 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:38.390 02:17:02 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:38.390 02:17:02 -- json_config/json_config.sh@51 -- # local get_types 00:05:38.390 02:17:02 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:38.390 02:17:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:38.390 02:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.390 02:17:02 -- json_config/json_config.sh@58 -- # return 0 00:05:38.390 02:17:02 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:38.390 02:17:02 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:38.390 02:17:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:38.390 02:17:02 -- common/autotest_common.sh@10 -- # set +x 00:05:38.390 02:17:02 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:38.390 02:17:02 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:38.390 02:17:02 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:38.390 02:17:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:38.648 MallocForNvmf0 00:05:38.648 02:17:03 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:38.648 02:17:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:38.906 MallocForNvmf1 00:05:38.906 02:17:03 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:38.906 02:17:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:39.164 [2024-11-27 02:17:03.704302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:39.164 02:17:03 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:39.164 02:17:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:39.423 02:17:03 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:39.423 02:17:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:39.681 02:17:04 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:39.681 02:17:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:39.939 02:17:04 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:39.939 02:17:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:40.197 [2024-11-27 02:17:04.719705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:40.197 02:17:04 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:40.197 02:17:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.197 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.197 02:17:04 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:40.197 02:17:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.197 02:17:04 -- common/autotest_common.sh@10 -- # set +x 00:05:40.197 02:17:04 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:40.197 02:17:04 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:40.197 02:17:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:40.454 MallocBdevForConfigChangeCheck 00:05:40.454 02:17:05 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:40.454 02:17:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.454 02:17:05 -- common/autotest_common.sh@10 -- # set +x 00:05:40.454 02:17:05 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:40.454 02:17:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:41.019 02:17:05 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:41.020 INFO: shutting down applications... 00:05:41.020 02:17:05 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:41.020 02:17:05 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:41.020 02:17:05 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:41.020 02:17:05 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:42.918 Calling clear_iscsi_subsystem 00:05:42.918 Calling clear_nvmf_subsystem 00:05:42.918 Calling clear_nbd_subsystem 00:05:42.918 Calling clear_ublk_subsystem 00:05:42.918 Calling clear_vhost_blk_subsystem 00:05:42.918 Calling clear_vhost_scsi_subsystem 00:05:42.918 Calling clear_scheduler_subsystem 00:05:42.918 Calling clear_bdev_subsystem 00:05:42.918 Calling clear_accel_subsystem 00:05:42.918 Calling clear_vmd_subsystem 00:05:42.918 Calling clear_sock_subsystem 00:05:42.918 Calling clear_iobuf_subsystem 00:05:42.919 02:17:07 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:42.919 02:17:07 -- json_config/json_config.sh@396 -- # count=100 00:05:42.919 02:17:07 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:42.919 02:17:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:42.919 02:17:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:42.919 02:17:07 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:42.919 02:17:07 -- json_config/json_config.sh@398 -- # break 00:05:42.919 02:17:07 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:42.919 02:17:07 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:42.919 02:17:07 -- json_config/json_config.sh@120 -- # local app=target 00:05:42.919 02:17:07 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:42.919 02:17:07 -- json_config/json_config.sh@124 -- # [[ -n 1944698 ]] 00:05:42.919 02:17:07 -- json_config/json_config.sh@127 -- # kill -SIGINT 1944698 00:05:42.919 02:17:07 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:42.919 02:17:07 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:42.919 02:17:07 -- json_config/json_config.sh@130 -- # kill -0 1944698 00:05:42.919 02:17:07 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:43.487 02:17:07 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:43.487 02:17:07 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:43.487 02:17:07 -- json_config/json_config.sh@130 -- # kill -0 1944698 00:05:43.487 02:17:07 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:43.487 02:17:07 -- json_config/json_config.sh@132 -- # break 00:05:43.487 02:17:07 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:43.487 02:17:07 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:43.487 SPDK target shutdown done 00:05:43.487 02:17:07 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:43.487 INFO: relaunching applications... 00:05:43.487 02:17:07 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:43.487 02:17:07 -- json_config/json_config.sh@98 -- # local app=target 00:05:43.487 02:17:07 -- json_config/json_config.sh@99 -- # shift 00:05:43.487 02:17:07 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:43.487 02:17:07 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:43.487 02:17:07 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:43.487 02:17:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:43.487 02:17:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:43.487 02:17:07 -- json_config/json_config.sh@111 -- # app_pid[$app]=1946045 00:05:43.487 02:17:07 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:43.487 02:17:07 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:43.487 Waiting for target to run... 00:05:43.487 02:17:07 -- json_config/json_config.sh@114 -- # waitforlisten 1946045 /var/tmp/spdk_tgt.sock 00:05:43.487 02:17:07 -- common/autotest_common.sh@829 -- # '[' -z 1946045 ']' 00:05:43.487 02:17:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:43.487 02:17:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:43.487 02:17:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:43.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:43.487 02:17:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:43.487 02:17:07 -- common/autotest_common.sh@10 -- # set +x 00:05:43.487 [2024-11-27 02:17:08.017798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:43.487 [2024-11-27 02:17:08.017913] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1946045 ] 00:05:43.487 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.054 [2024-11-27 02:17:08.518247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.054 [2024-11-27 02:17:08.594695] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:44.054 [2024-11-27 02:17:08.594885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.344 [2024-11-27 02:17:11.617534] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:47.344 [2024-11-27 02:17:11.650031] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:47.344 02:17:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:47.344 02:17:11 -- common/autotest_common.sh@862 -- # return 0 00:05:47.344 02:17:11 -- json_config/json_config.sh@115 -- # echo '' 00:05:47.344 00:05:47.344 02:17:11 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:47.344 02:17:11 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:47.344 INFO: Checking if target configuration is the same... 00:05:47.344 02:17:11 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:47.344 02:17:11 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:47.344 02:17:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:47.344 + '[' 2 -ne 2 ']' 00:05:47.344 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:47.344 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:47.344 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:47.344 +++ basename /dev/fd/62 00:05:47.344 ++ mktemp /tmp/62.XXX 00:05:47.344 + tmp_file_1=/tmp/62.7kd 00:05:47.344 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:47.344 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:47.345 + tmp_file_2=/tmp/spdk_tgt_config.json.6mz 00:05:47.345 + ret=0 00:05:47.345 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:47.909 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:47.909 + diff -u /tmp/62.7kd /tmp/spdk_tgt_config.json.6mz 00:05:47.909 + echo 'INFO: JSON config files are the same' 00:05:47.909 INFO: JSON config files are the same 00:05:47.909 + rm /tmp/62.7kd /tmp/spdk_tgt_config.json.6mz 00:05:47.909 + exit 0 00:05:47.909 02:17:12 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:47.909 02:17:12 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:47.909 INFO: changing configuration and checking if this can be detected... 00:05:47.909 02:17:12 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:47.909 02:17:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:48.167 02:17:12 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:48.167 02:17:12 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:48.167 02:17:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:48.167 + '[' 2 -ne 2 ']' 00:05:48.167 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:48.167 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:48.167 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:48.167 +++ basename /dev/fd/62 00:05:48.167 ++ mktemp /tmp/62.XXX 00:05:48.167 + tmp_file_1=/tmp/62.1Jd 00:05:48.167 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:48.167 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:48.167 + tmp_file_2=/tmp/spdk_tgt_config.json.nrA 00:05:48.167 + ret=0 00:05:48.167 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:48.425 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:48.425 + diff -u /tmp/62.1Jd /tmp/spdk_tgt_config.json.nrA 00:05:48.425 + ret=1 00:05:48.425 + echo '=== Start of file: /tmp/62.1Jd ===' 00:05:48.425 + cat /tmp/62.1Jd 00:05:48.425 + echo '=== End of file: /tmp/62.1Jd ===' 00:05:48.425 + echo '' 00:05:48.425 + echo '=== Start of file: /tmp/spdk_tgt_config.json.nrA ===' 00:05:48.425 + cat /tmp/spdk_tgt_config.json.nrA 00:05:48.425 + echo '=== End of file: /tmp/spdk_tgt_config.json.nrA ===' 00:05:48.425 + echo '' 00:05:48.425 + rm /tmp/62.1Jd /tmp/spdk_tgt_config.json.nrA 00:05:48.425 + exit 1 00:05:48.425 02:17:13 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:48.425 INFO: configuration change detected. 00:05:48.425 02:17:13 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:48.425 02:17:13 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:48.425 02:17:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:48.425 02:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:48.425 02:17:13 -- json_config/json_config.sh@360 -- # local ret=0 00:05:48.425 02:17:13 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:48.425 02:17:13 -- json_config/json_config.sh@370 -- # [[ -n 1946045 ]] 00:05:48.425 02:17:13 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:48.425 02:17:13 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:48.425 02:17:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:48.425 02:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:48.425 02:17:13 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:48.425 02:17:13 -- json_config/json_config.sh@246 -- # uname -s 00:05:48.425 02:17:13 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:48.425 02:17:13 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:48.425 02:17:13 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:48.425 02:17:13 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:48.425 02:17:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.425 02:17:13 -- common/autotest_common.sh@10 -- # set +x 00:05:48.683 02:17:13 -- json_config/json_config.sh@376 -- # killprocess 1946045 00:05:48.683 02:17:13 -- common/autotest_common.sh@936 -- # '[' -z 1946045 ']' 00:05:48.683 02:17:13 -- common/autotest_common.sh@940 -- # kill -0 1946045 00:05:48.683 02:17:13 -- common/autotest_common.sh@941 -- # uname 00:05:48.683 02:17:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.683 02:17:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1946045 00:05:48.683 02:17:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.683 02:17:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.683 02:17:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1946045' 00:05:48.683 killing process with pid 1946045 00:05:48.683 02:17:13 -- common/autotest_common.sh@955 -- # kill 1946045 00:05:48.683 02:17:13 -- common/autotest_common.sh@960 -- # wait 1946045 00:05:50.583 02:17:14 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.583 02:17:14 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:50.583 02:17:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:50.583 02:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:50.583 02:17:14 -- json_config/json_config.sh@381 -- # return 0 00:05:50.583 02:17:14 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:50.583 INFO: Success 00:05:50.583 00:05:50.583 real 0m16.420s 00:05:50.583 user 0m18.804s 00:05:50.583 sys 0m2.262s 00:05:50.583 02:17:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.583 02:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:50.583 ************************************ 00:05:50.584 END TEST json_config 00:05:50.584 ************************************ 00:05:50.584 02:17:14 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:50.584 02:17:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.584 02:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:50.584 ************************************ 00:05:50.584 START TEST json_config_extra_key 00:05:50.584 ************************************ 00:05:50.584 02:17:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:50.584 02:17:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:50.584 02:17:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:50.584 02:17:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:50.584 02:17:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:50.584 02:17:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:50.584 02:17:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:50.584 02:17:14 -- scripts/common.sh@335 -- # IFS=.-: 00:05:50.584 02:17:14 -- scripts/common.sh@335 -- # read -ra ver1 00:05:50.584 02:17:14 -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.584 02:17:14 -- scripts/common.sh@336 -- # read -ra ver2 00:05:50.584 02:17:14 -- scripts/common.sh@337 -- # local 'op=<' 00:05:50.584 02:17:14 -- scripts/common.sh@339 -- # ver1_l=2 00:05:50.584 02:17:14 -- scripts/common.sh@340 -- # ver2_l=1 00:05:50.584 02:17:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:50.584 02:17:14 -- scripts/common.sh@343 -- # case "$op" in 00:05:50.584 02:17:14 -- scripts/common.sh@344 -- # : 1 00:05:50.584 02:17:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:50.584 02:17:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.584 02:17:14 -- scripts/common.sh@364 -- # decimal 1 00:05:50.584 02:17:14 -- scripts/common.sh@352 -- # local d=1 00:05:50.584 02:17:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.584 02:17:14 -- scripts/common.sh@354 -- # echo 1 00:05:50.584 02:17:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:50.584 02:17:14 -- scripts/common.sh@365 -- # decimal 2 00:05:50.584 02:17:14 -- scripts/common.sh@352 -- # local d=2 00:05:50.584 02:17:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.584 02:17:14 -- scripts/common.sh@354 -- # echo 2 00:05:50.584 02:17:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:50.584 02:17:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:50.584 02:17:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:50.584 02:17:14 -- scripts/common.sh@367 -- # return 0 00:05:50.584 02:17:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:50.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.584 --rc genhtml_branch_coverage=1 00:05:50.584 --rc genhtml_function_coverage=1 00:05:50.584 --rc genhtml_legend=1 00:05:50.584 --rc geninfo_all_blocks=1 00:05:50.584 --rc geninfo_unexecuted_blocks=1 00:05:50.584 00:05:50.584 ' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:50.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.584 --rc genhtml_branch_coverage=1 00:05:50.584 --rc genhtml_function_coverage=1 00:05:50.584 --rc genhtml_legend=1 00:05:50.584 --rc geninfo_all_blocks=1 00:05:50.584 --rc geninfo_unexecuted_blocks=1 00:05:50.584 00:05:50.584 ' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:50.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.584 --rc genhtml_branch_coverage=1 00:05:50.584 --rc genhtml_function_coverage=1 00:05:50.584 --rc genhtml_legend=1 00:05:50.584 --rc geninfo_all_blocks=1 00:05:50.584 --rc geninfo_unexecuted_blocks=1 00:05:50.584 00:05:50.584 ' 00:05:50.584 02:17:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:50.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.584 --rc genhtml_branch_coverage=1 00:05:50.584 --rc genhtml_function_coverage=1 00:05:50.584 --rc genhtml_legend=1 00:05:50.584 --rc geninfo_all_blocks=1 00:05:50.584 --rc geninfo_unexecuted_blocks=1 00:05:50.584 00:05:50.584 ' 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:50.584 02:17:14 -- nvmf/common.sh@7 -- # uname -s 00:05:50.584 02:17:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:50.584 02:17:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:50.584 02:17:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:50.584 02:17:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:50.584 02:17:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:50.584 02:17:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:50.584 02:17:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:50.584 02:17:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:50.584 02:17:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:50.584 02:17:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:50.584 02:17:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:50.584 02:17:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:50.584 02:17:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:50.584 02:17:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:50.584 02:17:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:50.584 02:17:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:50.584 02:17:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:50.584 02:17:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:50.584 02:17:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:50.584 02:17:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.584 02:17:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.584 02:17:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.584 02:17:14 -- paths/export.sh@5 -- # export PATH 00:05:50.584 02:17:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:50.584 02:17:14 -- nvmf/common.sh@46 -- # : 0 00:05:50.584 02:17:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:50.584 02:17:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:50.584 02:17:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:50.584 02:17:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:50.584 02:17:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:50.584 02:17:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:50.584 02:17:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:50.584 02:17:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:50.584 INFO: launching applications... 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1946994 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:50.584 Waiting for target to run... 00:05:50.584 02:17:14 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1946994 /var/tmp/spdk_tgt.sock 00:05:50.584 02:17:14 -- common/autotest_common.sh@829 -- # '[' -z 1946994 ']' 00:05:50.584 02:17:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:50.584 02:17:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:50.584 02:17:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:50.584 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:50.584 02:17:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:50.584 02:17:14 -- common/autotest_common.sh@10 -- # set +x 00:05:50.585 [2024-11-27 02:17:14.963057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:50.585 [2024-11-27 02:17:14.963150] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1946994 ] 00:05:50.585 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.843 [2024-11-27 02:17:15.307339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.843 [2024-11-27 02:17:15.368596] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:50.843 [2024-11-27 02:17:15.368783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.410 02:17:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:51.410 02:17:15 -- common/autotest_common.sh@862 -- # return 0 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:51.410 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:51.410 INFO: shutting down applications... 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1946994 ]] 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1946994 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1946994 00:05:51.410 02:17:15 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1946994 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:51.975 SPDK target shutdown done 00:05:51.975 02:17:16 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:51.975 Success 00:05:51.975 00:05:51.975 real 0m1.659s 00:05:51.975 user 0m1.611s 00:05:51.975 sys 0m0.458s 00:05:51.975 02:17:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.975 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:05:51.975 ************************************ 00:05:51.975 END TEST json_config_extra_key 00:05:51.975 ************************************ 00:05:51.975 02:17:16 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:51.975 02:17:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.975 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:05:51.975 ************************************ 00:05:51.975 START TEST alias_rpc 00:05:51.975 ************************************ 00:05:51.975 02:17:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:51.975 * Looking for test storage... 00:05:51.975 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:51.975 02:17:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:51.975 02:17:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:51.975 02:17:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:51.975 02:17:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:51.975 02:17:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:51.975 02:17:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:51.975 02:17:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:51.975 02:17:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:51.975 02:17:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.975 02:17:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:51.975 02:17:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:51.975 02:17:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:51.975 02:17:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:51.975 02:17:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:51.975 02:17:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:51.975 02:17:16 -- scripts/common.sh@344 -- # : 1 00:05:51.975 02:17:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:51.975 02:17:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.975 02:17:16 -- scripts/common.sh@364 -- # decimal 1 00:05:51.975 02:17:16 -- scripts/common.sh@352 -- # local d=1 00:05:51.975 02:17:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.975 02:17:16 -- scripts/common.sh@354 -- # echo 1 00:05:51.975 02:17:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:51.975 02:17:16 -- scripts/common.sh@365 -- # decimal 2 00:05:51.975 02:17:16 -- scripts/common.sh@352 -- # local d=2 00:05:51.975 02:17:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.975 02:17:16 -- scripts/common.sh@354 -- # echo 2 00:05:51.975 02:17:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:51.975 02:17:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:51.975 02:17:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:51.975 02:17:16 -- scripts/common.sh@367 -- # return 0 00:05:51.975 02:17:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:51.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.975 --rc genhtml_branch_coverage=1 00:05:51.975 --rc genhtml_function_coverage=1 00:05:51.975 --rc genhtml_legend=1 00:05:51.975 --rc geninfo_all_blocks=1 00:05:51.975 --rc geninfo_unexecuted_blocks=1 00:05:51.975 00:05:51.975 ' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:51.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.975 --rc genhtml_branch_coverage=1 00:05:51.975 --rc genhtml_function_coverage=1 00:05:51.975 --rc genhtml_legend=1 00:05:51.975 --rc geninfo_all_blocks=1 00:05:51.975 --rc geninfo_unexecuted_blocks=1 00:05:51.975 00:05:51.975 ' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:51.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.975 --rc genhtml_branch_coverage=1 00:05:51.975 --rc genhtml_function_coverage=1 00:05:51.975 --rc genhtml_legend=1 00:05:51.975 --rc geninfo_all_blocks=1 00:05:51.975 --rc geninfo_unexecuted_blocks=1 00:05:51.975 00:05:51.975 ' 00:05:51.975 02:17:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:51.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.975 --rc genhtml_branch_coverage=1 00:05:51.975 --rc genhtml_function_coverage=1 00:05:51.975 --rc genhtml_legend=1 00:05:51.975 --rc geninfo_all_blocks=1 00:05:51.975 --rc geninfo_unexecuted_blocks=1 00:05:51.975 00:05:51.975 ' 00:05:51.975 02:17:16 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:51.975 02:17:16 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1947313 00:05:51.975 02:17:16 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:51.975 02:17:16 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1947313 00:05:51.976 02:17:16 -- common/autotest_common.sh@829 -- # '[' -z 1947313 ']' 00:05:51.976 02:17:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:51.976 02:17:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:51.976 02:17:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:51.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:51.976 02:17:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:51.976 02:17:16 -- common/autotest_common.sh@10 -- # set +x 00:05:52.234 [2024-11-27 02:17:16.641400] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:52.234 [2024-11-27 02:17:16.641490] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1947313 ] 00:05:52.234 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.234 [2024-11-27 02:17:16.703694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.234 [2024-11-27 02:17:16.791576] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:52.234 [2024-11-27 02:17:16.791762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.168 02:17:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:53.168 02:17:17 -- common/autotest_common.sh@862 -- # return 0 00:05:53.168 02:17:17 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:53.426 02:17:17 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1947313 00:05:53.426 02:17:17 -- common/autotest_common.sh@936 -- # '[' -z 1947313 ']' 00:05:53.426 02:17:17 -- common/autotest_common.sh@940 -- # kill -0 1947313 00:05:53.426 02:17:17 -- common/autotest_common.sh@941 -- # uname 00:05:53.426 02:17:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:53.426 02:17:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1947313 00:05:53.426 02:17:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:53.426 02:17:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:53.426 02:17:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1947313' 00:05:53.427 killing process with pid 1947313 00:05:53.427 02:17:17 -- common/autotest_common.sh@955 -- # kill 1947313 00:05:53.427 02:17:17 -- common/autotest_common.sh@960 -- # wait 1947313 00:05:53.685 00:05:53.685 real 0m1.830s 00:05:53.685 user 0m2.064s 00:05:53.685 sys 0m0.487s 00:05:53.685 02:17:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.685 02:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:53.685 ************************************ 00:05:53.685 END TEST alias_rpc 00:05:53.685 ************************************ 00:05:53.685 02:17:18 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:53.685 02:17:18 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:53.685 02:17:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:53.685 02:17:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.685 02:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:53.685 ************************************ 00:05:53.685 START TEST spdkcli_tcp 00:05:53.685 ************************************ 00:05:53.685 02:17:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:53.944 * Looking for test storage... 00:05:53.944 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:53.944 02:17:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:53.944 02:17:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:53.944 02:17:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:53.944 02:17:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:53.944 02:17:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:53.944 02:17:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:53.944 02:17:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:53.944 02:17:18 -- scripts/common.sh@335 -- # IFS=.-: 00:05:53.944 02:17:18 -- scripts/common.sh@335 -- # read -ra ver1 00:05:53.944 02:17:18 -- scripts/common.sh@336 -- # IFS=.-: 00:05:53.944 02:17:18 -- scripts/common.sh@336 -- # read -ra ver2 00:05:53.944 02:17:18 -- scripts/common.sh@337 -- # local 'op=<' 00:05:53.944 02:17:18 -- scripts/common.sh@339 -- # ver1_l=2 00:05:53.944 02:17:18 -- scripts/common.sh@340 -- # ver2_l=1 00:05:53.944 02:17:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:53.944 02:17:18 -- scripts/common.sh@343 -- # case "$op" in 00:05:53.944 02:17:18 -- scripts/common.sh@344 -- # : 1 00:05:53.944 02:17:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:53.944 02:17:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:53.944 02:17:18 -- scripts/common.sh@364 -- # decimal 1 00:05:53.944 02:17:18 -- scripts/common.sh@352 -- # local d=1 00:05:53.944 02:17:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:53.944 02:17:18 -- scripts/common.sh@354 -- # echo 1 00:05:53.944 02:17:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:53.944 02:17:18 -- scripts/common.sh@365 -- # decimal 2 00:05:53.944 02:17:18 -- scripts/common.sh@352 -- # local d=2 00:05:53.944 02:17:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:53.944 02:17:18 -- scripts/common.sh@354 -- # echo 2 00:05:53.944 02:17:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:53.944 02:17:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:53.944 02:17:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:53.944 02:17:18 -- scripts/common.sh@367 -- # return 0 00:05:53.944 02:17:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:53.944 02:17:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:53.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.944 --rc genhtml_branch_coverage=1 00:05:53.944 --rc genhtml_function_coverage=1 00:05:53.944 --rc genhtml_legend=1 00:05:53.944 --rc geninfo_all_blocks=1 00:05:53.944 --rc geninfo_unexecuted_blocks=1 00:05:53.944 00:05:53.944 ' 00:05:53.944 02:17:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:53.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.944 --rc genhtml_branch_coverage=1 00:05:53.944 --rc genhtml_function_coverage=1 00:05:53.944 --rc genhtml_legend=1 00:05:53.944 --rc geninfo_all_blocks=1 00:05:53.944 --rc geninfo_unexecuted_blocks=1 00:05:53.944 00:05:53.944 ' 00:05:53.944 02:17:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:53.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.944 --rc genhtml_branch_coverage=1 00:05:53.944 --rc genhtml_function_coverage=1 00:05:53.944 --rc genhtml_legend=1 00:05:53.944 --rc geninfo_all_blocks=1 00:05:53.944 --rc geninfo_unexecuted_blocks=1 00:05:53.944 00:05:53.944 ' 00:05:53.944 02:17:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:53.944 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.944 --rc genhtml_branch_coverage=1 00:05:53.944 --rc genhtml_function_coverage=1 00:05:53.944 --rc genhtml_legend=1 00:05:53.944 --rc geninfo_all_blocks=1 00:05:53.944 --rc geninfo_unexecuted_blocks=1 00:05:53.944 00:05:53.944 ' 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:53.945 02:17:18 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:53.945 02:17:18 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:53.945 02:17:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:53.945 02:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1947521 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:53.945 02:17:18 -- spdkcli/tcp.sh@27 -- # waitforlisten 1947521 00:05:53.945 02:17:18 -- common/autotest_common.sh@829 -- # '[' -z 1947521 ']' 00:05:53.945 02:17:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:53.945 02:17:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:53.945 02:17:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:53.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:53.945 02:17:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:53.945 02:17:18 -- common/autotest_common.sh@10 -- # set +x 00:05:53.945 [2024-11-27 02:17:18.501750] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:53.945 [2024-11-27 02:17:18.501840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1947521 ] 00:05:53.945 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.945 [2024-11-27 02:17:18.558271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:54.203 [2024-11-27 02:17:18.640048] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:54.203 [2024-11-27 02:17:18.640278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:54.203 [2024-11-27 02:17:18.640283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.138 02:17:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:55.138 02:17:19 -- common/autotest_common.sh@862 -- # return 0 00:05:55.138 02:17:19 -- spdkcli/tcp.sh@31 -- # socat_pid=1947658 00:05:55.138 02:17:19 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:55.138 02:17:19 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:55.138 [ 00:05:55.138 "bdev_malloc_delete", 00:05:55.138 "bdev_malloc_create", 00:05:55.138 "bdev_null_resize", 00:05:55.138 "bdev_null_delete", 00:05:55.138 "bdev_null_create", 00:05:55.138 "bdev_nvme_cuse_unregister", 00:05:55.138 "bdev_nvme_cuse_register", 00:05:55.138 "bdev_opal_new_user", 00:05:55.138 "bdev_opal_set_lock_state", 00:05:55.138 "bdev_opal_delete", 00:05:55.138 "bdev_opal_get_info", 00:05:55.138 "bdev_opal_create", 00:05:55.138 "bdev_nvme_opal_revert", 00:05:55.138 "bdev_nvme_opal_init", 00:05:55.138 "bdev_nvme_send_cmd", 00:05:55.138 "bdev_nvme_get_path_iostat", 00:05:55.138 "bdev_nvme_get_mdns_discovery_info", 00:05:55.138 "bdev_nvme_stop_mdns_discovery", 00:05:55.138 "bdev_nvme_start_mdns_discovery", 00:05:55.138 "bdev_nvme_set_multipath_policy", 00:05:55.138 "bdev_nvme_set_preferred_path", 00:05:55.138 "bdev_nvme_get_io_paths", 00:05:55.138 "bdev_nvme_remove_error_injection", 00:05:55.138 "bdev_nvme_add_error_injection", 00:05:55.138 "bdev_nvme_get_discovery_info", 00:05:55.138 "bdev_nvme_stop_discovery", 00:05:55.138 "bdev_nvme_start_discovery", 00:05:55.138 "bdev_nvme_get_controller_health_info", 00:05:55.138 "bdev_nvme_disable_controller", 00:05:55.138 "bdev_nvme_enable_controller", 00:05:55.138 "bdev_nvme_reset_controller", 00:05:55.138 "bdev_nvme_get_transport_statistics", 00:05:55.138 "bdev_nvme_apply_firmware", 00:05:55.138 "bdev_nvme_detach_controller", 00:05:55.138 "bdev_nvme_get_controllers", 00:05:55.138 "bdev_nvme_attach_controller", 00:05:55.138 "bdev_nvme_set_hotplug", 00:05:55.139 "bdev_nvme_set_options", 00:05:55.139 "bdev_passthru_delete", 00:05:55.139 "bdev_passthru_create", 00:05:55.139 "bdev_lvol_grow_lvstore", 00:05:55.139 "bdev_lvol_get_lvols", 00:05:55.139 "bdev_lvol_get_lvstores", 00:05:55.139 "bdev_lvol_delete", 00:05:55.139 "bdev_lvol_set_read_only", 00:05:55.139 "bdev_lvol_resize", 00:05:55.139 "bdev_lvol_decouple_parent", 00:05:55.139 "bdev_lvol_inflate", 00:05:55.139 "bdev_lvol_rename", 00:05:55.139 "bdev_lvol_clone_bdev", 00:05:55.139 "bdev_lvol_clone", 00:05:55.139 "bdev_lvol_snapshot", 00:05:55.139 "bdev_lvol_create", 00:05:55.139 "bdev_lvol_delete_lvstore", 00:05:55.139 "bdev_lvol_rename_lvstore", 00:05:55.139 "bdev_lvol_create_lvstore", 00:05:55.139 "bdev_raid_set_options", 00:05:55.139 "bdev_raid_remove_base_bdev", 00:05:55.139 "bdev_raid_add_base_bdev", 00:05:55.139 "bdev_raid_delete", 00:05:55.139 "bdev_raid_create", 00:05:55.139 "bdev_raid_get_bdevs", 00:05:55.139 "bdev_error_inject_error", 00:05:55.139 "bdev_error_delete", 00:05:55.139 "bdev_error_create", 00:05:55.139 "bdev_split_delete", 00:05:55.139 "bdev_split_create", 00:05:55.139 "bdev_delay_delete", 00:05:55.139 "bdev_delay_create", 00:05:55.139 "bdev_delay_update_latency", 00:05:55.139 "bdev_zone_block_delete", 00:05:55.139 "bdev_zone_block_create", 00:05:55.139 "blobfs_create", 00:05:55.139 "blobfs_detect", 00:05:55.139 "blobfs_set_cache_size", 00:05:55.139 "bdev_aio_delete", 00:05:55.139 "bdev_aio_rescan", 00:05:55.139 "bdev_aio_create", 00:05:55.139 "bdev_ftl_set_property", 00:05:55.139 "bdev_ftl_get_properties", 00:05:55.139 "bdev_ftl_get_stats", 00:05:55.139 "bdev_ftl_unmap", 00:05:55.139 "bdev_ftl_unload", 00:05:55.139 "bdev_ftl_delete", 00:05:55.139 "bdev_ftl_load", 00:05:55.139 "bdev_ftl_create", 00:05:55.139 "bdev_virtio_attach_controller", 00:05:55.139 "bdev_virtio_scsi_get_devices", 00:05:55.139 "bdev_virtio_detach_controller", 00:05:55.139 "bdev_virtio_blk_set_hotplug", 00:05:55.139 "bdev_iscsi_delete", 00:05:55.139 "bdev_iscsi_create", 00:05:55.139 "bdev_iscsi_set_options", 00:05:55.139 "accel_error_inject_error", 00:05:55.139 "ioat_scan_accel_module", 00:05:55.139 "dsa_scan_accel_module", 00:05:55.139 "iaa_scan_accel_module", 00:05:55.139 "vfu_virtio_create_scsi_endpoint", 00:05:55.139 "vfu_virtio_scsi_remove_target", 00:05:55.139 "vfu_virtio_scsi_add_target", 00:05:55.139 "vfu_virtio_create_blk_endpoint", 00:05:55.139 "vfu_virtio_delete_endpoint", 00:05:55.139 "iscsi_set_options", 00:05:55.139 "iscsi_get_auth_groups", 00:05:55.139 "iscsi_auth_group_remove_secret", 00:05:55.139 "iscsi_auth_group_add_secret", 00:05:55.139 "iscsi_delete_auth_group", 00:05:55.139 "iscsi_create_auth_group", 00:05:55.139 "iscsi_set_discovery_auth", 00:05:55.139 "iscsi_get_options", 00:05:55.139 "iscsi_target_node_request_logout", 00:05:55.139 "iscsi_target_node_set_redirect", 00:05:55.139 "iscsi_target_node_set_auth", 00:05:55.139 "iscsi_target_node_add_lun", 00:05:55.139 "iscsi_get_connections", 00:05:55.139 "iscsi_portal_group_set_auth", 00:05:55.139 "iscsi_start_portal_group", 00:05:55.139 "iscsi_delete_portal_group", 00:05:55.139 "iscsi_create_portal_group", 00:05:55.139 "iscsi_get_portal_groups", 00:05:55.139 "iscsi_delete_target_node", 00:05:55.139 "iscsi_target_node_remove_pg_ig_maps", 00:05:55.139 "iscsi_target_node_add_pg_ig_maps", 00:05:55.139 "iscsi_create_target_node", 00:05:55.139 "iscsi_get_target_nodes", 00:05:55.139 "iscsi_delete_initiator_group", 00:05:55.139 "iscsi_initiator_group_remove_initiators", 00:05:55.139 "iscsi_initiator_group_add_initiators", 00:05:55.139 "iscsi_create_initiator_group", 00:05:55.139 "iscsi_get_initiator_groups", 00:05:55.139 "nvmf_set_crdt", 00:05:55.139 "nvmf_set_config", 00:05:55.139 "nvmf_set_max_subsystems", 00:05:55.139 "nvmf_subsystem_get_listeners", 00:05:55.139 "nvmf_subsystem_get_qpairs", 00:05:55.139 "nvmf_subsystem_get_controllers", 00:05:55.139 "nvmf_get_stats", 00:05:55.139 "nvmf_get_transports", 00:05:55.139 "nvmf_create_transport", 00:05:55.139 "nvmf_get_targets", 00:05:55.139 "nvmf_delete_target", 00:05:55.139 "nvmf_create_target", 00:05:55.139 "nvmf_subsystem_allow_any_host", 00:05:55.139 "nvmf_subsystem_remove_host", 00:05:55.139 "nvmf_subsystem_add_host", 00:05:55.139 "nvmf_subsystem_remove_ns", 00:05:55.139 "nvmf_subsystem_add_ns", 00:05:55.139 "nvmf_subsystem_listener_set_ana_state", 00:05:55.139 "nvmf_discovery_get_referrals", 00:05:55.139 "nvmf_discovery_remove_referral", 00:05:55.139 "nvmf_discovery_add_referral", 00:05:55.139 "nvmf_subsystem_remove_listener", 00:05:55.139 "nvmf_subsystem_add_listener", 00:05:55.139 "nvmf_delete_subsystem", 00:05:55.139 "nvmf_create_subsystem", 00:05:55.139 "nvmf_get_subsystems", 00:05:55.139 "env_dpdk_get_mem_stats", 00:05:55.139 "nbd_get_disks", 00:05:55.139 "nbd_stop_disk", 00:05:55.139 "nbd_start_disk", 00:05:55.139 "ublk_recover_disk", 00:05:55.139 "ublk_get_disks", 00:05:55.139 "ublk_stop_disk", 00:05:55.139 "ublk_start_disk", 00:05:55.139 "ublk_destroy_target", 00:05:55.139 "ublk_create_target", 00:05:55.139 "virtio_blk_create_transport", 00:05:55.139 "virtio_blk_get_transports", 00:05:55.139 "vhost_controller_set_coalescing", 00:05:55.139 "vhost_get_controllers", 00:05:55.139 "vhost_delete_controller", 00:05:55.139 "vhost_create_blk_controller", 00:05:55.139 "vhost_scsi_controller_remove_target", 00:05:55.139 "vhost_scsi_controller_add_target", 00:05:55.139 "vhost_start_scsi_controller", 00:05:55.139 "vhost_create_scsi_controller", 00:05:55.139 "thread_set_cpumask", 00:05:55.139 "framework_get_scheduler", 00:05:55.139 "framework_set_scheduler", 00:05:55.139 "framework_get_reactors", 00:05:55.139 "thread_get_io_channels", 00:05:55.139 "thread_get_pollers", 00:05:55.139 "thread_get_stats", 00:05:55.139 "framework_monitor_context_switch", 00:05:55.139 "spdk_kill_instance", 00:05:55.139 "log_enable_timestamps", 00:05:55.139 "log_get_flags", 00:05:55.139 "log_clear_flag", 00:05:55.139 "log_set_flag", 00:05:55.139 "log_get_level", 00:05:55.139 "log_set_level", 00:05:55.139 "log_get_print_level", 00:05:55.139 "log_set_print_level", 00:05:55.139 "framework_enable_cpumask_locks", 00:05:55.139 "framework_disable_cpumask_locks", 00:05:55.139 "framework_wait_init", 00:05:55.139 "framework_start_init", 00:05:55.139 "scsi_get_devices", 00:05:55.139 "bdev_get_histogram", 00:05:55.139 "bdev_enable_histogram", 00:05:55.139 "bdev_set_qos_limit", 00:05:55.139 "bdev_set_qd_sampling_period", 00:05:55.139 "bdev_get_bdevs", 00:05:55.139 "bdev_reset_iostat", 00:05:55.139 "bdev_get_iostat", 00:05:55.139 "bdev_examine", 00:05:55.139 "bdev_wait_for_examine", 00:05:55.139 "bdev_set_options", 00:05:55.139 "notify_get_notifications", 00:05:55.139 "notify_get_types", 00:05:55.139 "accel_get_stats", 00:05:55.139 "accel_set_options", 00:05:55.139 "accel_set_driver", 00:05:55.139 "accel_crypto_key_destroy", 00:05:55.139 "accel_crypto_keys_get", 00:05:55.139 "accel_crypto_key_create", 00:05:55.139 "accel_assign_opc", 00:05:55.139 "accel_get_module_info", 00:05:55.139 "accel_get_opc_assignments", 00:05:55.139 "vmd_rescan", 00:05:55.139 "vmd_remove_device", 00:05:55.139 "vmd_enable", 00:05:55.139 "sock_set_default_impl", 00:05:55.139 "sock_impl_set_options", 00:05:55.139 "sock_impl_get_options", 00:05:55.139 "iobuf_get_stats", 00:05:55.139 "iobuf_set_options", 00:05:55.139 "framework_get_pci_devices", 00:05:55.139 "framework_get_config", 00:05:55.139 "framework_get_subsystems", 00:05:55.139 "vfu_tgt_set_base_path", 00:05:55.139 "trace_get_info", 00:05:55.139 "trace_get_tpoint_group_mask", 00:05:55.139 "trace_disable_tpoint_group", 00:05:55.139 "trace_enable_tpoint_group", 00:05:55.139 "trace_clear_tpoint_mask", 00:05:55.139 "trace_set_tpoint_mask", 00:05:55.139 "spdk_get_version", 00:05:55.139 "rpc_get_methods" 00:05:55.139 ] 00:05:55.139 02:17:19 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:55.139 02:17:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:55.139 02:17:19 -- common/autotest_common.sh@10 -- # set +x 00:05:55.139 02:17:19 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:55.139 02:17:19 -- spdkcli/tcp.sh@38 -- # killprocess 1947521 00:05:55.139 02:17:19 -- common/autotest_common.sh@936 -- # '[' -z 1947521 ']' 00:05:55.139 02:17:19 -- common/autotest_common.sh@940 -- # kill -0 1947521 00:05:55.139 02:17:19 -- common/autotest_common.sh@941 -- # uname 00:05:55.139 02:17:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.139 02:17:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1947521 00:05:55.139 02:17:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.139 02:17:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.139 02:17:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1947521' 00:05:55.139 killing process with pid 1947521 00:05:55.139 02:17:19 -- common/autotest_common.sh@955 -- # kill 1947521 00:05:55.139 02:17:19 -- common/autotest_common.sh@960 -- # wait 1947521 00:05:55.705 00:05:55.705 real 0m1.823s 00:05:55.705 user 0m3.523s 00:05:55.705 sys 0m0.459s 00:05:55.705 02:17:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.705 02:17:20 -- common/autotest_common.sh@10 -- # set +x 00:05:55.705 ************************************ 00:05:55.705 END TEST spdkcli_tcp 00:05:55.705 ************************************ 00:05:55.705 02:17:20 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:55.705 02:17:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.705 02:17:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.705 02:17:20 -- common/autotest_common.sh@10 -- # set +x 00:05:55.705 ************************************ 00:05:55.705 START TEST dpdk_mem_utility 00:05:55.705 ************************************ 00:05:55.705 02:17:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:55.705 * Looking for test storage... 00:05:55.705 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:55.705 02:17:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:55.705 02:17:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:55.705 02:17:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:55.705 02:17:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:55.705 02:17:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:55.705 02:17:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:55.705 02:17:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:55.705 02:17:20 -- scripts/common.sh@335 -- # IFS=.-: 00:05:55.705 02:17:20 -- scripts/common.sh@335 -- # read -ra ver1 00:05:55.705 02:17:20 -- scripts/common.sh@336 -- # IFS=.-: 00:05:55.705 02:17:20 -- scripts/common.sh@336 -- # read -ra ver2 00:05:55.705 02:17:20 -- scripts/common.sh@337 -- # local 'op=<' 00:05:55.705 02:17:20 -- scripts/common.sh@339 -- # ver1_l=2 00:05:55.705 02:17:20 -- scripts/common.sh@340 -- # ver2_l=1 00:05:55.705 02:17:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:55.705 02:17:20 -- scripts/common.sh@343 -- # case "$op" in 00:05:55.705 02:17:20 -- scripts/common.sh@344 -- # : 1 00:05:55.705 02:17:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:55.705 02:17:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:55.705 02:17:20 -- scripts/common.sh@364 -- # decimal 1 00:05:55.706 02:17:20 -- scripts/common.sh@352 -- # local d=1 00:05:55.706 02:17:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:55.706 02:17:20 -- scripts/common.sh@354 -- # echo 1 00:05:55.706 02:17:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:55.706 02:17:20 -- scripts/common.sh@365 -- # decimal 2 00:05:55.706 02:17:20 -- scripts/common.sh@352 -- # local d=2 00:05:55.706 02:17:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:55.706 02:17:20 -- scripts/common.sh@354 -- # echo 2 00:05:55.706 02:17:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:55.706 02:17:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:55.706 02:17:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:55.706 02:17:20 -- scripts/common.sh@367 -- # return 0 00:05:55.706 02:17:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:55.706 02:17:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:55.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.706 --rc genhtml_branch_coverage=1 00:05:55.706 --rc genhtml_function_coverage=1 00:05:55.706 --rc genhtml_legend=1 00:05:55.706 --rc geninfo_all_blocks=1 00:05:55.706 --rc geninfo_unexecuted_blocks=1 00:05:55.706 00:05:55.706 ' 00:05:55.706 02:17:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:55.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.706 --rc genhtml_branch_coverage=1 00:05:55.706 --rc genhtml_function_coverage=1 00:05:55.706 --rc genhtml_legend=1 00:05:55.706 --rc geninfo_all_blocks=1 00:05:55.706 --rc geninfo_unexecuted_blocks=1 00:05:55.706 00:05:55.706 ' 00:05:55.706 02:17:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:55.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.706 --rc genhtml_branch_coverage=1 00:05:55.706 --rc genhtml_function_coverage=1 00:05:55.706 --rc genhtml_legend=1 00:05:55.706 --rc geninfo_all_blocks=1 00:05:55.706 --rc geninfo_unexecuted_blocks=1 00:05:55.706 00:05:55.706 ' 00:05:55.706 02:17:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:55.706 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.706 --rc genhtml_branch_coverage=1 00:05:55.706 --rc genhtml_function_coverage=1 00:05:55.706 --rc genhtml_legend=1 00:05:55.706 --rc geninfo_all_blocks=1 00:05:55.706 --rc geninfo_unexecuted_blocks=1 00:05:55.706 00:05:55.706 ' 00:05:55.706 02:17:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:55.706 02:17:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1947865 00:05:55.706 02:17:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1947865 00:05:55.706 02:17:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:55.706 02:17:20 -- common/autotest_common.sh@829 -- # '[' -z 1947865 ']' 00:05:55.706 02:17:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:55.706 02:17:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:55.706 02:17:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:55.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:55.706 02:17:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:55.706 02:17:20 -- common/autotest_common.sh@10 -- # set +x 00:05:55.964 [2024-11-27 02:17:20.347881] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:55.964 [2024-11-27 02:17:20.347966] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1947865 ] 00:05:55.964 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.964 [2024-11-27 02:17:20.404751] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.964 [2024-11-27 02:17:20.490603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:55.964 [2024-11-27 02:17:20.490793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.898 02:17:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:56.898 02:17:21 -- common/autotest_common.sh@862 -- # return 0 00:05:56.898 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:56.898 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:56.898 02:17:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:56.898 02:17:21 -- common/autotest_common.sh@10 -- # set +x 00:05:56.898 { 00:05:56.898 "filename": "/tmp/spdk_mem_dump.txt" 00:05:56.898 } 00:05:56.898 02:17:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:56.898 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:56.898 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:56.898 1 heaps totaling size 814.000000 MiB 00:05:56.898 size: 814.000000 MiB heap id: 0 00:05:56.898 end heaps---------- 00:05:56.898 8 mempools totaling size 598.116089 MiB 00:05:56.898 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:56.898 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:56.898 size: 84.521057 MiB name: bdev_io_1947865 00:05:56.898 size: 51.011292 MiB name: evtpool_1947865 00:05:56.898 size: 50.003479 MiB name: msgpool_1947865 00:05:56.898 size: 21.763794 MiB name: PDU_Pool 00:05:56.898 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:56.898 size: 0.026123 MiB name: Session_Pool 00:05:56.898 end mempools------- 00:05:56.898 6 memzones totaling size 4.142822 MiB 00:05:56.898 size: 1.000366 MiB name: RG_ring_0_1947865 00:05:56.898 size: 1.000366 MiB name: RG_ring_1_1947865 00:05:56.898 size: 1.000366 MiB name: RG_ring_4_1947865 00:05:56.898 size: 1.000366 MiB name: RG_ring_5_1947865 00:05:56.898 size: 0.125366 MiB name: RG_ring_2_1947865 00:05:56.898 size: 0.015991 MiB name: RG_ring_3_1947865 00:05:56.898 end memzones------- 00:05:56.898 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:56.898 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:56.898 list of free elements. size: 12.519348 MiB 00:05:56.898 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:56.898 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:56.898 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:56.898 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:56.898 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:56.898 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:56.898 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:56.898 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:56.898 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:56.898 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:56.898 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:56.898 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:56.898 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:56.898 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:56.898 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:56.898 list of standard malloc elements. size: 199.218079 MiB 00:05:56.898 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:56.898 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:56.898 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:56.898 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:56.898 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:56.898 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:56.898 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:56.898 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:56.898 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:56.898 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:56.898 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:56.898 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:56.898 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:56.898 list of memzone associated elements. size: 602.262573 MiB 00:05:56.898 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:56.898 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:56.898 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:56.898 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:56.898 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:56.898 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1947865_0 00:05:56.898 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:56.898 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1947865_0 00:05:56.898 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:56.898 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1947865_0 00:05:56.898 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:56.898 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:56.898 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:56.898 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:56.898 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:56.898 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1947865 00:05:56.898 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:56.898 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1947865 00:05:56.898 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:56.898 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1947865 00:05:56.898 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:56.898 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:56.898 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:56.898 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:56.898 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:56.898 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:56.898 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:56.898 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:56.898 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:56.898 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1947865 00:05:56.898 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:56.899 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1947865 00:05:56.899 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:56.899 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1947865 00:05:56.899 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:56.899 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1947865 00:05:56.899 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:56.899 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1947865 00:05:56.899 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:56.899 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:56.899 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:56.899 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:56.899 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:56.899 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:56.899 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:56.899 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1947865 00:05:56.899 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:56.899 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:56.899 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:56.899 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:56.899 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:56.899 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1947865 00:05:56.899 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:56.899 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:56.899 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:56.899 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1947865 00:05:56.899 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:56.899 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1947865 00:05:56.899 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:56.899 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:56.899 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:56.899 02:17:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1947865 00:05:56.899 02:17:21 -- common/autotest_common.sh@936 -- # '[' -z 1947865 ']' 00:05:56.899 02:17:21 -- common/autotest_common.sh@940 -- # kill -0 1947865 00:05:56.899 02:17:21 -- common/autotest_common.sh@941 -- # uname 00:05:56.899 02:17:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:56.899 02:17:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1947865 00:05:56.899 02:17:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:56.899 02:17:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:56.899 02:17:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1947865' 00:05:56.899 killing process with pid 1947865 00:05:56.899 02:17:21 -- common/autotest_common.sh@955 -- # kill 1947865 00:05:56.899 02:17:21 -- common/autotest_common.sh@960 -- # wait 1947865 00:05:57.465 00:05:57.465 real 0m1.700s 00:05:57.465 user 0m1.867s 00:05:57.465 sys 0m0.456s 00:05:57.465 02:17:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.465 02:17:21 -- common/autotest_common.sh@10 -- # set +x 00:05:57.465 ************************************ 00:05:57.465 END TEST dpdk_mem_utility 00:05:57.465 ************************************ 00:05:57.465 02:17:21 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:57.465 02:17:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.465 02:17:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.465 02:17:21 -- common/autotest_common.sh@10 -- # set +x 00:05:57.465 ************************************ 00:05:57.465 START TEST event 00:05:57.465 ************************************ 00:05:57.465 02:17:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:57.465 * Looking for test storage... 00:05:57.465 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:57.465 02:17:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:57.465 02:17:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:57.465 02:17:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:57.465 02:17:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:57.465 02:17:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:57.465 02:17:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:57.465 02:17:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:57.465 02:17:22 -- scripts/common.sh@335 -- # IFS=.-: 00:05:57.465 02:17:22 -- scripts/common.sh@335 -- # read -ra ver1 00:05:57.465 02:17:22 -- scripts/common.sh@336 -- # IFS=.-: 00:05:57.465 02:17:22 -- scripts/common.sh@336 -- # read -ra ver2 00:05:57.465 02:17:22 -- scripts/common.sh@337 -- # local 'op=<' 00:05:57.465 02:17:22 -- scripts/common.sh@339 -- # ver1_l=2 00:05:57.465 02:17:22 -- scripts/common.sh@340 -- # ver2_l=1 00:05:57.465 02:17:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:57.465 02:17:22 -- scripts/common.sh@343 -- # case "$op" in 00:05:57.465 02:17:22 -- scripts/common.sh@344 -- # : 1 00:05:57.465 02:17:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:57.465 02:17:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:57.465 02:17:22 -- scripts/common.sh@364 -- # decimal 1 00:05:57.465 02:17:22 -- scripts/common.sh@352 -- # local d=1 00:05:57.465 02:17:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:57.465 02:17:22 -- scripts/common.sh@354 -- # echo 1 00:05:57.465 02:17:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:57.465 02:17:22 -- scripts/common.sh@365 -- # decimal 2 00:05:57.465 02:17:22 -- scripts/common.sh@352 -- # local d=2 00:05:57.465 02:17:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:57.465 02:17:22 -- scripts/common.sh@354 -- # echo 2 00:05:57.465 02:17:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:57.465 02:17:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:57.465 02:17:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:57.465 02:17:22 -- scripts/common.sh@367 -- # return 0 00:05:57.465 02:17:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:57.465 02:17:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:57.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.465 --rc genhtml_branch_coverage=1 00:05:57.465 --rc genhtml_function_coverage=1 00:05:57.465 --rc genhtml_legend=1 00:05:57.465 --rc geninfo_all_blocks=1 00:05:57.465 --rc geninfo_unexecuted_blocks=1 00:05:57.465 00:05:57.465 ' 00:05:57.465 02:17:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:57.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.465 --rc genhtml_branch_coverage=1 00:05:57.465 --rc genhtml_function_coverage=1 00:05:57.465 --rc genhtml_legend=1 00:05:57.465 --rc geninfo_all_blocks=1 00:05:57.465 --rc geninfo_unexecuted_blocks=1 00:05:57.465 00:05:57.465 ' 00:05:57.465 02:17:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:57.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.465 --rc genhtml_branch_coverage=1 00:05:57.465 --rc genhtml_function_coverage=1 00:05:57.465 --rc genhtml_legend=1 00:05:57.465 --rc geninfo_all_blocks=1 00:05:57.465 --rc geninfo_unexecuted_blocks=1 00:05:57.465 00:05:57.465 ' 00:05:57.465 02:17:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:57.465 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.465 --rc genhtml_branch_coverage=1 00:05:57.465 --rc genhtml_function_coverage=1 00:05:57.465 --rc genhtml_legend=1 00:05:57.465 --rc geninfo_all_blocks=1 00:05:57.465 --rc geninfo_unexecuted_blocks=1 00:05:57.465 00:05:57.465 ' 00:05:57.466 02:17:22 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:57.466 02:17:22 -- bdev/nbd_common.sh@6 -- # set -e 00:05:57.466 02:17:22 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:57.466 02:17:22 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:57.466 02:17:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.466 02:17:22 -- common/autotest_common.sh@10 -- # set +x 00:05:57.466 ************************************ 00:05:57.466 START TEST event_perf 00:05:57.466 ************************************ 00:05:57.466 02:17:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:57.466 Running I/O for 1 seconds...[2024-11-27 02:17:22.038523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:57.466 [2024-11-27 02:17:22.038640] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1948075 ] 00:05:57.466 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.724 [2024-11-27 02:17:22.099162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:57.724 [2024-11-27 02:17:22.192242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.724 [2024-11-27 02:17:22.192310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:57.724 [2024-11-27 02:17:22.192400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:57.724 [2024-11-27 02:17:22.192403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.658 Running I/O for 1 seconds... 00:05:58.658 lcore 0: 229584 00:05:58.658 lcore 1: 229582 00:05:58.658 lcore 2: 229582 00:05:58.659 lcore 3: 229582 00:05:58.659 done. 00:05:58.659 00:05:58.659 real 0m1.247s 00:05:58.659 user 0m4.156s 00:05:58.659 sys 0m0.089s 00:05:58.659 02:17:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.659 02:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:58.659 ************************************ 00:05:58.659 END TEST event_perf 00:05:58.659 ************************************ 00:05:58.917 02:17:23 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:58.917 02:17:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:58.917 02:17:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.917 02:17:23 -- common/autotest_common.sh@10 -- # set +x 00:05:58.917 ************************************ 00:05:58.917 START TEST event_reactor 00:05:58.917 ************************************ 00:05:58.917 02:17:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:58.917 [2024-11-27 02:17:23.313389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:58.917 [2024-11-27 02:17:23.313476] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1948263 ] 00:05:58.917 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.917 [2024-11-27 02:17:23.376930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.917 [2024-11-27 02:17:23.467543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.289 test_start 00:06:00.289 oneshot 00:06:00.289 tick 100 00:06:00.289 tick 100 00:06:00.289 tick 250 00:06:00.289 tick 100 00:06:00.289 tick 100 00:06:00.289 tick 100 00:06:00.289 tick 250 00:06:00.289 tick 500 00:06:00.289 tick 100 00:06:00.289 tick 100 00:06:00.289 tick 250 00:06:00.289 tick 100 00:06:00.289 tick 100 00:06:00.289 test_end 00:06:00.289 00:06:00.289 real 0m1.249s 00:06:00.289 user 0m1.154s 00:06:00.289 sys 0m0.090s 00:06:00.289 02:17:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.289 02:17:24 -- common/autotest_common.sh@10 -- # set +x 00:06:00.289 ************************************ 00:06:00.289 END TEST event_reactor 00:06:00.289 ************************************ 00:06:00.289 02:17:24 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:00.289 02:17:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:00.289 02:17:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.289 02:17:24 -- common/autotest_common.sh@10 -- # set +x 00:06:00.289 ************************************ 00:06:00.289 START TEST event_reactor_perf 00:06:00.289 ************************************ 00:06:00.289 02:17:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:00.289 [2024-11-27 02:17:24.583733] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:00.289 [2024-11-27 02:17:24.583807] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1948510 ] 00:06:00.289 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.289 [2024-11-27 02:17:24.644775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.289 [2024-11-27 02:17:24.735203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.223 test_start 00:06:01.223 test_end 00:06:01.223 Performance: 352788 events per second 00:06:01.223 00:06:01.223 real 0m1.243s 00:06:01.223 user 0m1.153s 00:06:01.223 sys 0m0.085s 00:06:01.223 02:17:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.223 02:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:01.223 ************************************ 00:06:01.223 END TEST event_reactor_perf 00:06:01.223 ************************************ 00:06:01.223 02:17:25 -- event/event.sh@49 -- # uname -s 00:06:01.223 02:17:25 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:01.223 02:17:25 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:01.223 02:17:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:01.223 02:17:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.223 02:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:01.224 ************************************ 00:06:01.224 START TEST event_scheduler 00:06:01.224 ************************************ 00:06:01.224 02:17:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:01.482 * Looking for test storage... 00:06:01.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:01.482 02:17:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:01.482 02:17:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:01.482 02:17:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:01.482 02:17:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:01.482 02:17:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:01.482 02:17:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:01.482 02:17:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:01.482 02:17:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:01.482 02:17:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:01.482 02:17:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:01.482 02:17:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:01.482 02:17:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:01.482 02:17:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:01.482 02:17:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:01.482 02:17:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:01.482 02:17:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:01.482 02:17:25 -- scripts/common.sh@344 -- # : 1 00:06:01.482 02:17:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:01.482 02:17:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:01.482 02:17:25 -- scripts/common.sh@364 -- # decimal 1 00:06:01.482 02:17:25 -- scripts/common.sh@352 -- # local d=1 00:06:01.482 02:17:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:01.482 02:17:25 -- scripts/common.sh@354 -- # echo 1 00:06:01.482 02:17:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:01.482 02:17:25 -- scripts/common.sh@365 -- # decimal 2 00:06:01.482 02:17:25 -- scripts/common.sh@352 -- # local d=2 00:06:01.482 02:17:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:01.482 02:17:25 -- scripts/common.sh@354 -- # echo 2 00:06:01.482 02:17:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:01.482 02:17:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:01.482 02:17:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:01.482 02:17:25 -- scripts/common.sh@367 -- # return 0 00:06:01.482 02:17:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:01.482 02:17:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:01.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.482 --rc genhtml_branch_coverage=1 00:06:01.482 --rc genhtml_function_coverage=1 00:06:01.482 --rc genhtml_legend=1 00:06:01.482 --rc geninfo_all_blocks=1 00:06:01.482 --rc geninfo_unexecuted_blocks=1 00:06:01.482 00:06:01.482 ' 00:06:01.482 02:17:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:01.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.482 --rc genhtml_branch_coverage=1 00:06:01.482 --rc genhtml_function_coverage=1 00:06:01.482 --rc genhtml_legend=1 00:06:01.482 --rc geninfo_all_blocks=1 00:06:01.482 --rc geninfo_unexecuted_blocks=1 00:06:01.482 00:06:01.482 ' 00:06:01.482 02:17:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:01.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.482 --rc genhtml_branch_coverage=1 00:06:01.482 --rc genhtml_function_coverage=1 00:06:01.482 --rc genhtml_legend=1 00:06:01.482 --rc geninfo_all_blocks=1 00:06:01.482 --rc geninfo_unexecuted_blocks=1 00:06:01.482 00:06:01.482 ' 00:06:01.482 02:17:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:01.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:01.482 --rc genhtml_branch_coverage=1 00:06:01.482 --rc genhtml_function_coverage=1 00:06:01.482 --rc genhtml_legend=1 00:06:01.482 --rc geninfo_all_blocks=1 00:06:01.482 --rc geninfo_unexecuted_blocks=1 00:06:01.482 00:06:01.482 ' 00:06:01.482 02:17:25 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:01.482 02:17:25 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1948699 00:06:01.482 02:17:25 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:01.482 02:17:25 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:01.482 02:17:25 -- scheduler/scheduler.sh@37 -- # waitforlisten 1948699 00:06:01.482 02:17:25 -- common/autotest_common.sh@829 -- # '[' -z 1948699 ']' 00:06:01.482 02:17:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:01.482 02:17:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:01.482 02:17:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:01.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:01.482 02:17:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:01.482 02:17:25 -- common/autotest_common.sh@10 -- # set +x 00:06:01.482 [2024-11-27 02:17:26.019673] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:01.482 [2024-11-27 02:17:26.019773] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1948699 ] 00:06:01.482 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.482 [2024-11-27 02:17:26.078793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:01.741 [2024-11-27 02:17:26.162989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.741 [2024-11-27 02:17:26.163047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:01.741 [2024-11-27 02:17:26.163109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:01.741 [2024-11-27 02:17:26.163113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:01.741 02:17:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:01.741 02:17:26 -- common/autotest_common.sh@862 -- # return 0 00:06:01.741 02:17:26 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:01.741 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.741 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:01.741 POWER: Env isn't set yet! 00:06:01.741 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:01.741 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:01.741 POWER: Cannot get available frequencies of lcore 0 00:06:01.741 POWER: Attempting to initialise PSTAT power management... 00:06:01.741 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:01.741 POWER: Initialized successfully for lcore 0 power management 00:06:01.741 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:01.741 POWER: Initialized successfully for lcore 1 power management 00:06:01.741 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:01.741 POWER: Initialized successfully for lcore 2 power management 00:06:01.741 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:01.741 POWER: Initialized successfully for lcore 3 power management 00:06:01.741 [2024-11-27 02:17:26.290719] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:01.741 [2024-11-27 02:17:26.290738] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:01.741 [2024-11-27 02:17:26.290749] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:01.741 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:01.741 02:17:26 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:01.741 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:01.741 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 [2024-11-27 02:17:26.388099] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:02.000 02:17:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:02.000 02:17:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 ************************************ 00:06:02.000 START TEST scheduler_create_thread 00:06:02.000 ************************************ 00:06:02.000 02:17:26 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 2 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 3 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 4 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 5 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 6 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 7 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 8 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 9 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 10 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:02.000 02:17:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:02.000 02:17:26 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:02.000 02:17:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:02.000 02:17:26 -- common/autotest_common.sh@10 -- # set +x 00:06:03.375 02:17:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:03.375 02:17:27 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:03.375 02:17:27 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:03.375 02:17:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:03.375 02:17:27 -- common/autotest_common.sh@10 -- # set +x 00:06:04.749 02:17:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.749 00:06:04.749 real 0m2.620s 00:06:04.749 user 0m0.012s 00:06:04.749 sys 0m0.002s 00:06:04.749 02:17:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.749 02:17:29 -- common/autotest_common.sh@10 -- # set +x 00:06:04.749 ************************************ 00:06:04.749 END TEST scheduler_create_thread 00:06:04.749 ************************************ 00:06:04.749 02:17:29 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:04.749 02:17:29 -- scheduler/scheduler.sh@46 -- # killprocess 1948699 00:06:04.749 02:17:29 -- common/autotest_common.sh@936 -- # '[' -z 1948699 ']' 00:06:04.749 02:17:29 -- common/autotest_common.sh@940 -- # kill -0 1948699 00:06:04.749 02:17:29 -- common/autotest_common.sh@941 -- # uname 00:06:04.749 02:17:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.749 02:17:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1948699 00:06:04.749 02:17:29 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:04.749 02:17:29 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:04.749 02:17:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1948699' 00:06:04.749 killing process with pid 1948699 00:06:04.749 02:17:29 -- common/autotest_common.sh@955 -- # kill 1948699 00:06:04.749 02:17:29 -- common/autotest_common.sh@960 -- # wait 1948699 00:06:05.006 [2024-11-27 02:17:29.495215] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:05.006 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:05.006 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:05.006 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:05.006 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:05.006 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:05.006 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:05.006 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:05.006 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:05.264 00:06:05.264 real 0m3.874s 00:06:05.264 user 0m5.913s 00:06:05.264 sys 0m0.325s 00:06:05.264 02:17:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.264 02:17:29 -- common/autotest_common.sh@10 -- # set +x 00:06:05.264 ************************************ 00:06:05.264 END TEST event_scheduler 00:06:05.264 ************************************ 00:06:05.264 02:17:29 -- event/event.sh@51 -- # modprobe -n nbd 00:06:05.264 02:17:29 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:05.264 02:17:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.264 02:17:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.264 02:17:29 -- common/autotest_common.sh@10 -- # set +x 00:06:05.264 ************************************ 00:06:05.264 START TEST app_repeat 00:06:05.264 ************************************ 00:06:05.264 02:17:29 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:05.264 02:17:29 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:05.264 02:17:29 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:05.264 02:17:29 -- event/event.sh@13 -- # local nbd_list 00:06:05.264 02:17:29 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:05.264 02:17:29 -- event/event.sh@14 -- # local bdev_list 00:06:05.264 02:17:29 -- event/event.sh@15 -- # local repeat_times=4 00:06:05.264 02:17:29 -- event/event.sh@17 -- # modprobe nbd 00:06:05.264 02:17:29 -- event/event.sh@19 -- # repeat_pid=1949165 00:06:05.264 02:17:29 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:05.264 02:17:29 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:05.264 02:17:29 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1949165' 00:06:05.264 Process app_repeat pid: 1949165 00:06:05.264 02:17:29 -- event/event.sh@23 -- # for i in {0..2} 00:06:05.264 02:17:29 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:05.264 spdk_app_start Round 0 00:06:05.264 02:17:29 -- event/event.sh@25 -- # waitforlisten 1949165 /var/tmp/spdk-nbd.sock 00:06:05.264 02:17:29 -- common/autotest_common.sh@829 -- # '[' -z 1949165 ']' 00:06:05.264 02:17:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:05.264 02:17:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.264 02:17:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:05.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:05.264 02:17:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.264 02:17:29 -- common/autotest_common.sh@10 -- # set +x 00:06:05.264 [2024-11-27 02:17:29.781097] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:05.264 [2024-11-27 02:17:29.781172] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1949165 ] 00:06:05.264 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.264 [2024-11-27 02:17:29.840465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:05.521 [2024-11-27 02:17:29.930254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:05.521 [2024-11-27 02:17:29.930258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.455 02:17:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.455 02:17:30 -- common/autotest_common.sh@862 -- # return 0 00:06:06.455 02:17:30 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:06.455 Malloc0 00:06:06.455 02:17:31 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:06.713 Malloc1 00:06:06.713 02:17:31 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@12 -- # local i 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:06.713 02:17:31 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:06.971 /dev/nbd0 00:06:06.971 02:17:31 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:06.971 02:17:31 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:06.971 02:17:31 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:06.971 02:17:31 -- common/autotest_common.sh@867 -- # local i 00:06:06.971 02:17:31 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:06.971 02:17:31 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:06.971 02:17:31 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:06.971 02:17:31 -- common/autotest_common.sh@871 -- # break 00:06:06.971 02:17:31 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:06.971 02:17:31 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:06.971 02:17:31 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:06.971 1+0 records in 00:06:06.971 1+0 records out 00:06:06.971 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000213601 s, 19.2 MB/s 00:06:06.971 02:17:31 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:07.229 02:17:31 -- common/autotest_common.sh@884 -- # size=4096 00:06:07.229 02:17:31 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:07.229 02:17:31 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:07.229 02:17:31 -- common/autotest_common.sh@887 -- # return 0 00:06:07.229 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:07.229 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.229 02:17:31 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:07.488 /dev/nbd1 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:07.489 02:17:31 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:07.489 02:17:31 -- common/autotest_common.sh@867 -- # local i 00:06:07.489 02:17:31 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:07.489 02:17:31 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:07.489 02:17:31 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:07.489 02:17:31 -- common/autotest_common.sh@871 -- # break 00:06:07.489 02:17:31 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:07.489 02:17:31 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:07.489 02:17:31 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:07.489 1+0 records in 00:06:07.489 1+0 records out 00:06:07.489 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000150334 s, 27.2 MB/s 00:06:07.489 02:17:31 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:07.489 02:17:31 -- common/autotest_common.sh@884 -- # size=4096 00:06:07.489 02:17:31 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:07.489 02:17:31 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:07.489 02:17:31 -- common/autotest_common.sh@887 -- # return 0 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.489 02:17:31 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:07.773 { 00:06:07.773 "nbd_device": "/dev/nbd0", 00:06:07.773 "bdev_name": "Malloc0" 00:06:07.773 }, 00:06:07.773 { 00:06:07.773 "nbd_device": "/dev/nbd1", 00:06:07.773 "bdev_name": "Malloc1" 00:06:07.773 } 00:06:07.773 ]' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:07.773 { 00:06:07.773 "nbd_device": "/dev/nbd0", 00:06:07.773 "bdev_name": "Malloc0" 00:06:07.773 }, 00:06:07.773 { 00:06:07.773 "nbd_device": "/dev/nbd1", 00:06:07.773 "bdev_name": "Malloc1" 00:06:07.773 } 00:06:07.773 ]' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:07.773 /dev/nbd1' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:07.773 /dev/nbd1' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@65 -- # count=2 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@95 -- # count=2 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:07.773 256+0 records in 00:06:07.773 256+0 records out 00:06:07.773 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506279 s, 207 MB/s 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:07.773 256+0 records in 00:06:07.773 256+0 records out 00:06:07.773 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025678 s, 40.8 MB/s 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:07.773 256+0 records in 00:06:07.773 256+0 records out 00:06:07.773 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236861 s, 44.3 MB/s 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:07.773 02:17:32 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@51 -- # local i 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:07.774 02:17:32 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@41 -- # break 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.046 02:17:32 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@41 -- # break 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.306 02:17:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@65 -- # true 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@65 -- # count=0 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@104 -- # count=0 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:08.564 02:17:33 -- bdev/nbd_common.sh@109 -- # return 0 00:06:08.564 02:17:33 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:08.821 02:17:33 -- event/event.sh@35 -- # sleep 3 00:06:09.079 [2024-11-27 02:17:33.630276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:09.337 [2024-11-27 02:17:33.719308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.337 [2024-11-27 02:17:33.719308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.337 [2024-11-27 02:17:33.780998] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:09.337 [2024-11-27 02:17:33.781066] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:11.863 02:17:36 -- event/event.sh@23 -- # for i in {0..2} 00:06:11.863 02:17:36 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:11.863 spdk_app_start Round 1 00:06:11.863 02:17:36 -- event/event.sh@25 -- # waitforlisten 1949165 /var/tmp/spdk-nbd.sock 00:06:11.863 02:17:36 -- common/autotest_common.sh@829 -- # '[' -z 1949165 ']' 00:06:11.863 02:17:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:11.863 02:17:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.863 02:17:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:11.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:11.863 02:17:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.863 02:17:36 -- common/autotest_common.sh@10 -- # set +x 00:06:12.120 02:17:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.120 02:17:36 -- common/autotest_common.sh@862 -- # return 0 00:06:12.120 02:17:36 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:12.378 Malloc0 00:06:12.378 02:17:36 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:12.636 Malloc1 00:06:12.636 02:17:37 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@12 -- # local i 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:12.636 02:17:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:12.894 /dev/nbd0 00:06:12.894 02:17:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:12.894 02:17:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:12.894 02:17:37 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:12.894 02:17:37 -- common/autotest_common.sh@867 -- # local i 00:06:12.894 02:17:37 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:12.894 02:17:37 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:12.894 02:17:37 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:12.894 02:17:37 -- common/autotest_common.sh@871 -- # break 00:06:12.894 02:17:37 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:12.894 02:17:37 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:12.894 02:17:37 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:12.894 1+0 records in 00:06:12.894 1+0 records out 00:06:12.894 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000176623 s, 23.2 MB/s 00:06:12.894 02:17:37 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:12.894 02:17:37 -- common/autotest_common.sh@884 -- # size=4096 00:06:12.894 02:17:37 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:12.894 02:17:37 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:12.894 02:17:37 -- common/autotest_common.sh@887 -- # return 0 00:06:12.894 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:12.894 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:12.894 02:17:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:13.152 /dev/nbd1 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:13.152 02:17:37 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:13.152 02:17:37 -- common/autotest_common.sh@867 -- # local i 00:06:13.152 02:17:37 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:13.152 02:17:37 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:13.152 02:17:37 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:13.152 02:17:37 -- common/autotest_common.sh@871 -- # break 00:06:13.152 02:17:37 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:13.152 02:17:37 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:13.152 02:17:37 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:13.152 1+0 records in 00:06:13.152 1+0 records out 00:06:13.152 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000202599 s, 20.2 MB/s 00:06:13.152 02:17:37 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:13.152 02:17:37 -- common/autotest_common.sh@884 -- # size=4096 00:06:13.152 02:17:37 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:13.152 02:17:37 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:13.152 02:17:37 -- common/autotest_common.sh@887 -- # return 0 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:13.152 02:17:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:13.410 02:17:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:13.410 { 00:06:13.410 "nbd_device": "/dev/nbd0", 00:06:13.410 "bdev_name": "Malloc0" 00:06:13.410 }, 00:06:13.410 { 00:06:13.410 "nbd_device": "/dev/nbd1", 00:06:13.410 "bdev_name": "Malloc1" 00:06:13.410 } 00:06:13.410 ]' 00:06:13.410 02:17:38 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:13.410 { 00:06:13.410 "nbd_device": "/dev/nbd0", 00:06:13.410 "bdev_name": "Malloc0" 00:06:13.410 }, 00:06:13.410 { 00:06:13.410 "nbd_device": "/dev/nbd1", 00:06:13.410 "bdev_name": "Malloc1" 00:06:13.410 } 00:06:13.410 ]' 00:06:13.410 02:17:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:13.668 /dev/nbd1' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:13.668 /dev/nbd1' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@65 -- # count=2 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@95 -- # count=2 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:13.668 256+0 records in 00:06:13.668 256+0 records out 00:06:13.668 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00412839 s, 254 MB/s 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:13.668 256+0 records in 00:06:13.668 256+0 records out 00:06:13.668 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233089 s, 45.0 MB/s 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:13.668 256+0 records in 00:06:13.668 256+0 records out 00:06:13.668 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272679 s, 38.5 MB/s 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:13.668 02:17:38 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@51 -- # local i 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:13.669 02:17:38 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@41 -- # break 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@45 -- # return 0 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:13.926 02:17:38 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@41 -- # break 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@45 -- # return 0 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.184 02:17:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@65 -- # true 00:06:14.442 02:17:38 -- bdev/nbd_common.sh@65 -- # count=0 00:06:14.443 02:17:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:14.443 02:17:38 -- bdev/nbd_common.sh@104 -- # count=0 00:06:14.443 02:17:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:14.443 02:17:38 -- bdev/nbd_common.sh@109 -- # return 0 00:06:14.443 02:17:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:14.699 02:17:39 -- event/event.sh@35 -- # sleep 3 00:06:14.956 [2024-11-27 02:17:39.492477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:14.956 [2024-11-27 02:17:39.580247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:14.956 [2024-11-27 02:17:39.580252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.214 [2024-11-27 02:17:39.640115] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:15.214 [2024-11-27 02:17:39.640184] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:17.742 02:17:42 -- event/event.sh@23 -- # for i in {0..2} 00:06:17.742 02:17:42 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:17.742 spdk_app_start Round 2 00:06:17.742 02:17:42 -- event/event.sh@25 -- # waitforlisten 1949165 /var/tmp/spdk-nbd.sock 00:06:17.742 02:17:42 -- common/autotest_common.sh@829 -- # '[' -z 1949165 ']' 00:06:17.742 02:17:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:17.742 02:17:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.742 02:17:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:17.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:17.742 02:17:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.742 02:17:42 -- common/autotest_common.sh@10 -- # set +x 00:06:17.999 02:17:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:18.000 02:17:42 -- common/autotest_common.sh@862 -- # return 0 00:06:18.000 02:17:42 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:18.258 Malloc0 00:06:18.258 02:17:42 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:18.516 Malloc1 00:06:18.516 02:17:43 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@12 -- # local i 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:18.516 02:17:43 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:18.774 /dev/nbd0 00:06:18.774 02:17:43 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:18.774 02:17:43 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:18.774 02:17:43 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:18.774 02:17:43 -- common/autotest_common.sh@867 -- # local i 00:06:18.774 02:17:43 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:18.774 02:17:43 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:18.774 02:17:43 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:18.774 02:17:43 -- common/autotest_common.sh@871 -- # break 00:06:18.774 02:17:43 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:18.774 02:17:43 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:18.774 02:17:43 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:18.774 1+0 records in 00:06:18.774 1+0 records out 00:06:18.774 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200754 s, 20.4 MB/s 00:06:18.774 02:17:43 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:18.774 02:17:43 -- common/autotest_common.sh@884 -- # size=4096 00:06:18.774 02:17:43 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:18.774 02:17:43 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:18.774 02:17:43 -- common/autotest_common.sh@887 -- # return 0 00:06:18.774 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:18.774 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:18.774 02:17:43 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:19.033 /dev/nbd1 00:06:19.033 02:17:43 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:19.033 02:17:43 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:19.033 02:17:43 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:19.033 02:17:43 -- common/autotest_common.sh@867 -- # local i 00:06:19.033 02:17:43 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:19.033 02:17:43 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:19.033 02:17:43 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:19.033 02:17:43 -- common/autotest_common.sh@871 -- # break 00:06:19.034 02:17:43 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:19.034 02:17:43 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:19.034 02:17:43 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:19.034 1+0 records in 00:06:19.034 1+0 records out 00:06:19.034 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000219787 s, 18.6 MB/s 00:06:19.034 02:17:43 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:19.034 02:17:43 -- common/autotest_common.sh@884 -- # size=4096 00:06:19.034 02:17:43 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:19.034 02:17:43 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:19.034 02:17:43 -- common/autotest_common.sh@887 -- # return 0 00:06:19.034 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:19.034 02:17:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:19.034 02:17:43 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:19.034 02:17:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:19.034 02:17:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:19.292 02:17:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:19.292 { 00:06:19.292 "nbd_device": "/dev/nbd0", 00:06:19.292 "bdev_name": "Malloc0" 00:06:19.292 }, 00:06:19.292 { 00:06:19.292 "nbd_device": "/dev/nbd1", 00:06:19.292 "bdev_name": "Malloc1" 00:06:19.292 } 00:06:19.292 ]' 00:06:19.292 02:17:43 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:19.292 { 00:06:19.292 "nbd_device": "/dev/nbd0", 00:06:19.292 "bdev_name": "Malloc0" 00:06:19.292 }, 00:06:19.292 { 00:06:19.292 "nbd_device": "/dev/nbd1", 00:06:19.292 "bdev_name": "Malloc1" 00:06:19.292 } 00:06:19.292 ]' 00:06:19.292 02:17:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:19.550 /dev/nbd1' 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:19.550 /dev/nbd1' 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@65 -- # count=2 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@95 -- # count=2 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:19.550 256+0 records in 00:06:19.550 256+0 records out 00:06:19.550 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508706 s, 206 MB/s 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:19.550 256+0 records in 00:06:19.550 256+0 records out 00:06:19.550 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261965 s, 40.0 MB/s 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:19.550 02:17:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:19.550 256+0 records in 00:06:19.550 256+0 records out 00:06:19.550 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252251 s, 41.6 MB/s 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@51 -- # local i 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:19.550 02:17:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@41 -- # break 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@45 -- # return 0 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:19.809 02:17:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@41 -- # break 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@45 -- # return 0 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.067 02:17:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@65 -- # true 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@65 -- # count=0 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@104 -- # count=0 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:20.325 02:17:44 -- bdev/nbd_common.sh@109 -- # return 0 00:06:20.325 02:17:44 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:20.582 02:17:45 -- event/event.sh@35 -- # sleep 3 00:06:20.840 [2024-11-27 02:17:45.388299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:21.099 [2024-11-27 02:17:45.477268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.099 [2024-11-27 02:17:45.477272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.099 [2024-11-27 02:17:45.538895] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:21.099 [2024-11-27 02:17:45.538988] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:23.628 02:17:48 -- event/event.sh@38 -- # waitforlisten 1949165 /var/tmp/spdk-nbd.sock 00:06:23.628 02:17:48 -- common/autotest_common.sh@829 -- # '[' -z 1949165 ']' 00:06:23.628 02:17:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:23.628 02:17:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.628 02:17:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:23.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:23.628 02:17:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.628 02:17:48 -- common/autotest_common.sh@10 -- # set +x 00:06:23.886 02:17:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.886 02:17:48 -- common/autotest_common.sh@862 -- # return 0 00:06:23.886 02:17:48 -- event/event.sh@39 -- # killprocess 1949165 00:06:23.886 02:17:48 -- common/autotest_common.sh@936 -- # '[' -z 1949165 ']' 00:06:23.886 02:17:48 -- common/autotest_common.sh@940 -- # kill -0 1949165 00:06:23.886 02:17:48 -- common/autotest_common.sh@941 -- # uname 00:06:23.886 02:17:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.886 02:17:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1949165 00:06:23.886 02:17:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.886 02:17:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.886 02:17:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1949165' 00:06:23.886 killing process with pid 1949165 00:06:23.886 02:17:48 -- common/autotest_common.sh@955 -- # kill 1949165 00:06:23.886 02:17:48 -- common/autotest_common.sh@960 -- # wait 1949165 00:06:24.145 spdk_app_start is called in Round 0. 00:06:24.145 Shutdown signal received, stop current app iteration 00:06:24.145 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:24.145 spdk_app_start is called in Round 1. 00:06:24.145 Shutdown signal received, stop current app iteration 00:06:24.145 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:24.145 spdk_app_start is called in Round 2. 00:06:24.145 Shutdown signal received, stop current app iteration 00:06:24.145 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:24.145 spdk_app_start is called in Round 3. 00:06:24.145 Shutdown signal received, stop current app iteration 00:06:24.145 02:17:48 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:24.145 02:17:48 -- event/event.sh@42 -- # return 0 00:06:24.145 00:06:24.145 real 0m18.907s 00:06:24.145 user 0m41.519s 00:06:24.145 sys 0m3.206s 00:06:24.145 02:17:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.145 02:17:48 -- common/autotest_common.sh@10 -- # set +x 00:06:24.145 ************************************ 00:06:24.145 END TEST app_repeat 00:06:24.145 ************************************ 00:06:24.145 02:17:48 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:24.145 02:17:48 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:24.145 02:17:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.145 02:17:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.145 02:17:48 -- common/autotest_common.sh@10 -- # set +x 00:06:24.145 ************************************ 00:06:24.145 START TEST cpu_locks 00:06:24.145 ************************************ 00:06:24.145 02:17:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:24.145 * Looking for test storage... 00:06:24.145 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:24.145 02:17:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:24.145 02:17:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:24.145 02:17:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:24.404 02:17:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:24.404 02:17:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:24.404 02:17:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:24.404 02:17:48 -- scripts/common.sh@335 -- # IFS=.-: 00:06:24.404 02:17:48 -- scripts/common.sh@335 -- # read -ra ver1 00:06:24.404 02:17:48 -- scripts/common.sh@336 -- # IFS=.-: 00:06:24.404 02:17:48 -- scripts/common.sh@336 -- # read -ra ver2 00:06:24.404 02:17:48 -- scripts/common.sh@337 -- # local 'op=<' 00:06:24.404 02:17:48 -- scripts/common.sh@339 -- # ver1_l=2 00:06:24.404 02:17:48 -- scripts/common.sh@340 -- # ver2_l=1 00:06:24.404 02:17:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:24.404 02:17:48 -- scripts/common.sh@343 -- # case "$op" in 00:06:24.404 02:17:48 -- scripts/common.sh@344 -- # : 1 00:06:24.404 02:17:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:24.404 02:17:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:24.404 02:17:48 -- scripts/common.sh@364 -- # decimal 1 00:06:24.404 02:17:48 -- scripts/common.sh@352 -- # local d=1 00:06:24.404 02:17:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:24.404 02:17:48 -- scripts/common.sh@354 -- # echo 1 00:06:24.404 02:17:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:24.404 02:17:48 -- scripts/common.sh@365 -- # decimal 2 00:06:24.404 02:17:48 -- scripts/common.sh@352 -- # local d=2 00:06:24.404 02:17:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:24.404 02:17:48 -- scripts/common.sh@354 -- # echo 2 00:06:24.404 02:17:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:24.404 02:17:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:24.404 02:17:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:24.404 02:17:48 -- scripts/common.sh@367 -- # return 0 00:06:24.404 02:17:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:24.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.404 --rc genhtml_branch_coverage=1 00:06:24.404 --rc genhtml_function_coverage=1 00:06:24.404 --rc genhtml_legend=1 00:06:24.404 --rc geninfo_all_blocks=1 00:06:24.404 --rc geninfo_unexecuted_blocks=1 00:06:24.404 00:06:24.404 ' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:24.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.404 --rc genhtml_branch_coverage=1 00:06:24.404 --rc genhtml_function_coverage=1 00:06:24.404 --rc genhtml_legend=1 00:06:24.404 --rc geninfo_all_blocks=1 00:06:24.404 --rc geninfo_unexecuted_blocks=1 00:06:24.404 00:06:24.404 ' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:24.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.404 --rc genhtml_branch_coverage=1 00:06:24.404 --rc genhtml_function_coverage=1 00:06:24.404 --rc genhtml_legend=1 00:06:24.404 --rc geninfo_all_blocks=1 00:06:24.404 --rc geninfo_unexecuted_blocks=1 00:06:24.404 00:06:24.404 ' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:24.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.404 --rc genhtml_branch_coverage=1 00:06:24.404 --rc genhtml_function_coverage=1 00:06:24.404 --rc genhtml_legend=1 00:06:24.404 --rc geninfo_all_blocks=1 00:06:24.404 --rc geninfo_unexecuted_blocks=1 00:06:24.404 00:06:24.404 ' 00:06:24.404 02:17:48 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:24.404 02:17:48 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:24.404 02:17:48 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:24.404 02:17:48 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:24.404 02:17:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.404 02:17:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.404 02:17:48 -- common/autotest_common.sh@10 -- # set +x 00:06:24.404 ************************************ 00:06:24.404 START TEST default_locks 00:06:24.404 ************************************ 00:06:24.404 02:17:48 -- common/autotest_common.sh@1114 -- # default_locks 00:06:24.404 02:17:48 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1951725 00:06:24.404 02:17:48 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:24.404 02:17:48 -- event/cpu_locks.sh@47 -- # waitforlisten 1951725 00:06:24.404 02:17:48 -- common/autotest_common.sh@829 -- # '[' -z 1951725 ']' 00:06:24.404 02:17:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:24.404 02:17:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:24.404 02:17:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:24.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:24.404 02:17:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:24.404 02:17:48 -- common/autotest_common.sh@10 -- # set +x 00:06:24.404 [2024-11-27 02:17:48.882083] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:24.404 [2024-11-27 02:17:48.882162] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1951725 ] 00:06:24.404 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.404 [2024-11-27 02:17:48.944116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.663 [2024-11-27 02:17:49.040640] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:24.663 [2024-11-27 02:17:49.040813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.598 02:17:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.598 02:17:49 -- common/autotest_common.sh@862 -- # return 0 00:06:25.598 02:17:49 -- event/cpu_locks.sh@49 -- # locks_exist 1951725 00:06:25.598 02:17:49 -- event/cpu_locks.sh@22 -- # lslocks -p 1951725 00:06:25.598 02:17:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:25.598 lslocks: write error 00:06:25.598 02:17:50 -- event/cpu_locks.sh@50 -- # killprocess 1951725 00:06:25.598 02:17:50 -- common/autotest_common.sh@936 -- # '[' -z 1951725 ']' 00:06:25.598 02:17:50 -- common/autotest_common.sh@940 -- # kill -0 1951725 00:06:25.598 02:17:50 -- common/autotest_common.sh@941 -- # uname 00:06:25.598 02:17:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.598 02:17:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1951725 00:06:25.598 02:17:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.598 02:17:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.598 02:17:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1951725' 00:06:25.598 killing process with pid 1951725 00:06:25.598 02:17:50 -- common/autotest_common.sh@955 -- # kill 1951725 00:06:25.598 02:17:50 -- common/autotest_common.sh@960 -- # wait 1951725 00:06:26.164 02:17:50 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1951725 00:06:26.164 02:17:50 -- common/autotest_common.sh@650 -- # local es=0 00:06:26.164 02:17:50 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1951725 00:06:26.164 02:17:50 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:26.164 02:17:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.164 02:17:50 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:26.164 02:17:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.164 02:17:50 -- common/autotest_common.sh@653 -- # waitforlisten 1951725 00:06:26.164 02:17:50 -- common/autotest_common.sh@829 -- # '[' -z 1951725 ']' 00:06:26.164 02:17:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.164 02:17:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.164 02:17:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.164 02:17:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.164 02:17:50 -- common/autotest_common.sh@10 -- # set +x 00:06:26.164 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1951725) - No such process 00:06:26.164 ERROR: process (pid: 1951725) is no longer running 00:06:26.164 02:17:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.164 02:17:50 -- common/autotest_common.sh@862 -- # return 1 00:06:26.164 02:17:50 -- common/autotest_common.sh@653 -- # es=1 00:06:26.164 02:17:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:26.164 02:17:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:26.164 02:17:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:26.164 02:17:50 -- event/cpu_locks.sh@54 -- # no_locks 00:06:26.164 02:17:50 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:26.164 02:17:50 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:26.164 02:17:50 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:26.164 00:06:26.164 real 0m1.759s 00:06:26.164 user 0m1.970s 00:06:26.164 sys 0m0.580s 00:06:26.164 02:17:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.164 02:17:50 -- common/autotest_common.sh@10 -- # set +x 00:06:26.164 ************************************ 00:06:26.164 END TEST default_locks 00:06:26.164 ************************************ 00:06:26.164 02:17:50 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:26.164 02:17:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.164 02:17:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.164 02:17:50 -- common/autotest_common.sh@10 -- # set +x 00:06:26.164 ************************************ 00:06:26.164 START TEST default_locks_via_rpc 00:06:26.164 ************************************ 00:06:26.164 02:17:50 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:26.164 02:17:50 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1952017 00:06:26.164 02:17:50 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:26.164 02:17:50 -- event/cpu_locks.sh@63 -- # waitforlisten 1952017 00:06:26.164 02:17:50 -- common/autotest_common.sh@829 -- # '[' -z 1952017 ']' 00:06:26.164 02:17:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.165 02:17:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.165 02:17:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.165 02:17:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.165 02:17:50 -- common/autotest_common.sh@10 -- # set +x 00:06:26.165 [2024-11-27 02:17:50.670582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:26.165 [2024-11-27 02:17:50.670663] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1952017 ] 00:06:26.165 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.165 [2024-11-27 02:17:50.728924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.423 [2024-11-27 02:17:50.816468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.423 [2024-11-27 02:17:50.816631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.355 02:17:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.355 02:17:51 -- common/autotest_common.sh@862 -- # return 0 00:06:27.355 02:17:51 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:27.355 02:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.356 02:17:51 -- common/autotest_common.sh@10 -- # set +x 00:06:27.356 02:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.356 02:17:51 -- event/cpu_locks.sh@67 -- # no_locks 00:06:27.356 02:17:51 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:27.356 02:17:51 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:27.356 02:17:51 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:27.356 02:17:51 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:27.356 02:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:27.356 02:17:51 -- common/autotest_common.sh@10 -- # set +x 00:06:27.356 02:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:27.356 02:17:51 -- event/cpu_locks.sh@71 -- # locks_exist 1952017 00:06:27.356 02:17:51 -- event/cpu_locks.sh@22 -- # lslocks -p 1952017 00:06:27.356 02:17:51 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.356 02:17:51 -- event/cpu_locks.sh@73 -- # killprocess 1952017 00:06:27.356 02:17:51 -- common/autotest_common.sh@936 -- # '[' -z 1952017 ']' 00:06:27.356 02:17:51 -- common/autotest_common.sh@940 -- # kill -0 1952017 00:06:27.356 02:17:51 -- common/autotest_common.sh@941 -- # uname 00:06:27.356 02:17:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.356 02:17:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1952017 00:06:27.356 02:17:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.356 02:17:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.356 02:17:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1952017' 00:06:27.356 killing process with pid 1952017 00:06:27.356 02:17:51 -- common/autotest_common.sh@955 -- # kill 1952017 00:06:27.356 02:17:51 -- common/autotest_common.sh@960 -- # wait 1952017 00:06:27.921 00:06:27.921 real 0m1.757s 00:06:27.921 user 0m1.926s 00:06:27.921 sys 0m0.530s 00:06:27.921 02:17:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.921 02:17:52 -- common/autotest_common.sh@10 -- # set +x 00:06:27.921 ************************************ 00:06:27.921 END TEST default_locks_via_rpc 00:06:27.921 ************************************ 00:06:27.921 02:17:52 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:27.921 02:17:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.921 02:17:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.921 02:17:52 -- common/autotest_common.sh@10 -- # set +x 00:06:27.921 ************************************ 00:06:27.921 START TEST non_locking_app_on_locked_coremask 00:06:27.921 ************************************ 00:06:27.921 02:17:52 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:27.921 02:17:52 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1952199 00:06:27.921 02:17:52 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:27.921 02:17:52 -- event/cpu_locks.sh@81 -- # waitforlisten 1952199 /var/tmp/spdk.sock 00:06:27.921 02:17:52 -- common/autotest_common.sh@829 -- # '[' -z 1952199 ']' 00:06:27.921 02:17:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.921 02:17:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.921 02:17:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.921 02:17:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.921 02:17:52 -- common/autotest_common.sh@10 -- # set +x 00:06:27.922 [2024-11-27 02:17:52.452472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:27.922 [2024-11-27 02:17:52.452597] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1952199 ] 00:06:27.922 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.922 [2024-11-27 02:17:52.511367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.180 [2024-11-27 02:17:52.602037] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.180 [2024-11-27 02:17:52.602192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.117 02:17:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.117 02:17:53 -- common/autotest_common.sh@862 -- # return 0 00:06:29.117 02:17:53 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1952340 00:06:29.117 02:17:53 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:29.117 02:17:53 -- event/cpu_locks.sh@85 -- # waitforlisten 1952340 /var/tmp/spdk2.sock 00:06:29.117 02:17:53 -- common/autotest_common.sh@829 -- # '[' -z 1952340 ']' 00:06:29.117 02:17:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:29.117 02:17:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.117 02:17:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:29.117 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:29.117 02:17:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.117 02:17:53 -- common/autotest_common.sh@10 -- # set +x 00:06:29.117 [2024-11-27 02:17:53.457039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:29.117 [2024-11-27 02:17:53.457111] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1952340 ] 00:06:29.117 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.117 [2024-11-27 02:17:53.546888] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:29.117 [2024-11-27 02:17:53.546921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.117 [2024-11-27 02:17:53.728479] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.117 [2024-11-27 02:17:53.728676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.050 02:17:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.050 02:17:54 -- common/autotest_common.sh@862 -- # return 0 00:06:30.050 02:17:54 -- event/cpu_locks.sh@87 -- # locks_exist 1952199 00:06:30.050 02:17:54 -- event/cpu_locks.sh@22 -- # lslocks -p 1952199 00:06:30.050 02:17:54 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:30.308 lslocks: write error 00:06:30.308 02:17:54 -- event/cpu_locks.sh@89 -- # killprocess 1952199 00:06:30.308 02:17:54 -- common/autotest_common.sh@936 -- # '[' -z 1952199 ']' 00:06:30.308 02:17:54 -- common/autotest_common.sh@940 -- # kill -0 1952199 00:06:30.308 02:17:54 -- common/autotest_common.sh@941 -- # uname 00:06:30.308 02:17:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.308 02:17:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1952199 00:06:30.308 02:17:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:30.308 02:17:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:30.308 02:17:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1952199' 00:06:30.308 killing process with pid 1952199 00:06:30.308 02:17:54 -- common/autotest_common.sh@955 -- # kill 1952199 00:06:30.308 02:17:54 -- common/autotest_common.sh@960 -- # wait 1952199 00:06:31.239 02:17:55 -- event/cpu_locks.sh@90 -- # killprocess 1952340 00:06:31.239 02:17:55 -- common/autotest_common.sh@936 -- # '[' -z 1952340 ']' 00:06:31.239 02:17:55 -- common/autotest_common.sh@940 -- # kill -0 1952340 00:06:31.239 02:17:55 -- common/autotest_common.sh@941 -- # uname 00:06:31.239 02:17:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.239 02:17:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1952340 00:06:31.239 02:17:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.239 02:17:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.239 02:17:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1952340' 00:06:31.239 killing process with pid 1952340 00:06:31.239 02:17:55 -- common/autotest_common.sh@955 -- # kill 1952340 00:06:31.239 02:17:55 -- common/autotest_common.sh@960 -- # wait 1952340 00:06:31.495 00:06:31.495 real 0m3.640s 00:06:31.495 user 0m3.997s 00:06:31.495 sys 0m1.048s 00:06:31.495 02:17:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.495 02:17:56 -- common/autotest_common.sh@10 -- # set +x 00:06:31.495 ************************************ 00:06:31.495 END TEST non_locking_app_on_locked_coremask 00:06:31.495 ************************************ 00:06:31.495 02:17:56 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:31.495 02:17:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.495 02:17:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.495 02:17:56 -- common/autotest_common.sh@10 -- # set +x 00:06:31.495 ************************************ 00:06:31.495 START TEST locking_app_on_unlocked_coremask 00:06:31.495 ************************************ 00:06:31.495 02:17:56 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:31.495 02:17:56 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1952747 00:06:31.495 02:17:56 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:31.495 02:17:56 -- event/cpu_locks.sh@99 -- # waitforlisten 1952747 /var/tmp/spdk.sock 00:06:31.495 02:17:56 -- common/autotest_common.sh@829 -- # '[' -z 1952747 ']' 00:06:31.495 02:17:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.495 02:17:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.495 02:17:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.495 02:17:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.495 02:17:56 -- common/autotest_common.sh@10 -- # set +x 00:06:31.495 [2024-11-27 02:17:56.123462] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:31.495 [2024-11-27 02:17:56.123576] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1952747 ] 00:06:31.752 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.752 [2024-11-27 02:17:56.185207] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:31.752 [2024-11-27 02:17:56.185252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.752 [2024-11-27 02:17:56.271846] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.753 [2024-11-27 02:17:56.272045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.686 02:17:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.686 02:17:57 -- common/autotest_common.sh@862 -- # return 0 00:06:32.686 02:17:57 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1952787 00:06:32.686 02:17:57 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:32.686 02:17:57 -- event/cpu_locks.sh@103 -- # waitforlisten 1952787 /var/tmp/spdk2.sock 00:06:32.686 02:17:57 -- common/autotest_common.sh@829 -- # '[' -z 1952787 ']' 00:06:32.686 02:17:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:32.686 02:17:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:32.686 02:17:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:32.686 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:32.686 02:17:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:32.686 02:17:57 -- common/autotest_common.sh@10 -- # set +x 00:06:32.686 [2024-11-27 02:17:57.106690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.686 [2024-11-27 02:17:57.106783] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1952787 ] 00:06:32.686 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.686 [2024-11-27 02:17:57.205344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.944 [2024-11-27 02:17:57.387123] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:32.944 [2024-11-27 02:17:57.387326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.509 02:17:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.509 02:17:58 -- common/autotest_common.sh@862 -- # return 0 00:06:33.509 02:17:58 -- event/cpu_locks.sh@105 -- # locks_exist 1952787 00:06:33.509 02:17:58 -- event/cpu_locks.sh@22 -- # lslocks -p 1952787 00:06:33.509 02:17:58 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:34.075 lslocks: write error 00:06:34.075 02:17:58 -- event/cpu_locks.sh@107 -- # killprocess 1952747 00:06:34.075 02:17:58 -- common/autotest_common.sh@936 -- # '[' -z 1952747 ']' 00:06:34.075 02:17:58 -- common/autotest_common.sh@940 -- # kill -0 1952747 00:06:34.075 02:17:58 -- common/autotest_common.sh@941 -- # uname 00:06:34.075 02:17:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:34.075 02:17:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1952747 00:06:34.075 02:17:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:34.075 02:17:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:34.075 02:17:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1952747' 00:06:34.075 killing process with pid 1952747 00:06:34.075 02:17:58 -- common/autotest_common.sh@955 -- # kill 1952747 00:06:34.075 02:17:58 -- common/autotest_common.sh@960 -- # wait 1952747 00:06:35.007 02:17:59 -- event/cpu_locks.sh@108 -- # killprocess 1952787 00:06:35.007 02:17:59 -- common/autotest_common.sh@936 -- # '[' -z 1952787 ']' 00:06:35.007 02:17:59 -- common/autotest_common.sh@940 -- # kill -0 1952787 00:06:35.007 02:17:59 -- common/autotest_common.sh@941 -- # uname 00:06:35.007 02:17:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.007 02:17:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1952787 00:06:35.007 02:17:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.007 02:17:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.007 02:17:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1952787' 00:06:35.007 killing process with pid 1952787 00:06:35.007 02:17:59 -- common/autotest_common.sh@955 -- # kill 1952787 00:06:35.007 02:17:59 -- common/autotest_common.sh@960 -- # wait 1952787 00:06:35.265 00:06:35.265 real 0m3.722s 00:06:35.265 user 0m4.053s 00:06:35.265 sys 0m1.112s 00:06:35.265 02:17:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.265 02:17:59 -- common/autotest_common.sh@10 -- # set +x 00:06:35.265 ************************************ 00:06:35.265 END TEST locking_app_on_unlocked_coremask 00:06:35.265 ************************************ 00:06:35.265 02:17:59 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:35.265 02:17:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:35.265 02:17:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.265 02:17:59 -- common/autotest_common.sh@10 -- # set +x 00:06:35.265 ************************************ 00:06:35.265 START TEST locking_app_on_locked_coremask 00:06:35.265 ************************************ 00:06:35.265 02:17:59 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:35.265 02:17:59 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1953222 00:06:35.265 02:17:59 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:35.265 02:17:59 -- event/cpu_locks.sh@116 -- # waitforlisten 1953222 /var/tmp/spdk.sock 00:06:35.265 02:17:59 -- common/autotest_common.sh@829 -- # '[' -z 1953222 ']' 00:06:35.265 02:17:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.265 02:17:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:35.265 02:17:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.265 02:17:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:35.265 02:17:59 -- common/autotest_common.sh@10 -- # set +x 00:06:35.265 [2024-11-27 02:17:59.870314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:35.265 [2024-11-27 02:17:59.870416] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1953222 ] 00:06:35.265 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.524 [2024-11-27 02:17:59.929143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.524 [2024-11-27 02:18:00.021212] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:35.524 [2024-11-27 02:18:00.021383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.524 02:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.524 02:18:00 -- common/autotest_common.sh@862 -- # return 0 00:06:36.524 02:18:00 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1953417 00:06:36.524 02:18:00 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:36.524 02:18:00 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1953417 /var/tmp/spdk2.sock 00:06:36.524 02:18:00 -- common/autotest_common.sh@650 -- # local es=0 00:06:36.524 02:18:00 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1953417 /var/tmp/spdk2.sock 00:06:36.524 02:18:00 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:36.524 02:18:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.524 02:18:00 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:36.524 02:18:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:36.524 02:18:00 -- common/autotest_common.sh@653 -- # waitforlisten 1953417 /var/tmp/spdk2.sock 00:06:36.524 02:18:00 -- common/autotest_common.sh@829 -- # '[' -z 1953417 ']' 00:06:36.524 02:18:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:36.524 02:18:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.524 02:18:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:36.524 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:36.524 02:18:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.524 02:18:00 -- common/autotest_common.sh@10 -- # set +x 00:06:36.524 [2024-11-27 02:18:00.890272] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.524 [2024-11-27 02:18:00.890348] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1953417 ] 00:06:36.524 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.524 [2024-11-27 02:18:00.979591] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1953222 has claimed it. 00:06:36.524 [2024-11-27 02:18:00.979650] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:37.088 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1953417) - No such process 00:06:37.088 ERROR: process (pid: 1953417) is no longer running 00:06:37.089 02:18:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.089 02:18:01 -- common/autotest_common.sh@862 -- # return 1 00:06:37.089 02:18:01 -- common/autotest_common.sh@653 -- # es=1 00:06:37.089 02:18:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:37.089 02:18:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:37.089 02:18:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:37.089 02:18:01 -- event/cpu_locks.sh@122 -- # locks_exist 1953222 00:06:37.089 02:18:01 -- event/cpu_locks.sh@22 -- # lslocks -p 1953222 00:06:37.089 02:18:01 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:37.346 lslocks: write error 00:06:37.346 02:18:01 -- event/cpu_locks.sh@124 -- # killprocess 1953222 00:06:37.346 02:18:01 -- common/autotest_common.sh@936 -- # '[' -z 1953222 ']' 00:06:37.346 02:18:01 -- common/autotest_common.sh@940 -- # kill -0 1953222 00:06:37.346 02:18:01 -- common/autotest_common.sh@941 -- # uname 00:06:37.346 02:18:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.347 02:18:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1953222 00:06:37.347 02:18:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.347 02:18:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.347 02:18:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1953222' 00:06:37.347 killing process with pid 1953222 00:06:37.347 02:18:01 -- common/autotest_common.sh@955 -- # kill 1953222 00:06:37.347 02:18:01 -- common/autotest_common.sh@960 -- # wait 1953222 00:06:37.911 00:06:37.911 real 0m2.483s 00:06:37.911 user 0m2.874s 00:06:37.911 sys 0m0.654s 00:06:37.911 02:18:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.911 02:18:02 -- common/autotest_common.sh@10 -- # set +x 00:06:37.911 ************************************ 00:06:37.911 END TEST locking_app_on_locked_coremask 00:06:37.911 ************************************ 00:06:37.911 02:18:02 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:37.911 02:18:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.911 02:18:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.911 02:18:02 -- common/autotest_common.sh@10 -- # set +x 00:06:37.911 ************************************ 00:06:37.911 START TEST locking_overlapped_coremask 00:06:37.911 ************************************ 00:06:37.911 02:18:02 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:37.911 02:18:02 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1953649 00:06:37.911 02:18:02 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:37.911 02:18:02 -- event/cpu_locks.sh@133 -- # waitforlisten 1953649 /var/tmp/spdk.sock 00:06:37.911 02:18:02 -- common/autotest_common.sh@829 -- # '[' -z 1953649 ']' 00:06:37.911 02:18:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.911 02:18:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.911 02:18:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.911 02:18:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.911 02:18:02 -- common/autotest_common.sh@10 -- # set +x 00:06:37.911 [2024-11-27 02:18:02.381156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:37.911 [2024-11-27 02:18:02.381239] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1953649 ] 00:06:37.912 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.912 [2024-11-27 02:18:02.444368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:37.912 [2024-11-27 02:18:02.541881] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.912 [2024-11-27 02:18:02.542084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:37.912 [2024-11-27 02:18:02.542155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:37.912 [2024-11-27 02:18:02.542158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.845 02:18:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.845 02:18:03 -- common/autotest_common.sh@862 -- # return 0 00:06:38.845 02:18:03 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1953789 00:06:38.845 02:18:03 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1953789 /var/tmp/spdk2.sock 00:06:38.845 02:18:03 -- common/autotest_common.sh@650 -- # local es=0 00:06:38.845 02:18:03 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:38.845 02:18:03 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1953789 /var/tmp/spdk2.sock 00:06:38.845 02:18:03 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:38.845 02:18:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.845 02:18:03 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:38.845 02:18:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.845 02:18:03 -- common/autotest_common.sh@653 -- # waitforlisten 1953789 /var/tmp/spdk2.sock 00:06:38.845 02:18:03 -- common/autotest_common.sh@829 -- # '[' -z 1953789 ']' 00:06:38.845 02:18:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:38.845 02:18:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.845 02:18:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:38.845 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:38.845 02:18:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.845 02:18:03 -- common/autotest_common.sh@10 -- # set +x 00:06:38.845 [2024-11-27 02:18:03.424729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:38.845 [2024-11-27 02:18:03.424848] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1953789 ] 00:06:38.845 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.104 [2024-11-27 02:18:03.515786] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1953649 has claimed it. 00:06:39.104 [2024-11-27 02:18:03.515859] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:39.670 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1953789) - No such process 00:06:39.670 ERROR: process (pid: 1953789) is no longer running 00:06:39.670 02:18:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:39.670 02:18:04 -- common/autotest_common.sh@862 -- # return 1 00:06:39.670 02:18:04 -- common/autotest_common.sh@653 -- # es=1 00:06:39.670 02:18:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:39.670 02:18:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:39.670 02:18:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:39.670 02:18:04 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:39.670 02:18:04 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:39.670 02:18:04 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:39.670 02:18:04 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:39.670 02:18:04 -- event/cpu_locks.sh@141 -- # killprocess 1953649 00:06:39.670 02:18:04 -- common/autotest_common.sh@936 -- # '[' -z 1953649 ']' 00:06:39.670 02:18:04 -- common/autotest_common.sh@940 -- # kill -0 1953649 00:06:39.670 02:18:04 -- common/autotest_common.sh@941 -- # uname 00:06:39.670 02:18:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.670 02:18:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1953649 00:06:39.670 02:18:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.670 02:18:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.670 02:18:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1953649' 00:06:39.670 killing process with pid 1953649 00:06:39.670 02:18:04 -- common/autotest_common.sh@955 -- # kill 1953649 00:06:39.670 02:18:04 -- common/autotest_common.sh@960 -- # wait 1953649 00:06:40.236 00:06:40.236 real 0m2.237s 00:06:40.236 user 0m6.466s 00:06:40.236 sys 0m0.505s 00:06:40.236 02:18:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.236 02:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:40.236 ************************************ 00:06:40.236 END TEST locking_overlapped_coremask 00:06:40.236 ************************************ 00:06:40.236 02:18:04 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:40.236 02:18:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:40.236 02:18:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.236 02:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:40.236 ************************************ 00:06:40.236 START TEST locking_overlapped_coremask_via_rpc 00:06:40.236 ************************************ 00:06:40.236 02:18:04 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:40.236 02:18:04 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1953959 00:06:40.236 02:18:04 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:40.236 02:18:04 -- event/cpu_locks.sh@149 -- # waitforlisten 1953959 /var/tmp/spdk.sock 00:06:40.236 02:18:04 -- common/autotest_common.sh@829 -- # '[' -z 1953959 ']' 00:06:40.236 02:18:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:40.236 02:18:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.236 02:18:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:40.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:40.236 02:18:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.236 02:18:04 -- common/autotest_common.sh@10 -- # set +x 00:06:40.236 [2024-11-27 02:18:04.643884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:40.236 [2024-11-27 02:18:04.643977] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1953959 ] 00:06:40.236 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.236 [2024-11-27 02:18:04.702386] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:40.236 [2024-11-27 02:18:04.702420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:40.236 [2024-11-27 02:18:04.791306] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:40.236 [2024-11-27 02:18:04.791536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:40.236 [2024-11-27 02:18:04.791596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:40.236 [2024-11-27 02:18:04.791599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.169 02:18:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:41.169 02:18:05 -- common/autotest_common.sh@862 -- # return 0 00:06:41.169 02:18:05 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1954101 00:06:41.169 02:18:05 -- event/cpu_locks.sh@153 -- # waitforlisten 1954101 /var/tmp/spdk2.sock 00:06:41.169 02:18:05 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:41.169 02:18:05 -- common/autotest_common.sh@829 -- # '[' -z 1954101 ']' 00:06:41.169 02:18:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:41.169 02:18:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.169 02:18:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:41.169 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:41.169 02:18:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.169 02:18:05 -- common/autotest_common.sh@10 -- # set +x 00:06:41.169 [2024-11-27 02:18:05.669801] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:41.169 [2024-11-27 02:18:05.669906] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1954101 ] 00:06:41.169 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.169 [2024-11-27 02:18:05.758407] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.169 [2024-11-27 02:18:05.758440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:41.427 [2024-11-27 02:18:05.929012] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.427 [2024-11-27 02:18:05.929220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:41.427 [2024-11-27 02:18:05.932622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:41.427 [2024-11-27 02:18:05.932625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:42.357 02:18:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.357 02:18:06 -- common/autotest_common.sh@862 -- # return 0 00:06:42.357 02:18:06 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:42.357 02:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.357 02:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:42.357 02:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:42.357 02:18:06 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:42.357 02:18:06 -- common/autotest_common.sh@650 -- # local es=0 00:06:42.357 02:18:06 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:42.357 02:18:06 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:42.357 02:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:42.357 02:18:06 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:42.357 02:18:06 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:42.357 02:18:06 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:42.357 02:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:42.357 02:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:42.357 [2024-11-27 02:18:06.647617] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1953959 has claimed it. 00:06:42.357 request: 00:06:42.357 { 00:06:42.357 "method": "framework_enable_cpumask_locks", 00:06:42.357 "req_id": 1 00:06:42.357 } 00:06:42.357 Got JSON-RPC error response 00:06:42.357 response: 00:06:42.357 { 00:06:42.357 "code": -32603, 00:06:42.357 "message": "Failed to claim CPU core: 2" 00:06:42.357 } 00:06:42.357 02:18:06 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:42.357 02:18:06 -- common/autotest_common.sh@653 -- # es=1 00:06:42.357 02:18:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:42.357 02:18:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:42.357 02:18:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:42.357 02:18:06 -- event/cpu_locks.sh@158 -- # waitforlisten 1953959 /var/tmp/spdk.sock 00:06:42.357 02:18:06 -- common/autotest_common.sh@829 -- # '[' -z 1953959 ']' 00:06:42.357 02:18:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.357 02:18:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.357 02:18:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.357 02:18:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.357 02:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:42.357 02:18:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.357 02:18:06 -- common/autotest_common.sh@862 -- # return 0 00:06:42.357 02:18:06 -- event/cpu_locks.sh@159 -- # waitforlisten 1954101 /var/tmp/spdk2.sock 00:06:42.357 02:18:06 -- common/autotest_common.sh@829 -- # '[' -z 1954101 ']' 00:06:42.357 02:18:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.357 02:18:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.357 02:18:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.357 02:18:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.357 02:18:06 -- common/autotest_common.sh@10 -- # set +x 00:06:42.614 02:18:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.614 02:18:07 -- common/autotest_common.sh@862 -- # return 0 00:06:42.614 02:18:07 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:42.614 02:18:07 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:42.614 02:18:07 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:42.614 02:18:07 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:42.614 00:06:42.614 real 0m2.588s 00:06:42.614 user 0m1.315s 00:06:42.614 sys 0m0.199s 00:06:42.614 02:18:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:42.614 02:18:07 -- common/autotest_common.sh@10 -- # set +x 00:06:42.614 ************************************ 00:06:42.614 END TEST locking_overlapped_coremask_via_rpc 00:06:42.614 ************************************ 00:06:42.614 02:18:07 -- event/cpu_locks.sh@174 -- # cleanup 00:06:42.614 02:18:07 -- event/cpu_locks.sh@15 -- # [[ -z 1953959 ]] 00:06:42.614 02:18:07 -- event/cpu_locks.sh@15 -- # killprocess 1953959 00:06:42.614 02:18:07 -- common/autotest_common.sh@936 -- # '[' -z 1953959 ']' 00:06:42.614 02:18:07 -- common/autotest_common.sh@940 -- # kill -0 1953959 00:06:42.614 02:18:07 -- common/autotest_common.sh@941 -- # uname 00:06:42.614 02:18:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.614 02:18:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1953959 00:06:42.614 02:18:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.614 02:18:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.614 02:18:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1953959' 00:06:42.614 killing process with pid 1953959 00:06:42.614 02:18:07 -- common/autotest_common.sh@955 -- # kill 1953959 00:06:42.614 02:18:07 -- common/autotest_common.sh@960 -- # wait 1953959 00:06:43.177 02:18:07 -- event/cpu_locks.sh@16 -- # [[ -z 1954101 ]] 00:06:43.177 02:18:07 -- event/cpu_locks.sh@16 -- # killprocess 1954101 00:06:43.177 02:18:07 -- common/autotest_common.sh@936 -- # '[' -z 1954101 ']' 00:06:43.177 02:18:07 -- common/autotest_common.sh@940 -- # kill -0 1954101 00:06:43.177 02:18:07 -- common/autotest_common.sh@941 -- # uname 00:06:43.177 02:18:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.177 02:18:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1954101 00:06:43.177 02:18:07 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:43.177 02:18:07 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:43.177 02:18:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1954101' 00:06:43.177 killing process with pid 1954101 00:06:43.177 02:18:07 -- common/autotest_common.sh@955 -- # kill 1954101 00:06:43.177 02:18:07 -- common/autotest_common.sh@960 -- # wait 1954101 00:06:43.435 02:18:08 -- event/cpu_locks.sh@18 -- # rm -f 00:06:43.435 02:18:08 -- event/cpu_locks.sh@1 -- # cleanup 00:06:43.435 02:18:08 -- event/cpu_locks.sh@15 -- # [[ -z 1953959 ]] 00:06:43.435 02:18:08 -- event/cpu_locks.sh@15 -- # killprocess 1953959 00:06:43.435 02:18:08 -- common/autotest_common.sh@936 -- # '[' -z 1953959 ']' 00:06:43.435 02:18:08 -- common/autotest_common.sh@940 -- # kill -0 1953959 00:06:43.435 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1953959) - No such process 00:06:43.435 02:18:08 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1953959 is not found' 00:06:43.435 Process with pid 1953959 is not found 00:06:43.435 02:18:08 -- event/cpu_locks.sh@16 -- # [[ -z 1954101 ]] 00:06:43.435 02:18:08 -- event/cpu_locks.sh@16 -- # killprocess 1954101 00:06:43.435 02:18:08 -- common/autotest_common.sh@936 -- # '[' -z 1954101 ']' 00:06:43.435 02:18:08 -- common/autotest_common.sh@940 -- # kill -0 1954101 00:06:43.435 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1954101) - No such process 00:06:43.435 02:18:08 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1954101 is not found' 00:06:43.435 Process with pid 1954101 is not found 00:06:43.435 02:18:08 -- event/cpu_locks.sh@18 -- # rm -f 00:06:43.435 00:06:43.435 real 0m19.375s 00:06:43.435 user 0m35.347s 00:06:43.435 sys 0m5.482s 00:06:43.435 02:18:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.435 02:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.435 ************************************ 00:06:43.435 END TEST cpu_locks 00:06:43.435 ************************************ 00:06:43.693 00:06:43.693 real 0m46.205s 00:06:43.693 user 1m29.404s 00:06:43.693 sys 0m9.459s 00:06:43.693 02:18:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.693 02:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.693 ************************************ 00:06:43.693 END TEST event 00:06:43.693 ************************************ 00:06:43.693 02:18:08 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:43.693 02:18:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.693 02:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.693 02:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.693 ************************************ 00:06:43.693 START TEST thread 00:06:43.693 ************************************ 00:06:43.693 02:18:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:43.693 * Looking for test storage... 00:06:43.693 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:43.693 02:18:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.693 02:18:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.693 02:18:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.693 02:18:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.693 02:18:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.693 02:18:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.693 02:18:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.693 02:18:08 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.693 02:18:08 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.693 02:18:08 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.693 02:18:08 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.693 02:18:08 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.693 02:18:08 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.693 02:18:08 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.693 02:18:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.693 02:18:08 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.693 02:18:08 -- scripts/common.sh@344 -- # : 1 00:06:43.693 02:18:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.693 02:18:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.693 02:18:08 -- scripts/common.sh@364 -- # decimal 1 00:06:43.693 02:18:08 -- scripts/common.sh@352 -- # local d=1 00:06:43.693 02:18:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.693 02:18:08 -- scripts/common.sh@354 -- # echo 1 00:06:43.693 02:18:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.693 02:18:08 -- scripts/common.sh@365 -- # decimal 2 00:06:43.693 02:18:08 -- scripts/common.sh@352 -- # local d=2 00:06:43.693 02:18:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.693 02:18:08 -- scripts/common.sh@354 -- # echo 2 00:06:43.693 02:18:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.693 02:18:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.693 02:18:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.693 02:18:08 -- scripts/common.sh@367 -- # return 0 00:06:43.693 02:18:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.693 02:18:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.693 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.693 --rc genhtml_branch_coverage=1 00:06:43.693 --rc genhtml_function_coverage=1 00:06:43.693 --rc genhtml_legend=1 00:06:43.693 --rc geninfo_all_blocks=1 00:06:43.693 --rc geninfo_unexecuted_blocks=1 00:06:43.693 00:06:43.693 ' 00:06:43.693 02:18:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.693 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.693 --rc genhtml_branch_coverage=1 00:06:43.693 --rc genhtml_function_coverage=1 00:06:43.693 --rc genhtml_legend=1 00:06:43.693 --rc geninfo_all_blocks=1 00:06:43.693 --rc geninfo_unexecuted_blocks=1 00:06:43.693 00:06:43.693 ' 00:06:43.693 02:18:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.693 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.694 --rc genhtml_branch_coverage=1 00:06:43.694 --rc genhtml_function_coverage=1 00:06:43.694 --rc genhtml_legend=1 00:06:43.694 --rc geninfo_all_blocks=1 00:06:43.694 --rc geninfo_unexecuted_blocks=1 00:06:43.694 00:06:43.694 ' 00:06:43.694 02:18:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.694 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.694 --rc genhtml_branch_coverage=1 00:06:43.694 --rc genhtml_function_coverage=1 00:06:43.694 --rc genhtml_legend=1 00:06:43.694 --rc geninfo_all_blocks=1 00:06:43.694 --rc geninfo_unexecuted_blocks=1 00:06:43.694 00:06:43.694 ' 00:06:43.694 02:18:08 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:43.694 02:18:08 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:43.694 02:18:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.694 02:18:08 -- common/autotest_common.sh@10 -- # set +x 00:06:43.694 ************************************ 00:06:43.694 START TEST thread_poller_perf 00:06:43.694 ************************************ 00:06:43.694 02:18:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:43.694 [2024-11-27 02:18:08.275602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:43.694 [2024-11-27 02:18:08.275682] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1954841 ] 00:06:43.694 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.952 [2024-11-27 02:18:08.335191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.952 [2024-11-27 02:18:08.421998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.952 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:44.887 [2024-11-27T01:18:09.522Z] ====================================== 00:06:44.887 [2024-11-27T01:18:09.522Z] busy:2714895332 (cyc) 00:06:44.887 [2024-11-27T01:18:09.522Z] total_run_count: 281000 00:06:44.887 [2024-11-27T01:18:09.522Z] tsc_hz: 2700000000 (cyc) 00:06:44.887 [2024-11-27T01:18:09.522Z] ====================================== 00:06:44.887 [2024-11-27T01:18:09.522Z] poller_cost: 9661 (cyc), 3578 (nsec) 00:06:44.887 00:06:44.887 real 0m1.245s 00:06:44.887 user 0m1.158s 00:06:44.887 sys 0m0.081s 00:06:44.887 02:18:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.887 02:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:44.887 ************************************ 00:06:44.887 END TEST thread_poller_perf 00:06:44.887 ************************************ 00:06:45.145 02:18:09 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:45.145 02:18:09 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:45.145 02:18:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.145 02:18:09 -- common/autotest_common.sh@10 -- # set +x 00:06:45.145 ************************************ 00:06:45.145 START TEST thread_poller_perf 00:06:45.145 ************************************ 00:06:45.145 02:18:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:45.145 [2024-11-27 02:18:09.543473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.145 [2024-11-27 02:18:09.543564] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955161 ] 00:06:45.145 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.145 [2024-11-27 02:18:09.604471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.145 [2024-11-27 02:18:09.696929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.145 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:46.518 [2024-11-27T01:18:11.153Z] ====================================== 00:06:46.518 [2024-11-27T01:18:11.153Z] busy:2703904377 (cyc) 00:06:46.518 [2024-11-27T01:18:11.153Z] total_run_count: 3822000 00:06:46.518 [2024-11-27T01:18:11.153Z] tsc_hz: 2700000000 (cyc) 00:06:46.518 [2024-11-27T01:18:11.153Z] ====================================== 00:06:46.518 [2024-11-27T01:18:11.153Z] poller_cost: 707 (cyc), 261 (nsec) 00:06:46.518 00:06:46.518 real 0m1.245s 00:06:46.518 user 0m1.153s 00:06:46.518 sys 0m0.085s 00:06:46.518 02:18:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.518 02:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:46.518 ************************************ 00:06:46.518 END TEST thread_poller_perf 00:06:46.518 ************************************ 00:06:46.518 02:18:10 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:46.518 00:06:46.518 real 0m2.685s 00:06:46.518 user 0m2.428s 00:06:46.518 sys 0m0.259s 00:06:46.518 02:18:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.518 02:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:46.518 ************************************ 00:06:46.518 END TEST thread 00:06:46.518 ************************************ 00:06:46.518 02:18:10 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:46.518 02:18:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:46.518 02:18:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.518 02:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:46.518 ************************************ 00:06:46.518 START TEST accel 00:06:46.518 ************************************ 00:06:46.518 02:18:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:46.518 * Looking for test storage... 00:06:46.518 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:46.518 02:18:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:46.518 02:18:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:46.518 02:18:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:46.518 02:18:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:46.518 02:18:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:46.518 02:18:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:46.518 02:18:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:46.518 02:18:10 -- scripts/common.sh@335 -- # IFS=.-: 00:06:46.518 02:18:10 -- scripts/common.sh@335 -- # read -ra ver1 00:06:46.518 02:18:10 -- scripts/common.sh@336 -- # IFS=.-: 00:06:46.518 02:18:10 -- scripts/common.sh@336 -- # read -ra ver2 00:06:46.518 02:18:10 -- scripts/common.sh@337 -- # local 'op=<' 00:06:46.518 02:18:10 -- scripts/common.sh@339 -- # ver1_l=2 00:06:46.518 02:18:10 -- scripts/common.sh@340 -- # ver2_l=1 00:06:46.519 02:18:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:46.519 02:18:10 -- scripts/common.sh@343 -- # case "$op" in 00:06:46.519 02:18:10 -- scripts/common.sh@344 -- # : 1 00:06:46.519 02:18:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:46.519 02:18:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:46.519 02:18:10 -- scripts/common.sh@364 -- # decimal 1 00:06:46.519 02:18:10 -- scripts/common.sh@352 -- # local d=1 00:06:46.519 02:18:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:46.519 02:18:10 -- scripts/common.sh@354 -- # echo 1 00:06:46.519 02:18:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:46.519 02:18:10 -- scripts/common.sh@365 -- # decimal 2 00:06:46.519 02:18:10 -- scripts/common.sh@352 -- # local d=2 00:06:46.519 02:18:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:46.519 02:18:10 -- scripts/common.sh@354 -- # echo 2 00:06:46.519 02:18:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:46.519 02:18:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:46.519 02:18:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:46.519 02:18:10 -- scripts/common.sh@367 -- # return 0 00:06:46.519 02:18:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:46.519 02:18:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:46.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.519 --rc genhtml_branch_coverage=1 00:06:46.519 --rc genhtml_function_coverage=1 00:06:46.519 --rc genhtml_legend=1 00:06:46.519 --rc geninfo_all_blocks=1 00:06:46.519 --rc geninfo_unexecuted_blocks=1 00:06:46.519 00:06:46.519 ' 00:06:46.519 02:18:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:46.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.519 --rc genhtml_branch_coverage=1 00:06:46.519 --rc genhtml_function_coverage=1 00:06:46.519 --rc genhtml_legend=1 00:06:46.519 --rc geninfo_all_blocks=1 00:06:46.519 --rc geninfo_unexecuted_blocks=1 00:06:46.519 00:06:46.519 ' 00:06:46.519 02:18:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:46.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.519 --rc genhtml_branch_coverage=1 00:06:46.519 --rc genhtml_function_coverage=1 00:06:46.519 --rc genhtml_legend=1 00:06:46.519 --rc geninfo_all_blocks=1 00:06:46.519 --rc geninfo_unexecuted_blocks=1 00:06:46.519 00:06:46.519 ' 00:06:46.519 02:18:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:46.519 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:46.519 --rc genhtml_branch_coverage=1 00:06:46.519 --rc genhtml_function_coverage=1 00:06:46.519 --rc genhtml_legend=1 00:06:46.519 --rc geninfo_all_blocks=1 00:06:46.519 --rc geninfo_unexecuted_blocks=1 00:06:46.519 00:06:46.519 ' 00:06:46.519 02:18:10 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:46.519 02:18:10 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:46.519 02:18:10 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:46.519 02:18:10 -- accel/accel.sh@59 -- # spdk_tgt_pid=1955465 00:06:46.519 02:18:10 -- accel/accel.sh@60 -- # waitforlisten 1955465 00:06:46.519 02:18:10 -- common/autotest_common.sh@829 -- # '[' -z 1955465 ']' 00:06:46.519 02:18:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:46.519 02:18:10 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:46.519 02:18:10 -- accel/accel.sh@58 -- # build_accel_config 00:06:46.519 02:18:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.519 02:18:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:46.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:46.519 02:18:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.519 02:18:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.519 02:18:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.519 02:18:10 -- common/autotest_common.sh@10 -- # set +x 00:06:46.519 02:18:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.519 02:18:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.519 02:18:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.519 02:18:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.519 02:18:10 -- accel/accel.sh@42 -- # jq -r . 00:06:46.519 [2024-11-27 02:18:11.014866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.519 [2024-11-27 02:18:11.014954] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955465 ] 00:06:46.519 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.519 [2024-11-27 02:18:11.075780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.778 [2024-11-27 02:18:11.165639] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:46.778 [2024-11-27 02:18:11.165832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.344 02:18:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.344 02:18:11 -- common/autotest_common.sh@862 -- # return 0 00:06:47.344 02:18:11 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:47.344 02:18:11 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:47.344 02:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:47.344 02:18:11 -- common/autotest_common.sh@10 -- # set +x 00:06:47.344 02:18:11 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:47.344 02:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # IFS== 00:06:47.602 02:18:12 -- accel/accel.sh@64 -- # read -r opc module 00:06:47.602 02:18:12 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:47.602 02:18:12 -- accel/accel.sh@67 -- # killprocess 1955465 00:06:47.602 02:18:12 -- common/autotest_common.sh@936 -- # '[' -z 1955465 ']' 00:06:47.602 02:18:12 -- common/autotest_common.sh@940 -- # kill -0 1955465 00:06:47.602 02:18:12 -- common/autotest_common.sh@941 -- # uname 00:06:47.602 02:18:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:47.602 02:18:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1955465 00:06:47.602 02:18:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:47.603 02:18:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:47.603 02:18:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1955465' 00:06:47.603 killing process with pid 1955465 00:06:47.603 02:18:12 -- common/autotest_common.sh@955 -- # kill 1955465 00:06:47.603 02:18:12 -- common/autotest_common.sh@960 -- # wait 1955465 00:06:47.861 02:18:12 -- accel/accel.sh@68 -- # trap - ERR 00:06:47.861 02:18:12 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:47.861 02:18:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:47.861 02:18:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.861 02:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:47.861 02:18:12 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:47.861 02:18:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:47.861 02:18:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.861 02:18:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.861 02:18:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.861 02:18:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.861 02:18:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.861 02:18:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.861 02:18:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.861 02:18:12 -- accel/accel.sh@42 -- # jq -r . 00:06:47.861 02:18:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.861 02:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:48.119 02:18:12 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:48.119 02:18:12 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:48.119 02:18:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.119 02:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:48.119 ************************************ 00:06:48.119 START TEST accel_missing_filename 00:06:48.119 ************************************ 00:06:48.119 02:18:12 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:48.119 02:18:12 -- common/autotest_common.sh@650 -- # local es=0 00:06:48.119 02:18:12 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:48.119 02:18:12 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:48.119 02:18:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.119 02:18:12 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:48.119 02:18:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.119 02:18:12 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:48.119 02:18:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:48.119 02:18:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.119 02:18:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.119 02:18:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.119 02:18:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.119 02:18:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.119 02:18:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.119 02:18:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.119 02:18:12 -- accel/accel.sh@42 -- # jq -r . 00:06:48.119 [2024-11-27 02:18:12.526270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.119 [2024-11-27 02:18:12.526347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955642 ] 00:06:48.119 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.119 [2024-11-27 02:18:12.587575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.119 [2024-11-27 02:18:12.679342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.119 [2024-11-27 02:18:12.739194] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:48.377 [2024-11-27 02:18:12.816691] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:48.377 A filename is required. 00:06:48.377 02:18:12 -- common/autotest_common.sh@653 -- # es=234 00:06:48.377 02:18:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:48.377 02:18:12 -- common/autotest_common.sh@662 -- # es=106 00:06:48.377 02:18:12 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:48.377 02:18:12 -- common/autotest_common.sh@670 -- # es=1 00:06:48.377 02:18:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:48.377 00:06:48.377 real 0m0.390s 00:06:48.377 user 0m0.280s 00:06:48.377 sys 0m0.144s 00:06:48.377 02:18:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.377 02:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:48.377 ************************************ 00:06:48.377 END TEST accel_missing_filename 00:06:48.377 ************************************ 00:06:48.377 02:18:12 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:48.377 02:18:12 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:48.377 02:18:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.377 02:18:12 -- common/autotest_common.sh@10 -- # set +x 00:06:48.377 ************************************ 00:06:48.377 START TEST accel_compress_verify 00:06:48.377 ************************************ 00:06:48.377 02:18:12 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:48.377 02:18:12 -- common/autotest_common.sh@650 -- # local es=0 00:06:48.377 02:18:12 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:48.377 02:18:12 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:48.377 02:18:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.377 02:18:12 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:48.377 02:18:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.377 02:18:12 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:48.377 02:18:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:48.377 02:18:12 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.377 02:18:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.377 02:18:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.377 02:18:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.377 02:18:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.377 02:18:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.377 02:18:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.377 02:18:12 -- accel/accel.sh@42 -- # jq -r . 00:06:48.377 [2024-11-27 02:18:12.940534] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.377 [2024-11-27 02:18:12.940628] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955683 ] 00:06:48.377 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.377 [2024-11-27 02:18:13.001699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.636 [2024-11-27 02:18:13.093489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.636 [2024-11-27 02:18:13.155707] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:48.636 [2024-11-27 02:18:13.240831] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:48.895 00:06:48.895 Compression does not support the verify option, aborting. 00:06:48.895 02:18:13 -- common/autotest_common.sh@653 -- # es=161 00:06:48.895 02:18:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:48.895 02:18:13 -- common/autotest_common.sh@662 -- # es=33 00:06:48.895 02:18:13 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:48.895 02:18:13 -- common/autotest_common.sh@670 -- # es=1 00:06:48.895 02:18:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:48.895 00:06:48.895 real 0m0.401s 00:06:48.895 user 0m0.294s 00:06:48.895 sys 0m0.141s 00:06:48.895 02:18:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.895 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.895 ************************************ 00:06:48.895 END TEST accel_compress_verify 00:06:48.895 ************************************ 00:06:48.895 02:18:13 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:48.895 02:18:13 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:48.895 02:18:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.895 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.895 ************************************ 00:06:48.895 START TEST accel_wrong_workload 00:06:48.895 ************************************ 00:06:48.895 02:18:13 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:48.895 02:18:13 -- common/autotest_common.sh@650 -- # local es=0 00:06:48.895 02:18:13 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:48.895 02:18:13 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.896 02:18:13 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.896 02:18:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.896 02:18:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.896 02:18:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.896 02:18:13 -- accel/accel.sh@42 -- # jq -r . 00:06:48.896 Unsupported workload type: foobar 00:06:48.896 [2024-11-27 02:18:13.363096] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:48.896 accel_perf options: 00:06:48.896 [-h help message] 00:06:48.896 [-q queue depth per core] 00:06:48.896 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:48.896 [-T number of threads per core 00:06:48.896 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:48.896 [-t time in seconds] 00:06:48.896 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:48.896 [ dif_verify, , dif_generate, dif_generate_copy 00:06:48.896 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:48.896 [-l for compress/decompress workloads, name of uncompressed input file 00:06:48.896 [-S for crc32c workload, use this seed value (default 0) 00:06:48.896 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:48.896 [-f for fill workload, use this BYTE value (default 255) 00:06:48.896 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:48.896 [-y verify result if this switch is on] 00:06:48.896 [-a tasks to allocate per core (default: same value as -q)] 00:06:48.896 Can be used to spread operations across a wider range of memory. 00:06:48.896 02:18:13 -- common/autotest_common.sh@653 -- # es=1 00:06:48.896 02:18:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:48.896 02:18:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:48.896 02:18:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:48.896 00:06:48.896 real 0m0.021s 00:06:48.896 user 0m0.009s 00:06:48.896 sys 0m0.012s 00:06:48.896 02:18:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.896 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.896 ************************************ 00:06:48.896 END TEST accel_wrong_workload 00:06:48.896 ************************************ 00:06:48.896 Error: writing output failed: Broken pipe 00:06:48.896 02:18:13 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:48.896 02:18:13 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:48.896 02:18:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.896 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.896 ************************************ 00:06:48.896 START TEST accel_negative_buffers 00:06:48.896 ************************************ 00:06:48.896 02:18:13 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:48.896 02:18:13 -- common/autotest_common.sh@650 -- # local es=0 00:06:48.896 02:18:13 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:48.896 02:18:13 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:48.896 02:18:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:48.896 02:18:13 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.896 02:18:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.896 02:18:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.896 02:18:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.896 02:18:13 -- accel/accel.sh@42 -- # jq -r . 00:06:48.896 -x option must be non-negative. 00:06:48.896 [2024-11-27 02:18:13.413834] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:48.896 accel_perf options: 00:06:48.896 [-h help message] 00:06:48.896 [-q queue depth per core] 00:06:48.896 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:48.896 [-T number of threads per core 00:06:48.896 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:48.896 [-t time in seconds] 00:06:48.896 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:48.896 [ dif_verify, , dif_generate, dif_generate_copy 00:06:48.896 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:48.896 [-l for compress/decompress workloads, name of uncompressed input file 00:06:48.896 [-S for crc32c workload, use this seed value (default 0) 00:06:48.896 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:48.896 [-f for fill workload, use this BYTE value (default 255) 00:06:48.896 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:48.896 [-y verify result if this switch is on] 00:06:48.896 [-a tasks to allocate per core (default: same value as -q)] 00:06:48.896 Can be used to spread operations across a wider range of memory. 00:06:48.896 02:18:13 -- common/autotest_common.sh@653 -- # es=1 00:06:48.896 02:18:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:48.896 02:18:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:48.896 02:18:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:48.896 00:06:48.896 real 0m0.024s 00:06:48.896 user 0m0.015s 00:06:48.896 sys 0m0.009s 00:06:48.896 02:18:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.896 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.896 ************************************ 00:06:48.896 END TEST accel_negative_buffers 00:06:48.896 ************************************ 00:06:48.896 Error: writing output failed: Broken pipe 00:06:48.896 02:18:13 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:48.896 02:18:13 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:48.896 02:18:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.896 02:18:13 -- common/autotest_common.sh@10 -- # set +x 00:06:48.896 ************************************ 00:06:48.896 START TEST accel_crc32c 00:06:48.896 ************************************ 00:06:48.896 02:18:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:48.896 02:18:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:48.896 02:18:13 -- accel/accel.sh@17 -- # local accel_module 00:06:48.896 02:18:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:48.896 02:18:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.896 02:18:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.896 02:18:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.896 02:18:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.896 02:18:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.896 02:18:13 -- accel/accel.sh@42 -- # jq -r . 00:06:48.896 [2024-11-27 02:18:13.459694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:48.896 [2024-11-27 02:18:13.459750] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955848 ] 00:06:48.896 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.896 [2024-11-27 02:18:13.518236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.155 [2024-11-27 02:18:13.609281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.531 02:18:14 -- accel/accel.sh@18 -- # out=' 00:06:50.531 SPDK Configuration: 00:06:50.531 Core mask: 0x1 00:06:50.531 00:06:50.531 Accel Perf Configuration: 00:06:50.531 Workload Type: crc32c 00:06:50.531 CRC-32C seed: 32 00:06:50.531 Transfer size: 4096 bytes 00:06:50.531 Vector count 1 00:06:50.531 Module: software 00:06:50.531 Queue depth: 32 00:06:50.531 Allocate depth: 32 00:06:50.531 # threads/core: 1 00:06:50.531 Run time: 1 seconds 00:06:50.531 Verify: Yes 00:06:50.531 00:06:50.531 Running for 1 seconds... 00:06:50.531 00:06:50.531 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:50.531 ------------------------------------------------------------------------------------ 00:06:50.531 0,0 405312/s 1583 MiB/s 0 0 00:06:50.531 ==================================================================================== 00:06:50.531 Total 405312/s 1583 MiB/s 0 0' 00:06:50.531 02:18:14 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:50.531 02:18:14 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:50.531 02:18:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.531 02:18:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.531 02:18:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.531 02:18:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.531 02:18:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.531 02:18:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.531 02:18:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.531 02:18:14 -- accel/accel.sh@42 -- # jq -r . 00:06:50.531 [2024-11-27 02:18:14.856912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:50.531 [2024-11-27 02:18:14.856992] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1955995 ] 00:06:50.531 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.531 [2024-11-27 02:18:14.918797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.531 [2024-11-27 02:18:15.009071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val=0x1 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val=crc32c 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val=32 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.531 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.531 02:18:15 -- accel/accel.sh@21 -- # val=software 00:06:50.531 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.531 02:18:15 -- accel/accel.sh@23 -- # accel_module=software 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val=32 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val=32 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val=1 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val=Yes 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:50.532 02:18:15 -- accel/accel.sh@21 -- # val= 00:06:50.532 02:18:15 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # IFS=: 00:06:50.532 02:18:15 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@21 -- # val= 00:06:51.907 02:18:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # IFS=: 00:06:51.907 02:18:16 -- accel/accel.sh@20 -- # read -r var val 00:06:51.907 02:18:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:51.907 02:18:16 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:51.907 02:18:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:51.907 00:06:51.907 real 0m2.797s 00:06:51.907 user 0m2.504s 00:06:51.907 sys 0m0.286s 00:06:51.907 02:18:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.907 02:18:16 -- common/autotest_common.sh@10 -- # set +x 00:06:51.907 ************************************ 00:06:51.907 END TEST accel_crc32c 00:06:51.907 ************************************ 00:06:51.907 02:18:16 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:51.907 02:18:16 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:51.907 02:18:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.907 02:18:16 -- common/autotest_common.sh@10 -- # set +x 00:06:51.907 ************************************ 00:06:51.907 START TEST accel_crc32c_C2 00:06:51.907 ************************************ 00:06:51.907 02:18:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:51.907 02:18:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:51.907 02:18:16 -- accel/accel.sh@17 -- # local accel_module 00:06:51.907 02:18:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:51.907 02:18:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:51.907 02:18:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.907 02:18:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.907 02:18:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.907 02:18:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.907 02:18:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.907 02:18:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.907 02:18:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.907 02:18:16 -- accel/accel.sh@42 -- # jq -r . 00:06:51.907 [2024-11-27 02:18:16.281776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.907 [2024-11-27 02:18:16.281877] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1956152 ] 00:06:51.907 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.907 [2024-11-27 02:18:16.345659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.907 [2024-11-27 02:18:16.434423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.283 02:18:17 -- accel/accel.sh@18 -- # out=' 00:06:53.283 SPDK Configuration: 00:06:53.283 Core mask: 0x1 00:06:53.283 00:06:53.283 Accel Perf Configuration: 00:06:53.283 Workload Type: crc32c 00:06:53.283 CRC-32C seed: 0 00:06:53.283 Transfer size: 4096 bytes 00:06:53.283 Vector count 2 00:06:53.283 Module: software 00:06:53.283 Queue depth: 32 00:06:53.283 Allocate depth: 32 00:06:53.283 # threads/core: 1 00:06:53.283 Run time: 1 seconds 00:06:53.283 Verify: Yes 00:06:53.283 00:06:53.283 Running for 1 seconds... 00:06:53.283 00:06:53.283 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:53.283 ------------------------------------------------------------------------------------ 00:06:53.283 0,0 315520/s 2465 MiB/s 0 0 00:06:53.283 ==================================================================================== 00:06:53.283 Total 315520/s 1232 MiB/s 0 0' 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:53.283 02:18:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.283 02:18:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.283 02:18:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.283 02:18:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.283 02:18:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.283 02:18:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.283 02:18:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.283 02:18:17 -- accel/accel.sh@42 -- # jq -r . 00:06:53.283 [2024-11-27 02:18:17.672788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.283 [2024-11-27 02:18:17.672898] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1956412 ] 00:06:53.283 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.283 [2024-11-27 02:18:17.733194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.283 [2024-11-27 02:18:17.824477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=0x1 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=crc32c 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=0 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=software 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@23 -- # accel_module=software 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=32 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=32 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val=1 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.283 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.283 02:18:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:53.283 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.284 02:18:17 -- accel/accel.sh@21 -- # val=Yes 00:06:53.284 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.284 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.284 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:53.284 02:18:17 -- accel/accel.sh@21 -- # val= 00:06:53.284 02:18:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # IFS=: 00:06:53.284 02:18:17 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@21 -- # val= 00:06:54.658 02:18:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # IFS=: 00:06:54.658 02:18:19 -- accel/accel.sh@20 -- # read -r var val 00:06:54.658 02:18:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:54.658 02:18:19 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:54.658 02:18:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:54.658 00:06:54.658 real 0m2.800s 00:06:54.658 user 0m2.502s 00:06:54.658 sys 0m0.290s 00:06:54.658 02:18:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.658 02:18:19 -- common/autotest_common.sh@10 -- # set +x 00:06:54.658 ************************************ 00:06:54.658 END TEST accel_crc32c_C2 00:06:54.658 ************************************ 00:06:54.658 02:18:19 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:54.658 02:18:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:54.658 02:18:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.658 02:18:19 -- common/autotest_common.sh@10 -- # set +x 00:06:54.658 ************************************ 00:06:54.658 START TEST accel_copy 00:06:54.658 ************************************ 00:06:54.658 02:18:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:54.658 02:18:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:54.658 02:18:19 -- accel/accel.sh@17 -- # local accel_module 00:06:54.658 02:18:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:54.658 02:18:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:54.658 02:18:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.658 02:18:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.658 02:18:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.658 02:18:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.658 02:18:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.658 02:18:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.658 02:18:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.658 02:18:19 -- accel/accel.sh@42 -- # jq -r . 00:06:54.658 [2024-11-27 02:18:19.107150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:54.658 [2024-11-27 02:18:19.107231] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1956571 ] 00:06:54.659 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.659 [2024-11-27 02:18:19.168004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.659 [2024-11-27 02:18:19.255712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.031 02:18:20 -- accel/accel.sh@18 -- # out=' 00:06:56.031 SPDK Configuration: 00:06:56.031 Core mask: 0x1 00:06:56.031 00:06:56.031 Accel Perf Configuration: 00:06:56.031 Workload Type: copy 00:06:56.031 Transfer size: 4096 bytes 00:06:56.031 Vector count 1 00:06:56.031 Module: software 00:06:56.031 Queue depth: 32 00:06:56.031 Allocate depth: 32 00:06:56.031 # threads/core: 1 00:06:56.031 Run time: 1 seconds 00:06:56.031 Verify: Yes 00:06:56.031 00:06:56.031 Running for 1 seconds... 00:06:56.031 00:06:56.031 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:56.031 ------------------------------------------------------------------------------------ 00:06:56.031 0,0 277632/s 1084 MiB/s 0 0 00:06:56.031 ==================================================================================== 00:06:56.031 Total 277632/s 1084 MiB/s 0 0' 00:06:56.031 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.031 02:18:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:56.031 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.031 02:18:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:56.031 02:18:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.031 02:18:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.031 02:18:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.031 02:18:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.031 02:18:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.031 02:18:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.031 02:18:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.031 02:18:20 -- accel/accel.sh@42 -- # jq -r . 00:06:56.031 [2024-11-27 02:18:20.504727] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.031 [2024-11-27 02:18:20.504805] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1956716 ] 00:06:56.031 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.031 [2024-11-27 02:18:20.565179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.031 [2024-11-27 02:18:20.655391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=0x1 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=copy 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=software 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@23 -- # accel_module=software 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=32 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=32 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=1 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val=Yes 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:56.290 02:18:20 -- accel/accel.sh@21 -- # val= 00:06:56.290 02:18:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # IFS=: 00:06:56.290 02:18:20 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@21 -- # val= 00:06:57.665 02:18:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # IFS=: 00:06:57.665 02:18:21 -- accel/accel.sh@20 -- # read -r var val 00:06:57.665 02:18:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:57.665 02:18:21 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:57.665 02:18:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:57.665 00:06:57.665 real 0m2.802s 00:06:57.665 user 0m2.500s 00:06:57.665 sys 0m0.293s 00:06:57.665 02:18:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.665 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:57.665 ************************************ 00:06:57.665 END TEST accel_copy 00:06:57.665 ************************************ 00:06:57.665 02:18:21 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:57.665 02:18:21 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:57.665 02:18:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.665 02:18:21 -- common/autotest_common.sh@10 -- # set +x 00:06:57.665 ************************************ 00:06:57.665 START TEST accel_fill 00:06:57.665 ************************************ 00:06:57.665 02:18:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:57.665 02:18:21 -- accel/accel.sh@16 -- # local accel_opc 00:06:57.665 02:18:21 -- accel/accel.sh@17 -- # local accel_module 00:06:57.665 02:18:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:57.665 02:18:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:57.665 02:18:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.665 02:18:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.665 02:18:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.665 02:18:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.665 02:18:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.665 02:18:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.665 02:18:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.665 02:18:21 -- accel/accel.sh@42 -- # jq -r . 00:06:57.665 [2024-11-27 02:18:21.932293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:57.665 [2024-11-27 02:18:21.932371] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1956877 ] 00:06:57.665 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.665 [2024-11-27 02:18:21.994474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.665 [2024-11-27 02:18:22.089522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.039 02:18:23 -- accel/accel.sh@18 -- # out=' 00:06:59.039 SPDK Configuration: 00:06:59.039 Core mask: 0x1 00:06:59.039 00:06:59.039 Accel Perf Configuration: 00:06:59.039 Workload Type: fill 00:06:59.039 Fill pattern: 0x80 00:06:59.039 Transfer size: 4096 bytes 00:06:59.039 Vector count 1 00:06:59.039 Module: software 00:06:59.039 Queue depth: 64 00:06:59.039 Allocate depth: 64 00:06:59.039 # threads/core: 1 00:06:59.039 Run time: 1 seconds 00:06:59.039 Verify: Yes 00:06:59.039 00:06:59.039 Running for 1 seconds... 00:06:59.039 00:06:59.039 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.039 ------------------------------------------------------------------------------------ 00:06:59.039 0,0 405888/s 1585 MiB/s 0 0 00:06:59.039 ==================================================================================== 00:06:59.039 Total 405888/s 1585 MiB/s 0 0' 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.039 02:18:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.039 02:18:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.039 02:18:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.039 02:18:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.039 02:18:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.039 02:18:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.039 02:18:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.039 02:18:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.039 02:18:23 -- accel/accel.sh@42 -- # jq -r . 00:06:59.039 [2024-11-27 02:18:23.331137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.039 [2024-11-27 02:18:23.331218] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1957139 ] 00:06:59.039 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.039 [2024-11-27 02:18:23.392613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.039 [2024-11-27 02:18:23.483536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=0x1 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=fill 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=0x80 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=software 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@23 -- # accel_module=software 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=64 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=64 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=1 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val=Yes 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:06:59.039 02:18:23 -- accel/accel.sh@21 -- # val= 00:06:59.039 02:18:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # IFS=: 00:06:59.039 02:18:23 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@21 -- # val= 00:07:00.435 02:18:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # IFS=: 00:07:00.435 02:18:24 -- accel/accel.sh@20 -- # read -r var val 00:07:00.435 02:18:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:00.435 02:18:24 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:00.435 02:18:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:00.435 00:07:00.435 real 0m2.801s 00:07:00.435 user 0m2.501s 00:07:00.435 sys 0m0.292s 00:07:00.435 02:18:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.435 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 ************************************ 00:07:00.435 END TEST accel_fill 00:07:00.435 ************************************ 00:07:00.435 02:18:24 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:00.435 02:18:24 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:00.435 02:18:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.435 02:18:24 -- common/autotest_common.sh@10 -- # set +x 00:07:00.435 ************************************ 00:07:00.435 START TEST accel_copy_crc32c 00:07:00.435 ************************************ 00:07:00.435 02:18:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:00.435 02:18:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:00.435 02:18:24 -- accel/accel.sh@17 -- # local accel_module 00:07:00.435 02:18:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:00.435 02:18:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:00.435 02:18:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.435 02:18:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.435 02:18:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.435 02:18:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.435 02:18:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.435 02:18:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.435 02:18:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.435 02:18:24 -- accel/accel.sh@42 -- # jq -r . 00:07:00.435 [2024-11-27 02:18:24.756378] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:00.435 [2024-11-27 02:18:24.756459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1957310 ] 00:07:00.435 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.435 [2024-11-27 02:18:24.819366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.435 [2024-11-27 02:18:24.910124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.810 02:18:26 -- accel/accel.sh@18 -- # out=' 00:07:01.810 SPDK Configuration: 00:07:01.810 Core mask: 0x1 00:07:01.810 00:07:01.810 Accel Perf Configuration: 00:07:01.810 Workload Type: copy_crc32c 00:07:01.810 CRC-32C seed: 0 00:07:01.810 Vector size: 4096 bytes 00:07:01.810 Transfer size: 4096 bytes 00:07:01.810 Vector count 1 00:07:01.810 Module: software 00:07:01.810 Queue depth: 32 00:07:01.810 Allocate depth: 32 00:07:01.810 # threads/core: 1 00:07:01.810 Run time: 1 seconds 00:07:01.810 Verify: Yes 00:07:01.810 00:07:01.810 Running for 1 seconds... 00:07:01.810 00:07:01.810 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:01.810 ------------------------------------------------------------------------------------ 00:07:01.810 0,0 219520/s 857 MiB/s 0 0 00:07:01.810 ==================================================================================== 00:07:01.810 Total 219520/s 857 MiB/s 0 0' 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:01.810 02:18:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.810 02:18:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.810 02:18:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.810 02:18:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.810 02:18:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.810 02:18:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.810 02:18:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.810 02:18:26 -- accel/accel.sh@42 -- # jq -r . 00:07:01.810 [2024-11-27 02:18:26.156336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:01.810 [2024-11-27 02:18:26.156406] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1957457 ] 00:07:01.810 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.810 [2024-11-27 02:18:26.217147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.810 [2024-11-27 02:18:26.307347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=0x1 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=0 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=software 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=32 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=32 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=1 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val=Yes 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:01.810 02:18:26 -- accel/accel.sh@21 -- # val= 00:07:01.810 02:18:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # IFS=: 00:07:01.810 02:18:26 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@21 -- # val= 00:07:03.184 02:18:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # IFS=: 00:07:03.184 02:18:27 -- accel/accel.sh@20 -- # read -r var val 00:07:03.184 02:18:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:03.184 02:18:27 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:03.184 02:18:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:03.184 00:07:03.184 real 0m2.803s 00:07:03.184 user 0m2.500s 00:07:03.184 sys 0m0.295s 00:07:03.184 02:18:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.184 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.184 ************************************ 00:07:03.184 END TEST accel_copy_crc32c 00:07:03.184 ************************************ 00:07:03.184 02:18:27 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:03.184 02:18:27 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:03.184 02:18:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.184 02:18:27 -- common/autotest_common.sh@10 -- # set +x 00:07:03.184 ************************************ 00:07:03.184 START TEST accel_copy_crc32c_C2 00:07:03.184 ************************************ 00:07:03.184 02:18:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:03.184 02:18:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:03.184 02:18:27 -- accel/accel.sh@17 -- # local accel_module 00:07:03.184 02:18:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:03.184 02:18:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:03.184 02:18:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.184 02:18:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.184 02:18:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.184 02:18:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.184 02:18:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.184 02:18:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.184 02:18:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.184 02:18:27 -- accel/accel.sh@42 -- # jq -r . 00:07:03.184 [2024-11-27 02:18:27.584754] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:03.184 [2024-11-27 02:18:27.584846] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1957610 ] 00:07:03.184 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.184 [2024-11-27 02:18:27.646977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.184 [2024-11-27 02:18:27.739734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.557 02:18:28 -- accel/accel.sh@18 -- # out=' 00:07:04.557 SPDK Configuration: 00:07:04.557 Core mask: 0x1 00:07:04.557 00:07:04.557 Accel Perf Configuration: 00:07:04.557 Workload Type: copy_crc32c 00:07:04.557 CRC-32C seed: 0 00:07:04.557 Vector size: 4096 bytes 00:07:04.557 Transfer size: 8192 bytes 00:07:04.557 Vector count 2 00:07:04.558 Module: software 00:07:04.558 Queue depth: 32 00:07:04.558 Allocate depth: 32 00:07:04.558 # threads/core: 1 00:07:04.558 Run time: 1 seconds 00:07:04.558 Verify: Yes 00:07:04.558 00:07:04.558 Running for 1 seconds... 00:07:04.558 00:07:04.558 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:04.558 ------------------------------------------------------------------------------------ 00:07:04.558 0,0 154784/s 1209 MiB/s 0 0 00:07:04.558 ==================================================================================== 00:07:04.558 Total 154784/s 604 MiB/s 0 0' 00:07:04.558 02:18:28 -- accel/accel.sh@20 -- # IFS=: 00:07:04.558 02:18:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:04.558 02:18:28 -- accel/accel.sh@20 -- # read -r var val 00:07:04.558 02:18:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:04.558 02:18:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.558 02:18:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.558 02:18:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.558 02:18:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.558 02:18:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.558 02:18:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.558 02:18:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.558 02:18:28 -- accel/accel.sh@42 -- # jq -r . 00:07:04.558 [2024-11-27 02:18:28.978984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.558 [2024-11-27 02:18:28.979057] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1957878 ] 00:07:04.558 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.558 [2024-11-27 02:18:29.038654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.558 [2024-11-27 02:18:29.130308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.815 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.815 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.815 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.815 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.815 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.815 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.815 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=0x1 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=0 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=software 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@23 -- # accel_module=software 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=32 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=32 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=1 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val=Yes 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:04.816 02:18:29 -- accel/accel.sh@21 -- # val= 00:07:04.816 02:18:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # IFS=: 00:07:04.816 02:18:29 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@21 -- # val= 00:07:05.751 02:18:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # IFS=: 00:07:05.751 02:18:30 -- accel/accel.sh@20 -- # read -r var val 00:07:05.751 02:18:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.751 02:18:30 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:05.751 02:18:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.751 00:07:05.751 real 0m2.804s 00:07:05.751 user 0m2.507s 00:07:05.751 sys 0m0.288s 00:07:05.751 02:18:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.751 02:18:30 -- common/autotest_common.sh@10 -- # set +x 00:07:05.751 ************************************ 00:07:05.751 END TEST accel_copy_crc32c_C2 00:07:05.751 ************************************ 00:07:06.011 02:18:30 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:06.011 02:18:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:06.011 02:18:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.011 02:18:30 -- common/autotest_common.sh@10 -- # set +x 00:07:06.011 ************************************ 00:07:06.011 START TEST accel_dualcast 00:07:06.011 ************************************ 00:07:06.011 02:18:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:06.011 02:18:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:06.011 02:18:30 -- accel/accel.sh@17 -- # local accel_module 00:07:06.011 02:18:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:06.011 02:18:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:06.011 02:18:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.011 02:18:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.011 02:18:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.011 02:18:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.011 02:18:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.011 02:18:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.011 02:18:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.011 02:18:30 -- accel/accel.sh@42 -- # jq -r . 00:07:06.011 [2024-11-27 02:18:30.408368] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.011 [2024-11-27 02:18:30.408459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958037 ] 00:07:06.011 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.011 [2024-11-27 02:18:30.471383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.011 [2024-11-27 02:18:30.559754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.385 02:18:31 -- accel/accel.sh@18 -- # out=' 00:07:07.385 SPDK Configuration: 00:07:07.385 Core mask: 0x1 00:07:07.385 00:07:07.385 Accel Perf Configuration: 00:07:07.385 Workload Type: dualcast 00:07:07.385 Transfer size: 4096 bytes 00:07:07.385 Vector count 1 00:07:07.385 Module: software 00:07:07.385 Queue depth: 32 00:07:07.385 Allocate depth: 32 00:07:07.385 # threads/core: 1 00:07:07.385 Run time: 1 seconds 00:07:07.385 Verify: Yes 00:07:07.385 00:07:07.385 Running for 1 seconds... 00:07:07.385 00:07:07.385 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:07.385 ------------------------------------------------------------------------------------ 00:07:07.385 0,0 300288/s 1173 MiB/s 0 0 00:07:07.385 ==================================================================================== 00:07:07.385 Total 300288/s 1173 MiB/s 0 0' 00:07:07.385 02:18:31 -- accel/accel.sh@20 -- # IFS=: 00:07:07.385 02:18:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:07.385 02:18:31 -- accel/accel.sh@20 -- # read -r var val 00:07:07.385 02:18:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:07.385 02:18:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.385 02:18:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.385 02:18:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.385 02:18:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.385 02:18:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.385 02:18:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.385 02:18:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.385 02:18:31 -- accel/accel.sh@42 -- # jq -r . 00:07:07.385 [2024-11-27 02:18:31.809611] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:07.385 [2024-11-27 02:18:31.809685] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958176 ] 00:07:07.385 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.385 [2024-11-27 02:18:31.869773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.386 [2024-11-27 02:18:31.960292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=0x1 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=dualcast 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=software 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=32 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=32 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=1 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val=Yes 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:07.644 02:18:32 -- accel/accel.sh@21 -- # val= 00:07:07.644 02:18:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # IFS=: 00:07:07.644 02:18:32 -- accel/accel.sh@20 -- # read -r var val 00:07:08.578 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.578 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.578 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.578 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.579 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.579 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.579 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.579 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@21 -- # val= 00:07:08.579 02:18:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # IFS=: 00:07:08.579 02:18:33 -- accel/accel.sh@20 -- # read -r var val 00:07:08.579 02:18:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:08.579 02:18:33 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:08.579 02:18:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:08.579 00:07:08.579 real 0m2.806s 00:07:08.579 user 0m2.513s 00:07:08.579 sys 0m0.285s 00:07:08.579 02:18:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.579 02:18:33 -- common/autotest_common.sh@10 -- # set +x 00:07:08.579 ************************************ 00:07:08.579 END TEST accel_dualcast 00:07:08.579 ************************************ 00:07:08.838 02:18:33 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:08.838 02:18:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:08.838 02:18:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.838 02:18:33 -- common/autotest_common.sh@10 -- # set +x 00:07:08.838 ************************************ 00:07:08.838 START TEST accel_compare 00:07:08.838 ************************************ 00:07:08.838 02:18:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:08.838 02:18:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:08.838 02:18:33 -- accel/accel.sh@17 -- # local accel_module 00:07:08.838 02:18:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:08.838 02:18:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:08.838 02:18:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.838 02:18:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.838 02:18:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.838 02:18:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.838 02:18:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.838 02:18:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.838 02:18:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.838 02:18:33 -- accel/accel.sh@42 -- # jq -r . 00:07:08.838 [2024-11-27 02:18:33.246461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.838 [2024-11-27 02:18:33.246575] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958337 ] 00:07:08.838 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.838 [2024-11-27 02:18:33.309280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.838 [2024-11-27 02:18:33.400819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.210 02:18:34 -- accel/accel.sh@18 -- # out=' 00:07:10.210 SPDK Configuration: 00:07:10.210 Core mask: 0x1 00:07:10.210 00:07:10.210 Accel Perf Configuration: 00:07:10.210 Workload Type: compare 00:07:10.210 Transfer size: 4096 bytes 00:07:10.210 Vector count 1 00:07:10.210 Module: software 00:07:10.210 Queue depth: 32 00:07:10.210 Allocate depth: 32 00:07:10.210 # threads/core: 1 00:07:10.210 Run time: 1 seconds 00:07:10.210 Verify: Yes 00:07:10.210 00:07:10.210 Running for 1 seconds... 00:07:10.210 00:07:10.210 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:10.210 ------------------------------------------------------------------------------------ 00:07:10.210 0,0 397920/s 1554 MiB/s 0 0 00:07:10.210 ==================================================================================== 00:07:10.210 Total 397920/s 1554 MiB/s 0 0' 00:07:10.210 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.210 02:18:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:10.210 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.210 02:18:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:10.210 02:18:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.210 02:18:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.210 02:18:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.210 02:18:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.210 02:18:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.210 02:18:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.210 02:18:34 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.210 02:18:34 -- accel/accel.sh@42 -- # jq -r . 00:07:10.210 [2024-11-27 02:18:34.641545] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:10.210 [2024-11-27 02:18:34.641649] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958599 ] 00:07:10.210 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.210 [2024-11-27 02:18:34.704214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.210 [2024-11-27 02:18:34.795223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=0x1 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=compare 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=software 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@23 -- # accel_module=software 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=32 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=32 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=1 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val=Yes 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:10.498 02:18:34 -- accel/accel.sh@21 -- # val= 00:07:10.498 02:18:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # IFS=: 00:07:10.498 02:18:34 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@21 -- # val= 00:07:11.463 02:18:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # IFS=: 00:07:11.463 02:18:36 -- accel/accel.sh@20 -- # read -r var val 00:07:11.463 02:18:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:11.463 02:18:36 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:11.463 02:18:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.463 00:07:11.463 real 0m2.804s 00:07:11.463 user 0m2.502s 00:07:11.463 sys 0m0.294s 00:07:11.463 02:18:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.463 02:18:36 -- common/autotest_common.sh@10 -- # set +x 00:07:11.463 ************************************ 00:07:11.463 END TEST accel_compare 00:07:11.463 ************************************ 00:07:11.463 02:18:36 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:11.463 02:18:36 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:11.463 02:18:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.463 02:18:36 -- common/autotest_common.sh@10 -- # set +x 00:07:11.463 ************************************ 00:07:11.463 START TEST accel_xor 00:07:11.463 ************************************ 00:07:11.463 02:18:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:11.463 02:18:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.463 02:18:36 -- accel/accel.sh@17 -- # local accel_module 00:07:11.463 02:18:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:11.463 02:18:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:11.463 02:18:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.463 02:18:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.463 02:18:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.463 02:18:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.463 02:18:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.463 02:18:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.463 02:18:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.463 02:18:36 -- accel/accel.sh@42 -- # jq -r . 00:07:11.463 [2024-11-27 02:18:36.072960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.463 [2024-11-27 02:18:36.073034] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958769 ] 00:07:11.721 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.721 [2024-11-27 02:18:36.136993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.721 [2024-11-27 02:18:36.226893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.094 02:18:37 -- accel/accel.sh@18 -- # out=' 00:07:13.094 SPDK Configuration: 00:07:13.094 Core mask: 0x1 00:07:13.094 00:07:13.094 Accel Perf Configuration: 00:07:13.094 Workload Type: xor 00:07:13.094 Source buffers: 2 00:07:13.094 Transfer size: 4096 bytes 00:07:13.094 Vector count 1 00:07:13.094 Module: software 00:07:13.094 Queue depth: 32 00:07:13.094 Allocate depth: 32 00:07:13.094 # threads/core: 1 00:07:13.094 Run time: 1 seconds 00:07:13.094 Verify: Yes 00:07:13.094 00:07:13.094 Running for 1 seconds... 00:07:13.094 00:07:13.094 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:13.094 ------------------------------------------------------------------------------------ 00:07:13.094 0,0 193632/s 756 MiB/s 0 0 00:07:13.094 ==================================================================================== 00:07:13.094 Total 193632/s 756 MiB/s 0 0' 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:13.094 02:18:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.094 02:18:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.094 02:18:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.094 02:18:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.094 02:18:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.094 02:18:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.094 02:18:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.094 02:18:37 -- accel/accel.sh@42 -- # jq -r . 00:07:13.094 [2024-11-27 02:18:37.476695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.094 [2024-11-27 02:18:37.476771] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1958908 ] 00:07:13.094 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.094 [2024-11-27 02:18:37.537290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.094 [2024-11-27 02:18:37.627924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=0x1 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=xor 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=2 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=software 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@23 -- # accel_module=software 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=32 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=32 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=1 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val=Yes 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:13.094 02:18:37 -- accel/accel.sh@21 -- # val= 00:07:13.094 02:18:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # IFS=: 00:07:13.094 02:18:37 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@21 -- # val= 00:07:14.468 02:18:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # IFS=: 00:07:14.468 02:18:38 -- accel/accel.sh@20 -- # read -r var val 00:07:14.468 02:18:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:14.468 02:18:38 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:14.468 02:18:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:14.468 00:07:14.468 real 0m2.810s 00:07:14.468 user 0m2.507s 00:07:14.468 sys 0m0.295s 00:07:14.468 02:18:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.468 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:07:14.468 ************************************ 00:07:14.468 END TEST accel_xor 00:07:14.468 ************************************ 00:07:14.468 02:18:38 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:14.468 02:18:38 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:14.468 02:18:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.468 02:18:38 -- common/autotest_common.sh@10 -- # set +x 00:07:14.468 ************************************ 00:07:14.468 START TEST accel_xor 00:07:14.468 ************************************ 00:07:14.468 02:18:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:14.468 02:18:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.468 02:18:38 -- accel/accel.sh@17 -- # local accel_module 00:07:14.468 02:18:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:14.468 02:18:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:14.468 02:18:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.468 02:18:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.468 02:18:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.468 02:18:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.468 02:18:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.468 02:18:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.468 02:18:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.468 02:18:38 -- accel/accel.sh@42 -- # jq -r . 00:07:14.468 [2024-11-27 02:18:38.905895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:14.468 [2024-11-27 02:18:38.905968] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1959063 ] 00:07:14.468 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.468 [2024-11-27 02:18:38.967053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.468 [2024-11-27 02:18:39.062307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.839 02:18:40 -- accel/accel.sh@18 -- # out=' 00:07:15.839 SPDK Configuration: 00:07:15.839 Core mask: 0x1 00:07:15.839 00:07:15.839 Accel Perf Configuration: 00:07:15.839 Workload Type: xor 00:07:15.839 Source buffers: 3 00:07:15.839 Transfer size: 4096 bytes 00:07:15.839 Vector count 1 00:07:15.839 Module: software 00:07:15.839 Queue depth: 32 00:07:15.839 Allocate depth: 32 00:07:15.839 # threads/core: 1 00:07:15.839 Run time: 1 seconds 00:07:15.839 Verify: Yes 00:07:15.839 00:07:15.839 Running for 1 seconds... 00:07:15.839 00:07:15.839 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:15.839 ------------------------------------------------------------------------------------ 00:07:15.839 0,0 182304/s 712 MiB/s 0 0 00:07:15.839 ==================================================================================== 00:07:15.839 Total 182304/s 712 MiB/s 0 0' 00:07:15.839 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:15.839 02:18:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:15.839 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:15.839 02:18:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:15.839 02:18:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.839 02:18:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.839 02:18:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.839 02:18:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.839 02:18:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.839 02:18:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.839 02:18:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.839 02:18:40 -- accel/accel.sh@42 -- # jq -r . 00:07:15.839 [2024-11-27 02:18:40.306996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:15.839 [2024-11-27 02:18:40.307075] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1959328 ] 00:07:15.839 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.839 [2024-11-27 02:18:40.370805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.839 [2024-11-27 02:18:40.461770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val=0x1 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val=xor 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val=3 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.097 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.097 02:18:40 -- accel/accel.sh@21 -- # val=software 00:07:16.097 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.097 02:18:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val=32 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val=32 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val=1 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val=Yes 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:16.098 02:18:40 -- accel/accel.sh@21 -- # val= 00:07:16.098 02:18:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # IFS=: 00:07:16.098 02:18:40 -- accel/accel.sh@20 -- # read -r var val 00:07:17.471 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.471 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.471 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.471 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.471 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.471 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.471 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.472 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.472 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.472 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.472 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.472 02:18:41 -- accel/accel.sh@21 -- # val= 00:07:17.472 02:18:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # IFS=: 00:07:17.472 02:18:41 -- accel/accel.sh@20 -- # read -r var val 00:07:17.472 02:18:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:17.472 02:18:41 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:17.472 02:18:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:17.472 00:07:17.472 real 0m2.808s 00:07:17.472 user 0m2.506s 00:07:17.472 sys 0m0.294s 00:07:17.472 02:18:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.472 02:18:41 -- common/autotest_common.sh@10 -- # set +x 00:07:17.472 ************************************ 00:07:17.472 END TEST accel_xor 00:07:17.472 ************************************ 00:07:17.472 02:18:41 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:17.472 02:18:41 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:17.472 02:18:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.472 02:18:41 -- common/autotest_common.sh@10 -- # set +x 00:07:17.472 ************************************ 00:07:17.472 START TEST accel_dif_verify 00:07:17.472 ************************************ 00:07:17.472 02:18:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:17.472 02:18:41 -- accel/accel.sh@16 -- # local accel_opc 00:07:17.472 02:18:41 -- accel/accel.sh@17 -- # local accel_module 00:07:17.472 02:18:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:17.472 02:18:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:17.472 02:18:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.472 02:18:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.472 02:18:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.472 02:18:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.472 02:18:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.472 02:18:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.472 02:18:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.472 02:18:41 -- accel/accel.sh@42 -- # jq -r . 00:07:17.472 [2024-11-27 02:18:41.738654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:17.472 [2024-11-27 02:18:41.738728] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1959486 ] 00:07:17.472 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.472 [2024-11-27 02:18:41.800108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.472 [2024-11-27 02:18:41.887728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.844 02:18:43 -- accel/accel.sh@18 -- # out=' 00:07:18.844 SPDK Configuration: 00:07:18.844 Core mask: 0x1 00:07:18.844 00:07:18.844 Accel Perf Configuration: 00:07:18.844 Workload Type: dif_verify 00:07:18.844 Vector size: 4096 bytes 00:07:18.844 Transfer size: 4096 bytes 00:07:18.844 Block size: 512 bytes 00:07:18.844 Metadata size: 8 bytes 00:07:18.844 Vector count 1 00:07:18.844 Module: software 00:07:18.844 Queue depth: 32 00:07:18.844 Allocate depth: 32 00:07:18.844 # threads/core: 1 00:07:18.844 Run time: 1 seconds 00:07:18.844 Verify: No 00:07:18.844 00:07:18.844 Running for 1 seconds... 00:07:18.844 00:07:18.844 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:18.844 ------------------------------------------------------------------------------------ 00:07:18.844 0,0 81888/s 324 MiB/s 0 0 00:07:18.844 ==================================================================================== 00:07:18.844 Total 81888/s 319 MiB/s 0 0' 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:18.844 02:18:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.844 02:18:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.844 02:18:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.844 02:18:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.844 02:18:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.844 02:18:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.844 02:18:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.844 02:18:43 -- accel/accel.sh@42 -- # jq -r . 00:07:18.844 [2024-11-27 02:18:43.130972] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:18.844 [2024-11-27 02:18:43.131041] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1959635 ] 00:07:18.844 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.844 [2024-11-27 02:18:43.191585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.844 [2024-11-27 02:18:43.282620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val=0x1 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val=dif_verify 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val=software 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val=32 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.844 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.844 02:18:43 -- accel/accel.sh@21 -- # val=32 00:07:18.844 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.845 02:18:43 -- accel/accel.sh@21 -- # val=1 00:07:18.845 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.845 02:18:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:18.845 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.845 02:18:43 -- accel/accel.sh@21 -- # val=No 00:07:18.845 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.845 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.845 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:18.845 02:18:43 -- accel/accel.sh@21 -- # val= 00:07:18.845 02:18:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # IFS=: 00:07:18.845 02:18:43 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@21 -- # val= 00:07:20.221 02:18:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # IFS=: 00:07:20.221 02:18:44 -- accel/accel.sh@20 -- # read -r var val 00:07:20.221 02:18:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:20.221 02:18:44 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:20.221 02:18:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:20.221 00:07:20.221 real 0m2.800s 00:07:20.221 user 0m2.512s 00:07:20.221 sys 0m0.283s 00:07:20.221 02:18:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.221 02:18:44 -- common/autotest_common.sh@10 -- # set +x 00:07:20.221 ************************************ 00:07:20.221 END TEST accel_dif_verify 00:07:20.221 ************************************ 00:07:20.221 02:18:44 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:20.221 02:18:44 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:20.221 02:18:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.221 02:18:44 -- common/autotest_common.sh@10 -- # set +x 00:07:20.221 ************************************ 00:07:20.221 START TEST accel_dif_generate 00:07:20.221 ************************************ 00:07:20.221 02:18:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:20.221 02:18:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:20.221 02:18:44 -- accel/accel.sh@17 -- # local accel_module 00:07:20.221 02:18:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:20.221 02:18:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:20.221 02:18:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.221 02:18:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.221 02:18:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.221 02:18:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.221 02:18:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.221 02:18:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.221 02:18:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.221 02:18:44 -- accel/accel.sh@42 -- # jq -r . 00:07:20.221 [2024-11-27 02:18:44.561825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:20.221 [2024-11-27 02:18:44.561904] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1959790 ] 00:07:20.221 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.221 [2024-11-27 02:18:44.623438] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.221 [2024-11-27 02:18:44.718384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.595 02:18:45 -- accel/accel.sh@18 -- # out=' 00:07:21.595 SPDK Configuration: 00:07:21.595 Core mask: 0x1 00:07:21.595 00:07:21.595 Accel Perf Configuration: 00:07:21.595 Workload Type: dif_generate 00:07:21.595 Vector size: 4096 bytes 00:07:21.595 Transfer size: 4096 bytes 00:07:21.595 Block size: 512 bytes 00:07:21.595 Metadata size: 8 bytes 00:07:21.595 Vector count 1 00:07:21.595 Module: software 00:07:21.595 Queue depth: 32 00:07:21.595 Allocate depth: 32 00:07:21.595 # threads/core: 1 00:07:21.595 Run time: 1 seconds 00:07:21.595 Verify: No 00:07:21.595 00:07:21.595 Running for 1 seconds... 00:07:21.595 00:07:21.595 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:21.595 ------------------------------------------------------------------------------------ 00:07:21.595 0,0 96128/s 381 MiB/s 0 0 00:07:21.595 ==================================================================================== 00:07:21.595 Total 96128/s 375 MiB/s 0 0' 00:07:21.595 02:18:45 -- accel/accel.sh@20 -- # IFS=: 00:07:21.595 02:18:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:21.595 02:18:45 -- accel/accel.sh@20 -- # read -r var val 00:07:21.595 02:18:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:21.595 02:18:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.595 02:18:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.595 02:18:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.595 02:18:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.595 02:18:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.595 02:18:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.595 02:18:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.595 02:18:45 -- accel/accel.sh@42 -- # jq -r . 00:07:21.595 [2024-11-27 02:18:45.959210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.595 [2024-11-27 02:18:45.959278] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960032 ] 00:07:21.596 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.596 [2024-11-27 02:18:46.020169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.596 [2024-11-27 02:18:46.108901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=0x1 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=dif_generate 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=software 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=32 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=32 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=1 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val=No 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:21.596 02:18:46 -- accel/accel.sh@21 -- # val= 00:07:21.596 02:18:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # IFS=: 00:07:21.596 02:18:46 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@21 -- # val= 00:07:22.975 02:18:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # IFS=: 00:07:22.975 02:18:47 -- accel/accel.sh@20 -- # read -r var val 00:07:22.975 02:18:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.975 02:18:47 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:22.975 02:18:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.975 00:07:22.975 real 0m2.795s 00:07:22.975 user 0m2.509s 00:07:22.975 sys 0m0.281s 00:07:22.975 02:18:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.975 02:18:47 -- common/autotest_common.sh@10 -- # set +x 00:07:22.975 ************************************ 00:07:22.975 END TEST accel_dif_generate 00:07:22.975 ************************************ 00:07:22.975 02:18:47 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:22.975 02:18:47 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:22.975 02:18:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.975 02:18:47 -- common/autotest_common.sh@10 -- # set +x 00:07:22.975 ************************************ 00:07:22.975 START TEST accel_dif_generate_copy 00:07:22.975 ************************************ 00:07:22.975 02:18:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:22.975 02:18:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.975 02:18:47 -- accel/accel.sh@17 -- # local accel_module 00:07:22.975 02:18:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:22.975 02:18:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:22.975 02:18:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.975 02:18:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.975 02:18:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.975 02:18:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.975 02:18:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.975 02:18:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.975 02:18:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.975 02:18:47 -- accel/accel.sh@42 -- # jq -r . 00:07:22.975 [2024-11-27 02:18:47.379875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.975 [2024-11-27 02:18:47.379952] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960213 ] 00:07:22.975 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.975 [2024-11-27 02:18:47.441821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.975 [2024-11-27 02:18:47.529458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.349 02:18:48 -- accel/accel.sh@18 -- # out=' 00:07:24.349 SPDK Configuration: 00:07:24.349 Core mask: 0x1 00:07:24.349 00:07:24.349 Accel Perf Configuration: 00:07:24.349 Workload Type: dif_generate_copy 00:07:24.349 Vector size: 4096 bytes 00:07:24.349 Transfer size: 4096 bytes 00:07:24.349 Vector count 1 00:07:24.349 Module: software 00:07:24.349 Queue depth: 32 00:07:24.349 Allocate depth: 32 00:07:24.349 # threads/core: 1 00:07:24.349 Run time: 1 seconds 00:07:24.349 Verify: No 00:07:24.349 00:07:24.349 Running for 1 seconds... 00:07:24.349 00:07:24.349 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:24.349 ------------------------------------------------------------------------------------ 00:07:24.349 0,0 76256/s 302 MiB/s 0 0 00:07:24.349 ==================================================================================== 00:07:24.349 Total 76256/s 297 MiB/s 0 0' 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.349 02:18:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.349 02:18:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:24.349 02:18:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.349 02:18:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.349 02:18:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.349 02:18:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.349 02:18:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.349 02:18:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.349 02:18:48 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.349 02:18:48 -- accel/accel.sh@42 -- # jq -r . 00:07:24.349 [2024-11-27 02:18:48.766475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:24.349 [2024-11-27 02:18:48.766564] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960356 ] 00:07:24.349 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.349 [2024-11-27 02:18:48.828179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.349 [2024-11-27 02:18:48.918255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.349 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.349 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.349 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.349 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.349 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.349 02:18:48 -- accel/accel.sh@21 -- # val=0x1 00:07:24.350 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.350 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.350 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.350 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.350 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.350 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.350 02:18:48 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:24.350 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.350 02:18:48 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val=software 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@23 -- # accel_module=software 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val=32 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val=32 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val=1 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val=No 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:24.608 02:18:48 -- accel/accel.sh@21 -- # val= 00:07:24.608 02:18:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # IFS=: 00:07:24.608 02:18:48 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@21 -- # val= 00:07:25.540 02:18:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # IFS=: 00:07:25.540 02:18:50 -- accel/accel.sh@20 -- # read -r var val 00:07:25.540 02:18:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:25.540 02:18:50 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:25.540 02:18:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.540 00:07:25.540 real 0m2.791s 00:07:25.540 user 0m2.495s 00:07:25.540 sys 0m0.289s 00:07:25.540 02:18:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.540 02:18:50 -- common/autotest_common.sh@10 -- # set +x 00:07:25.540 ************************************ 00:07:25.540 END TEST accel_dif_generate_copy 00:07:25.541 ************************************ 00:07:25.798 02:18:50 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:25.798 02:18:50 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.798 02:18:50 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:25.798 02:18:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.798 02:18:50 -- common/autotest_common.sh@10 -- # set +x 00:07:25.798 ************************************ 00:07:25.798 START TEST accel_comp 00:07:25.798 ************************************ 00:07:25.798 02:18:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.798 02:18:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.798 02:18:50 -- accel/accel.sh@17 -- # local accel_module 00:07:25.798 02:18:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.798 02:18:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.798 02:18:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.798 02:18:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.798 02:18:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.798 02:18:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.798 02:18:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.798 02:18:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.798 02:18:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.798 02:18:50 -- accel/accel.sh@42 -- # jq -r . 00:07:25.798 [2024-11-27 02:18:50.195138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.798 [2024-11-27 02:18:50.195218] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960517 ] 00:07:25.798 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.798 [2024-11-27 02:18:50.258310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.798 [2024-11-27 02:18:50.349794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.171 02:18:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:27.171 00:07:27.171 SPDK Configuration: 00:07:27.171 Core mask: 0x1 00:07:27.171 00:07:27.171 Accel Perf Configuration: 00:07:27.171 Workload Type: compress 00:07:27.171 Transfer size: 4096 bytes 00:07:27.171 Vector count 1 00:07:27.171 Module: software 00:07:27.171 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.171 Queue depth: 32 00:07:27.171 Allocate depth: 32 00:07:27.171 # threads/core: 1 00:07:27.171 Run time: 1 seconds 00:07:27.171 Verify: No 00:07:27.171 00:07:27.171 Running for 1 seconds... 00:07:27.171 00:07:27.171 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:27.171 ------------------------------------------------------------------------------------ 00:07:27.171 0,0 31552/s 131 MiB/s 0 0 00:07:27.171 ==================================================================================== 00:07:27.171 Total 31552/s 123 MiB/s 0 0' 00:07:27.171 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.171 02:18:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.171 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.171 02:18:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.171 02:18:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.171 02:18:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.171 02:18:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.171 02:18:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.171 02:18:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.171 02:18:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.171 02:18:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.171 02:18:51 -- accel/accel.sh@42 -- # jq -r . 00:07:27.171 [2024-11-27 02:18:51.597307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:27.171 [2024-11-27 02:18:51.597387] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960692 ] 00:07:27.171 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.171 [2024-11-27 02:18:51.656515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.171 [2024-11-27 02:18:51.746405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=0x1 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=compress 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=software 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@23 -- # accel_module=software 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=32 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=32 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=1 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val=No 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:27.429 02:18:51 -- accel/accel.sh@21 -- # val= 00:07:27.429 02:18:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # IFS=: 00:07:27.429 02:18:51 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@21 -- # val= 00:07:28.363 02:18:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # IFS=: 00:07:28.363 02:18:52 -- accel/accel.sh@20 -- # read -r var val 00:07:28.363 02:18:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:28.363 02:18:52 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:28.363 02:18:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.363 00:07:28.363 real 0m2.800s 00:07:28.363 user 0m2.515s 00:07:28.363 sys 0m0.279s 00:07:28.363 02:18:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.363 02:18:52 -- common/autotest_common.sh@10 -- # set +x 00:07:28.363 ************************************ 00:07:28.363 END TEST accel_comp 00:07:28.363 ************************************ 00:07:28.621 02:18:52 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:28.621 02:18:52 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:28.621 02:18:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.621 02:18:52 -- common/autotest_common.sh@10 -- # set +x 00:07:28.621 ************************************ 00:07:28.621 START TEST accel_decomp 00:07:28.621 ************************************ 00:07:28.621 02:18:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:28.621 02:18:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.621 02:18:52 -- accel/accel.sh@17 -- # local accel_module 00:07:28.621 02:18:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:28.621 02:18:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:28.621 02:18:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.621 02:18:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.621 02:18:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.621 02:18:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.621 02:18:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.621 02:18:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.621 02:18:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.621 02:18:53 -- accel/accel.sh@42 -- # jq -r . 00:07:28.621 [2024-11-27 02:18:53.018190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.621 [2024-11-27 02:18:53.018263] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1960931 ] 00:07:28.621 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.621 [2024-11-27 02:18:53.080057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.621 [2024-11-27 02:18:53.169919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.995 02:18:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:29.995 00:07:29.995 SPDK Configuration: 00:07:29.995 Core mask: 0x1 00:07:29.995 00:07:29.995 Accel Perf Configuration: 00:07:29.995 Workload Type: decompress 00:07:29.995 Transfer size: 4096 bytes 00:07:29.995 Vector count 1 00:07:29.995 Module: software 00:07:29.995 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.995 Queue depth: 32 00:07:29.995 Allocate depth: 32 00:07:29.995 # threads/core: 1 00:07:29.995 Run time: 1 seconds 00:07:29.995 Verify: Yes 00:07:29.995 00:07:29.995 Running for 1 seconds... 00:07:29.995 00:07:29.995 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:29.995 ------------------------------------------------------------------------------------ 00:07:29.995 0,0 55616/s 102 MiB/s 0 0 00:07:29.995 ==================================================================================== 00:07:29.995 Total 55616/s 217 MiB/s 0 0' 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.995 02:18:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.995 02:18:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.995 02:18:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.995 02:18:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.995 02:18:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.995 02:18:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.995 02:18:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.995 02:18:54 -- accel/accel.sh@42 -- # jq -r . 00:07:29.995 [2024-11-27 02:18:54.404056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:29.995 [2024-11-27 02:18:54.404137] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961082 ] 00:07:29.995 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.995 [2024-11-27 02:18:54.465941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.995 [2024-11-27 02:18:54.555917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=0x1 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=decompress 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=software 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=32 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=32 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=1 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.995 02:18:54 -- accel/accel.sh@21 -- # val=Yes 00:07:29.995 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.995 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.996 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.996 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.996 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.996 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:29.996 02:18:54 -- accel/accel.sh@21 -- # val= 00:07:29.996 02:18:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.996 02:18:54 -- accel/accel.sh@20 -- # IFS=: 00:07:29.996 02:18:54 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@21 -- # val= 00:07:31.370 02:18:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # IFS=: 00:07:31.370 02:18:55 -- accel/accel.sh@20 -- # read -r var val 00:07:31.370 02:18:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:31.370 02:18:55 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:31.370 02:18:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.370 00:07:31.370 real 0m2.799s 00:07:31.370 user 0m2.509s 00:07:31.370 sys 0m0.282s 00:07:31.370 02:18:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.370 02:18:55 -- common/autotest_common.sh@10 -- # set +x 00:07:31.370 ************************************ 00:07:31.370 END TEST accel_decomp 00:07:31.370 ************************************ 00:07:31.370 02:18:55 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:31.370 02:18:55 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:31.370 02:18:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.370 02:18:55 -- common/autotest_common.sh@10 -- # set +x 00:07:31.370 ************************************ 00:07:31.370 START TEST accel_decmop_full 00:07:31.370 ************************************ 00:07:31.370 02:18:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:31.370 02:18:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.370 02:18:55 -- accel/accel.sh@17 -- # local accel_module 00:07:31.370 02:18:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:31.370 02:18:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:31.370 02:18:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.370 02:18:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.370 02:18:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.370 02:18:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.370 02:18:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.370 02:18:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.370 02:18:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.370 02:18:55 -- accel/accel.sh@42 -- # jq -r . 00:07:31.370 [2024-11-27 02:18:55.840782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:31.370 [2024-11-27 02:18:55.840861] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961236 ] 00:07:31.370 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.370 [2024-11-27 02:18:55.901936] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.370 [2024-11-27 02:18:55.996468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.745 02:18:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:32.745 00:07:32.745 SPDK Configuration: 00:07:32.745 Core mask: 0x1 00:07:32.745 00:07:32.745 Accel Perf Configuration: 00:07:32.745 Workload Type: decompress 00:07:32.745 Transfer size: 111250 bytes 00:07:32.745 Vector count 1 00:07:32.745 Module: software 00:07:32.745 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:32.745 Queue depth: 32 00:07:32.745 Allocate depth: 32 00:07:32.745 # threads/core: 1 00:07:32.745 Run time: 1 seconds 00:07:32.745 Verify: Yes 00:07:32.745 00:07:32.745 Running for 1 seconds... 00:07:32.745 00:07:32.745 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:32.745 ------------------------------------------------------------------------------------ 00:07:32.745 0,0 3808/s 157 MiB/s 0 0 00:07:32.745 ==================================================================================== 00:07:32.745 Total 3808/s 404 MiB/s 0 0' 00:07:32.745 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:32.745 02:18:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.745 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:32.745 02:18:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.745 02:18:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.745 02:18:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.745 02:18:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.745 02:18:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.745 02:18:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.745 02:18:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.745 02:18:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.745 02:18:57 -- accel/accel.sh@42 -- # jq -r . 00:07:32.745 [2024-11-27 02:18:57.270006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:32.745 [2024-11-27 02:18:57.270088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961387 ] 00:07:32.745 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.745 [2024-11-27 02:18:57.332501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.004 [2024-11-27 02:18:57.426234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=0x1 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=decompress 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=software 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@23 -- # accel_module=software 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=32 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=32 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=1 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val=Yes 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:33.004 02:18:57 -- accel/accel.sh@21 -- # val= 00:07:33.004 02:18:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # IFS=: 00:07:33.004 02:18:57 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@21 -- # val= 00:07:34.379 02:18:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # IFS=: 00:07:34.379 02:18:58 -- accel/accel.sh@20 -- # read -r var val 00:07:34.379 02:18:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:34.379 02:18:58 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:34.379 02:18:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:34.379 00:07:34.379 real 0m2.855s 00:07:34.379 user 0m2.552s 00:07:34.379 sys 0m0.295s 00:07:34.379 02:18:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:34.379 02:18:58 -- common/autotest_common.sh@10 -- # set +x 00:07:34.379 ************************************ 00:07:34.379 END TEST accel_decmop_full 00:07:34.379 ************************************ 00:07:34.379 02:18:58 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:34.379 02:18:58 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:34.379 02:18:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.379 02:18:58 -- common/autotest_common.sh@10 -- # set +x 00:07:34.379 ************************************ 00:07:34.379 START TEST accel_decomp_mcore 00:07:34.379 ************************************ 00:07:34.379 02:18:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:34.379 02:18:58 -- accel/accel.sh@16 -- # local accel_opc 00:07:34.379 02:18:58 -- accel/accel.sh@17 -- # local accel_module 00:07:34.379 02:18:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:34.379 02:18:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:34.379 02:18:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.379 02:18:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.379 02:18:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.379 02:18:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.379 02:18:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.379 02:18:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.379 02:18:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.379 02:18:58 -- accel/accel.sh@42 -- # jq -r . 00:07:34.379 [2024-11-27 02:18:58.718547] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:34.379 [2024-11-27 02:18:58.718627] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961658 ] 00:07:34.379 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.379 [2024-11-27 02:18:58.785392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:34.379 [2024-11-27 02:18:58.881477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:34.379 [2024-11-27 02:18:58.881546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:34.379 [2024-11-27 02:18:58.881581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:34.379 [2024-11-27 02:18:58.881584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.755 02:19:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:35.756 00:07:35.756 SPDK Configuration: 00:07:35.756 Core mask: 0xf 00:07:35.756 00:07:35.756 Accel Perf Configuration: 00:07:35.756 Workload Type: decompress 00:07:35.756 Transfer size: 4096 bytes 00:07:35.756 Vector count 1 00:07:35.756 Module: software 00:07:35.756 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.756 Queue depth: 32 00:07:35.756 Allocate depth: 32 00:07:35.756 # threads/core: 1 00:07:35.756 Run time: 1 seconds 00:07:35.756 Verify: Yes 00:07:35.756 00:07:35.756 Running for 1 seconds... 00:07:35.756 00:07:35.756 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:35.756 ------------------------------------------------------------------------------------ 00:07:35.756 0,0 50240/s 92 MiB/s 0 0 00:07:35.756 3,0 50688/s 93 MiB/s 0 0 00:07:35.756 2,0 50624/s 93 MiB/s 0 0 00:07:35.756 1,0 50496/s 93 MiB/s 0 0 00:07:35.756 ==================================================================================== 00:07:35.756 Total 202048/s 789 MiB/s 0 0' 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.756 02:19:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.756 02:19:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.756 02:19:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.756 02:19:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.756 02:19:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.756 02:19:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.756 02:19:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.756 02:19:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.756 02:19:00 -- accel/accel.sh@42 -- # jq -r . 00:07:35.756 [2024-11-27 02:19:00.132544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:35.756 [2024-11-27 02:19:00.132645] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961807 ] 00:07:35.756 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.756 [2024-11-27 02:19:00.197161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:35.756 [2024-11-27 02:19:00.292719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:35.756 [2024-11-27 02:19:00.292772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:35.756 [2024-11-27 02:19:00.292835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:35.756 [2024-11-27 02:19:00.292838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=0xf 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=decompress 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=software 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@23 -- # accel_module=software 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=32 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=32 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=1 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val=Yes 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:35.756 02:19:00 -- accel/accel.sh@21 -- # val= 00:07:35.756 02:19:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # IFS=: 00:07:35.756 02:19:00 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@21 -- # val= 00:07:37.130 02:19:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # IFS=: 00:07:37.130 02:19:01 -- accel/accel.sh@20 -- # read -r var val 00:07:37.130 02:19:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:37.130 02:19:01 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:37.130 02:19:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:37.130 00:07:37.130 real 0m2.843s 00:07:37.130 user 0m9.431s 00:07:37.130 sys 0m0.314s 00:07:37.130 02:19:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.130 02:19:01 -- common/autotest_common.sh@10 -- # set +x 00:07:37.130 ************************************ 00:07:37.130 END TEST accel_decomp_mcore 00:07:37.130 ************************************ 00:07:37.131 02:19:01 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:37.131 02:19:01 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:37.131 02:19:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.131 02:19:01 -- common/autotest_common.sh@10 -- # set +x 00:07:37.131 ************************************ 00:07:37.131 START TEST accel_decomp_full_mcore 00:07:37.131 ************************************ 00:07:37.131 02:19:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:37.131 02:19:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:37.131 02:19:01 -- accel/accel.sh@17 -- # local accel_module 00:07:37.131 02:19:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:37.131 02:19:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:37.131 02:19:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.131 02:19:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.131 02:19:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.131 02:19:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.131 02:19:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.131 02:19:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.131 02:19:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.131 02:19:01 -- accel/accel.sh@42 -- # jq -r . 00:07:37.131 [2024-11-27 02:19:01.593445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:37.131 [2024-11-27 02:19:01.593550] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1961969 ] 00:07:37.131 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.131 [2024-11-27 02:19:01.657893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:37.131 [2024-11-27 02:19:01.753084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.131 [2024-11-27 02:19:01.753139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:37.131 [2024-11-27 02:19:01.753193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:37.131 [2024-11-27 02:19:01.753196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.506 02:19:03 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:38.506 00:07:38.506 SPDK Configuration: 00:07:38.506 Core mask: 0xf 00:07:38.506 00:07:38.506 Accel Perf Configuration: 00:07:38.506 Workload Type: decompress 00:07:38.506 Transfer size: 111250 bytes 00:07:38.506 Vector count 1 00:07:38.506 Module: software 00:07:38.506 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:38.506 Queue depth: 32 00:07:38.506 Allocate depth: 32 00:07:38.506 # threads/core: 1 00:07:38.506 Run time: 1 seconds 00:07:38.506 Verify: Yes 00:07:38.506 00:07:38.506 Running for 1 seconds... 00:07:38.506 00:07:38.506 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:38.506 ------------------------------------------------------------------------------------ 00:07:38.506 0,0 3776/s 155 MiB/s 0 0 00:07:38.506 3,0 3776/s 155 MiB/s 0 0 00:07:38.506 2,0 3776/s 155 MiB/s 0 0 00:07:38.506 1,0 3776/s 155 MiB/s 0 0 00:07:38.506 ==================================================================================== 00:07:38.506 Total 15104/s 1602 MiB/s 0 0' 00:07:38.506 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.506 02:19:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.506 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.506 02:19:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.506 02:19:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.506 02:19:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.506 02:19:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.506 02:19:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.506 02:19:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.506 02:19:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.506 02:19:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.506 02:19:03 -- accel/accel.sh@42 -- # jq -r . 00:07:38.506 [2024-11-27 02:19:03.025955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:38.506 [2024-11-27 02:19:03.026038] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1962170 ] 00:07:38.506 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.506 [2024-11-27 02:19:03.088814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.765 [2024-11-27 02:19:03.187297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.765 [2024-11-27 02:19:03.187353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.765 [2024-11-27 02:19:03.187406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.765 [2024-11-27 02:19:03.187409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=0xf 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=decompress 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=software 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=32 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=32 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=1 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val=Yes 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:38.765 02:19:03 -- accel/accel.sh@21 -- # val= 00:07:38.765 02:19:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # IFS=: 00:07:38.765 02:19:03 -- accel/accel.sh@20 -- # read -r var val 00:07:40.139 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.139 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.139 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.139 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.139 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.139 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.139 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.139 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.139 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.140 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.140 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.140 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.140 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@21 -- # val= 00:07:40.140 02:19:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # IFS=: 00:07:40.140 02:19:04 -- accel/accel.sh@20 -- # read -r var val 00:07:40.140 02:19:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:40.140 02:19:04 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:40.140 02:19:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:40.140 00:07:40.140 real 0m2.869s 00:07:40.140 user 0m9.551s 00:07:40.140 sys 0m0.309s 00:07:40.140 02:19:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:40.140 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:40.140 ************************************ 00:07:40.140 END TEST accel_decomp_full_mcore 00:07:40.140 ************************************ 00:07:40.140 02:19:04 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:40.140 02:19:04 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:40.140 02:19:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.140 02:19:04 -- common/autotest_common.sh@10 -- # set +x 00:07:40.140 ************************************ 00:07:40.140 START TEST accel_decomp_mthread 00:07:40.140 ************************************ 00:07:40.140 02:19:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:40.140 02:19:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:40.140 02:19:04 -- accel/accel.sh@17 -- # local accel_module 00:07:40.140 02:19:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:40.140 02:19:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:40.140 02:19:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.140 02:19:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.140 02:19:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.140 02:19:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.140 02:19:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.140 02:19:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.140 02:19:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.140 02:19:04 -- accel/accel.sh@42 -- # jq -r . 00:07:40.140 [2024-11-27 02:19:04.489233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:40.140 [2024-11-27 02:19:04.489312] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1962397 ] 00:07:40.140 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.140 [2024-11-27 02:19:04.555010] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.140 [2024-11-27 02:19:04.646174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.515 02:19:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:41.515 00:07:41.515 SPDK Configuration: 00:07:41.515 Core mask: 0x1 00:07:41.515 00:07:41.515 Accel Perf Configuration: 00:07:41.515 Workload Type: decompress 00:07:41.515 Transfer size: 4096 bytes 00:07:41.515 Vector count 1 00:07:41.515 Module: software 00:07:41.515 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:41.515 Queue depth: 32 00:07:41.515 Allocate depth: 32 00:07:41.515 # threads/core: 2 00:07:41.515 Run time: 1 seconds 00:07:41.515 Verify: Yes 00:07:41.515 00:07:41.515 Running for 1 seconds... 00:07:41.515 00:07:41.515 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:41.515 ------------------------------------------------------------------------------------ 00:07:41.515 0,1 28032/s 51 MiB/s 0 0 00:07:41.515 0,0 27936/s 51 MiB/s 0 0 00:07:41.515 ==================================================================================== 00:07:41.515 Total 55968/s 218 MiB/s 0 0' 00:07:41.515 02:19:05 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.515 02:19:05 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.515 02:19:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.515 02:19:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.515 02:19:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.515 02:19:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.515 02:19:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.515 02:19:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.515 02:19:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.515 02:19:05 -- accel/accel.sh@42 -- # jq -r . 00:07:41.515 [2024-11-27 02:19:05.891815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:41.515 [2024-11-27 02:19:05.891906] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1962543 ] 00:07:41.515 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.515 [2024-11-27 02:19:05.953764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.515 [2024-11-27 02:19:06.048099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=0x1 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=decompress 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=software 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=32 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=32 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=2 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val=Yes 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.515 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.515 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.515 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.516 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:41.516 02:19:06 -- accel/accel.sh@21 -- # val= 00:07:41.516 02:19:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.516 02:19:06 -- accel/accel.sh@20 -- # IFS=: 00:07:41.516 02:19:06 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@21 -- # val= 00:07:42.893 02:19:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # IFS=: 00:07:42.893 02:19:07 -- accel/accel.sh@20 -- # read -r var val 00:07:42.893 02:19:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:42.893 02:19:07 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:42.893 02:19:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:42.893 00:07:42.893 real 0m2.827s 00:07:42.893 user 0m2.529s 00:07:42.893 sys 0m0.291s 00:07:42.893 02:19:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.893 02:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.893 ************************************ 00:07:42.893 END TEST accel_decomp_mthread 00:07:42.893 ************************************ 00:07:42.893 02:19:07 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:42.893 02:19:07 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:42.893 02:19:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.893 02:19:07 -- common/autotest_common.sh@10 -- # set +x 00:07:42.893 ************************************ 00:07:42.893 START TEST accel_deomp_full_mthread 00:07:42.893 ************************************ 00:07:42.893 02:19:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:42.893 02:19:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:42.893 02:19:07 -- accel/accel.sh@17 -- # local accel_module 00:07:42.893 02:19:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:42.893 02:19:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:42.893 02:19:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.893 02:19:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.893 02:19:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.893 02:19:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.893 02:19:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.893 02:19:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.893 02:19:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.893 02:19:07 -- accel/accel.sh@42 -- # jq -r . 00:07:42.893 [2024-11-27 02:19:07.342358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:42.893 [2024-11-27 02:19:07.342438] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1962696 ] 00:07:42.893 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.893 [2024-11-27 02:19:07.408235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.894 [2024-11-27 02:19:07.504198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.267 02:19:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:44.267 00:07:44.267 SPDK Configuration: 00:07:44.267 Core mask: 0x1 00:07:44.267 00:07:44.267 Accel Perf Configuration: 00:07:44.268 Workload Type: decompress 00:07:44.268 Transfer size: 111250 bytes 00:07:44.268 Vector count 1 00:07:44.268 Module: software 00:07:44.268 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.268 Queue depth: 32 00:07:44.268 Allocate depth: 32 00:07:44.268 # threads/core: 2 00:07:44.268 Run time: 1 seconds 00:07:44.268 Verify: Yes 00:07:44.268 00:07:44.268 Running for 1 seconds... 00:07:44.268 00:07:44.268 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:44.268 ------------------------------------------------------------------------------------ 00:07:44.268 0,1 1952/s 80 MiB/s 0 0 00:07:44.268 0,0 1920/s 79 MiB/s 0 0 00:07:44.268 ==================================================================================== 00:07:44.268 Total 3872/s 410 MiB/s 0 0' 00:07:44.268 02:19:08 -- accel/accel.sh@20 -- # IFS=: 00:07:44.268 02:19:08 -- accel/accel.sh@20 -- # read -r var val 00:07:44.268 02:19:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.268 02:19:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.268 02:19:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.268 02:19:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.268 02:19:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.268 02:19:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.268 02:19:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.268 02:19:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.268 02:19:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.268 02:19:08 -- accel/accel.sh@42 -- # jq -r . 00:07:44.268 [2024-11-27 02:19:08.785882] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:44.268 [2024-11-27 02:19:08.785967] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1962960 ] 00:07:44.268 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.268 [2024-11-27 02:19:08.847933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.526 [2024-11-27 02:19:08.942142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=0x1 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=decompress 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=software 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=32 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=32 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val=2 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.526 02:19:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:44.526 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.526 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.527 02:19:09 -- accel/accel.sh@21 -- # val=Yes 00:07:44.527 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.527 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.527 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:44.527 02:19:09 -- accel/accel.sh@21 -- # val= 00:07:44.527 02:19:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # IFS=: 00:07:44.527 02:19:09 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@21 -- # val= 00:07:46.032 02:19:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # IFS=: 00:07:46.032 02:19:10 -- accel/accel.sh@20 -- # read -r var val 00:07:46.032 02:19:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:46.032 02:19:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:46.032 02:19:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.032 00:07:46.032 real 0m2.894s 00:07:46.032 user 0m2.580s 00:07:46.032 sys 0m0.307s 00:07:46.032 02:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.032 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.032 ************************************ 00:07:46.032 END TEST accel_deomp_full_mthread 00:07:46.032 ************************************ 00:07:46.033 02:19:10 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:46.033 02:19:10 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:46.033 02:19:10 -- accel/accel.sh@129 -- # build_accel_config 00:07:46.033 02:19:10 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:46.033 02:19:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.033 02:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.033 02:19:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.033 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.033 02:19:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.033 02:19:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.033 02:19:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.033 02:19:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.033 02:19:10 -- accel/accel.sh@42 -- # jq -r . 00:07:46.033 ************************************ 00:07:46.033 START TEST accel_dif_functional_tests 00:07:46.033 ************************************ 00:07:46.033 02:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:46.033 [2024-11-27 02:19:10.285783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:46.033 [2024-11-27 02:19:10.285875] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1963120 ] 00:07:46.033 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.033 [2024-11-27 02:19:10.349055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:46.033 [2024-11-27 02:19:10.444198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.033 [2024-11-27 02:19:10.444251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.033 [2024-11-27 02:19:10.444254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.033 00:07:46.033 00:07:46.033 CUnit - A unit testing framework for C - Version 2.1-3 00:07:46.033 http://cunit.sourceforge.net/ 00:07:46.033 00:07:46.033 00:07:46.033 Suite: accel_dif 00:07:46.033 Test: verify: DIF generated, GUARD check ...passed 00:07:46.033 Test: verify: DIF generated, APPTAG check ...passed 00:07:46.033 Test: verify: DIF generated, REFTAG check ...passed 00:07:46.033 Test: verify: DIF not generated, GUARD check ...[2024-11-27 02:19:10.539709] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:46.033 [2024-11-27 02:19:10.539781] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:46.033 passed 00:07:46.033 Test: verify: DIF not generated, APPTAG check ...[2024-11-27 02:19:10.539824] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:46.033 [2024-11-27 02:19:10.539856] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:46.033 passed 00:07:46.033 Test: verify: DIF not generated, REFTAG check ...[2024-11-27 02:19:10.539891] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:46.033 [2024-11-27 02:19:10.539920] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:46.033 passed 00:07:46.033 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:46.033 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-27 02:19:10.539992] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:46.033 passed 00:07:46.033 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:46.033 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:46.033 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:46.033 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-27 02:19:10.540151] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:46.033 passed 00:07:46.033 Test: generate copy: DIF generated, GUARD check ...passed 00:07:46.033 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:46.033 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:46.033 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:46.033 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:46.033 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:46.033 Test: generate copy: iovecs-len validate ...[2024-11-27 02:19:10.540408] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:46.033 passed 00:07:46.033 Test: generate copy: buffer alignment validate ...passed 00:07:46.033 00:07:46.033 Run Summary: Type Total Ran Passed Failed Inactive 00:07:46.033 suites 1 1 n/a 0 0 00:07:46.033 tests 20 20 20 0 0 00:07:46.033 asserts 204 204 204 0 n/a 00:07:46.033 00:07:46.033 Elapsed time = 0.003 seconds 00:07:46.292 00:07:46.292 real 0m0.517s 00:07:46.292 user 0m0.818s 00:07:46.292 sys 0m0.180s 00:07:46.292 02:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.292 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.292 ************************************ 00:07:46.292 END TEST accel_dif_functional_tests 00:07:46.292 ************************************ 00:07:46.292 00:07:46.292 real 0m59.961s 00:07:46.292 user 1m7.770s 00:07:46.292 sys 0m7.290s 00:07:46.292 02:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.292 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.292 ************************************ 00:07:46.292 END TEST accel 00:07:46.292 ************************************ 00:07:46.292 02:19:10 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:46.292 02:19:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:46.292 02:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.292 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.292 ************************************ 00:07:46.292 START TEST accel_rpc 00:07:46.292 ************************************ 00:07:46.292 02:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:46.292 * Looking for test storage... 00:07:46.292 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:46.292 02:19:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:46.292 02:19:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:46.292 02:19:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:46.553 02:19:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:46.553 02:19:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:46.553 02:19:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:46.553 02:19:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:46.553 02:19:10 -- scripts/common.sh@335 -- # IFS=.-: 00:07:46.553 02:19:10 -- scripts/common.sh@335 -- # read -ra ver1 00:07:46.553 02:19:10 -- scripts/common.sh@336 -- # IFS=.-: 00:07:46.553 02:19:10 -- scripts/common.sh@336 -- # read -ra ver2 00:07:46.553 02:19:10 -- scripts/common.sh@337 -- # local 'op=<' 00:07:46.553 02:19:10 -- scripts/common.sh@339 -- # ver1_l=2 00:07:46.553 02:19:10 -- scripts/common.sh@340 -- # ver2_l=1 00:07:46.553 02:19:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:46.553 02:19:10 -- scripts/common.sh@343 -- # case "$op" in 00:07:46.553 02:19:10 -- scripts/common.sh@344 -- # : 1 00:07:46.553 02:19:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:46.553 02:19:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:46.553 02:19:10 -- scripts/common.sh@364 -- # decimal 1 00:07:46.553 02:19:10 -- scripts/common.sh@352 -- # local d=1 00:07:46.553 02:19:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:46.553 02:19:10 -- scripts/common.sh@354 -- # echo 1 00:07:46.553 02:19:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:46.553 02:19:10 -- scripts/common.sh@365 -- # decimal 2 00:07:46.553 02:19:10 -- scripts/common.sh@352 -- # local d=2 00:07:46.553 02:19:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:46.553 02:19:10 -- scripts/common.sh@354 -- # echo 2 00:07:46.553 02:19:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:46.553 02:19:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:46.553 02:19:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:46.553 02:19:10 -- scripts/common.sh@367 -- # return 0 00:07:46.553 02:19:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:46.553 02:19:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:46.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.553 --rc genhtml_branch_coverage=1 00:07:46.553 --rc genhtml_function_coverage=1 00:07:46.553 --rc genhtml_legend=1 00:07:46.553 --rc geninfo_all_blocks=1 00:07:46.553 --rc geninfo_unexecuted_blocks=1 00:07:46.553 00:07:46.553 ' 00:07:46.553 02:19:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:46.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.553 --rc genhtml_branch_coverage=1 00:07:46.553 --rc genhtml_function_coverage=1 00:07:46.553 --rc genhtml_legend=1 00:07:46.553 --rc geninfo_all_blocks=1 00:07:46.553 --rc geninfo_unexecuted_blocks=1 00:07:46.553 00:07:46.553 ' 00:07:46.553 02:19:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:46.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.553 --rc genhtml_branch_coverage=1 00:07:46.553 --rc genhtml_function_coverage=1 00:07:46.553 --rc genhtml_legend=1 00:07:46.553 --rc geninfo_all_blocks=1 00:07:46.553 --rc geninfo_unexecuted_blocks=1 00:07:46.553 00:07:46.553 ' 00:07:46.553 02:19:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:46.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.553 --rc genhtml_branch_coverage=1 00:07:46.553 --rc genhtml_function_coverage=1 00:07:46.553 --rc genhtml_legend=1 00:07:46.553 --rc geninfo_all_blocks=1 00:07:46.553 --rc geninfo_unexecuted_blocks=1 00:07:46.553 00:07:46.553 ' 00:07:46.553 02:19:10 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:46.553 02:19:10 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1963245 00:07:46.553 02:19:10 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:46.553 02:19:10 -- accel/accel_rpc.sh@15 -- # waitforlisten 1963245 00:07:46.553 02:19:10 -- common/autotest_common.sh@829 -- # '[' -z 1963245 ']' 00:07:46.553 02:19:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:46.553 02:19:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:46.553 02:19:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:46.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:46.553 02:19:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:46.553 02:19:10 -- common/autotest_common.sh@10 -- # set +x 00:07:46.553 [2024-11-27 02:19:11.015406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:46.553 [2024-11-27 02:19:11.015498] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1963245 ] 00:07:46.553 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.553 [2024-11-27 02:19:11.078749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.553 [2024-11-27 02:19:11.175096] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:46.553 [2024-11-27 02:19:11.175287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.813 02:19:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:46.813 02:19:11 -- common/autotest_common.sh@862 -- # return 0 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:46.813 02:19:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:46.813 02:19:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.813 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:46.813 ************************************ 00:07:46.813 START TEST accel_assign_opcode 00:07:46.813 ************************************ 00:07:46.813 02:19:11 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:46.813 02:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.813 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:46.813 [2024-11-27 02:19:11.267968] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:46.813 02:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:46.813 02:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.813 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:46.813 [2024-11-27 02:19:11.275982] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:46.813 02:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.813 02:19:11 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:46.813 02:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.813 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:47.074 02:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.074 02:19:11 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:47.074 02:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:47.074 02:19:11 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:47.074 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:47.074 02:19:11 -- accel/accel_rpc.sh@42 -- # grep software 00:07:47.074 02:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:47.074 software 00:07:47.074 00:07:47.074 real 0m0.289s 00:07:47.074 user 0m0.038s 00:07:47.074 sys 0m0.006s 00:07:47.074 02:19:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.074 02:19:11 -- common/autotest_common.sh@10 -- # set +x 00:07:47.074 ************************************ 00:07:47.074 END TEST accel_assign_opcode 00:07:47.074 ************************************ 00:07:47.074 02:19:11 -- accel/accel_rpc.sh@55 -- # killprocess 1963245 00:07:47.074 02:19:11 -- common/autotest_common.sh@936 -- # '[' -z 1963245 ']' 00:07:47.074 02:19:11 -- common/autotest_common.sh@940 -- # kill -0 1963245 00:07:47.074 02:19:11 -- common/autotest_common.sh@941 -- # uname 00:07:47.074 02:19:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:47.074 02:19:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1963245 00:07:47.074 02:19:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:47.074 02:19:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:47.074 02:19:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1963245' 00:07:47.074 killing process with pid 1963245 00:07:47.074 02:19:11 -- common/autotest_common.sh@955 -- # kill 1963245 00:07:47.074 02:19:11 -- common/autotest_common.sh@960 -- # wait 1963245 00:07:47.643 00:07:47.643 real 0m1.213s 00:07:47.643 user 0m1.159s 00:07:47.643 sys 0m0.445s 00:07:47.643 02:19:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.643 02:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.643 ************************************ 00:07:47.643 END TEST accel_rpc 00:07:47.643 ************************************ 00:07:47.643 02:19:12 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:47.643 02:19:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:47.643 02:19:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.643 02:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.643 ************************************ 00:07:47.643 START TEST app_cmdline 00:07:47.643 ************************************ 00:07:47.643 02:19:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:47.643 * Looking for test storage... 00:07:47.643 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:47.643 02:19:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.643 02:19:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.643 02:19:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.643 02:19:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.643 02:19:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.643 02:19:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.643 02:19:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.644 02:19:12 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.644 02:19:12 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.644 02:19:12 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.644 02:19:12 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.644 02:19:12 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.644 02:19:12 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.644 02:19:12 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.644 02:19:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.644 02:19:12 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.644 02:19:12 -- scripts/common.sh@344 -- # : 1 00:07:47.644 02:19:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.644 02:19:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.644 02:19:12 -- scripts/common.sh@364 -- # decimal 1 00:07:47.644 02:19:12 -- scripts/common.sh@352 -- # local d=1 00:07:47.644 02:19:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.644 02:19:12 -- scripts/common.sh@354 -- # echo 1 00:07:47.644 02:19:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.644 02:19:12 -- scripts/common.sh@365 -- # decimal 2 00:07:47.644 02:19:12 -- scripts/common.sh@352 -- # local d=2 00:07:47.644 02:19:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.644 02:19:12 -- scripts/common.sh@354 -- # echo 2 00:07:47.644 02:19:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.644 02:19:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.644 02:19:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.644 02:19:12 -- scripts/common.sh@367 -- # return 0 00:07:47.644 02:19:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.644 02:19:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.644 --rc genhtml_branch_coverage=1 00:07:47.644 --rc genhtml_function_coverage=1 00:07:47.644 --rc genhtml_legend=1 00:07:47.644 --rc geninfo_all_blocks=1 00:07:47.644 --rc geninfo_unexecuted_blocks=1 00:07:47.644 00:07:47.644 ' 00:07:47.644 02:19:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.644 --rc genhtml_branch_coverage=1 00:07:47.644 --rc genhtml_function_coverage=1 00:07:47.644 --rc genhtml_legend=1 00:07:47.644 --rc geninfo_all_blocks=1 00:07:47.644 --rc geninfo_unexecuted_blocks=1 00:07:47.644 00:07:47.644 ' 00:07:47.644 02:19:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.644 --rc genhtml_branch_coverage=1 00:07:47.644 --rc genhtml_function_coverage=1 00:07:47.644 --rc genhtml_legend=1 00:07:47.644 --rc geninfo_all_blocks=1 00:07:47.644 --rc geninfo_unexecuted_blocks=1 00:07:47.644 00:07:47.644 ' 00:07:47.644 02:19:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.644 --rc genhtml_branch_coverage=1 00:07:47.644 --rc genhtml_function_coverage=1 00:07:47.644 --rc genhtml_legend=1 00:07:47.644 --rc geninfo_all_blocks=1 00:07:47.644 --rc geninfo_unexecuted_blocks=1 00:07:47.644 00:07:47.644 ' 00:07:47.644 02:19:12 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:47.644 02:19:12 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1963532 00:07:47.644 02:19:12 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:47.644 02:19:12 -- app/cmdline.sh@18 -- # waitforlisten 1963532 00:07:47.644 02:19:12 -- common/autotest_common.sh@829 -- # '[' -z 1963532 ']' 00:07:47.644 02:19:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.644 02:19:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:47.644 02:19:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.644 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.644 02:19:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:47.644 02:19:12 -- common/autotest_common.sh@10 -- # set +x 00:07:47.644 [2024-11-27 02:19:12.245346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:47.644 [2024-11-27 02:19:12.245439] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1963532 ] 00:07:47.644 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.904 [2024-11-27 02:19:12.307604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.904 [2024-11-27 02:19:12.396719] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.904 [2024-11-27 02:19:12.396900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.839 02:19:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.839 02:19:13 -- common/autotest_common.sh@862 -- # return 0 00:07:48.839 02:19:13 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:48.839 { 00:07:48.839 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:48.839 "fields": { 00:07:48.839 "major": 24, 00:07:48.839 "minor": 1, 00:07:48.839 "patch": 1, 00:07:48.839 "suffix": "-pre", 00:07:48.839 "commit": "c13c99a5e" 00:07:48.839 } 00:07:48.839 } 00:07:48.839 02:19:13 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:48.839 02:19:13 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:48.839 02:19:13 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:48.839 02:19:13 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:48.839 02:19:13 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:48.839 02:19:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.839 02:19:13 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:48.839 02:19:13 -- common/autotest_common.sh@10 -- # set +x 00:07:48.839 02:19:13 -- app/cmdline.sh@26 -- # sort 00:07:48.839 02:19:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.839 02:19:13 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:48.839 02:19:13 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:48.839 02:19:13 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:48.839 02:19:13 -- common/autotest_common.sh@650 -- # local es=0 00:07:48.839 02:19:13 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:48.839 02:19:13 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:48.839 02:19:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:48.839 02:19:13 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:48.839 02:19:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:48.839 02:19:13 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:48.839 02:19:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:48.839 02:19:13 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:48.839 02:19:13 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:48.839 02:19:13 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:49.407 request: 00:07:49.407 { 00:07:49.407 "method": "env_dpdk_get_mem_stats", 00:07:49.407 "req_id": 1 00:07:49.407 } 00:07:49.407 Got JSON-RPC error response 00:07:49.407 response: 00:07:49.407 { 00:07:49.407 "code": -32601, 00:07:49.407 "message": "Method not found" 00:07:49.407 } 00:07:49.407 02:19:13 -- common/autotest_common.sh@653 -- # es=1 00:07:49.407 02:19:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:49.407 02:19:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:49.407 02:19:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:49.407 02:19:13 -- app/cmdline.sh@1 -- # killprocess 1963532 00:07:49.407 02:19:13 -- common/autotest_common.sh@936 -- # '[' -z 1963532 ']' 00:07:49.407 02:19:13 -- common/autotest_common.sh@940 -- # kill -0 1963532 00:07:49.407 02:19:13 -- common/autotest_common.sh@941 -- # uname 00:07:49.407 02:19:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:49.407 02:19:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1963532 00:07:49.407 02:19:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:49.407 02:19:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:49.407 02:19:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1963532' 00:07:49.407 killing process with pid 1963532 00:07:49.407 02:19:13 -- common/autotest_common.sh@955 -- # kill 1963532 00:07:49.407 02:19:13 -- common/autotest_common.sh@960 -- # wait 1963532 00:07:49.666 00:07:49.666 real 0m2.161s 00:07:49.666 user 0m2.709s 00:07:49.666 sys 0m0.527s 00:07:49.666 02:19:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.666 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:49.666 ************************************ 00:07:49.666 END TEST app_cmdline 00:07:49.666 ************************************ 00:07:49.666 02:19:14 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:49.666 02:19:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:49.666 02:19:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.666 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:49.666 ************************************ 00:07:49.666 START TEST version 00:07:49.666 ************************************ 00:07:49.666 02:19:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:49.666 * Looking for test storage... 00:07:49.666 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:49.666 02:19:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.666 02:19:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.666 02:19:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.925 02:19:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.925 02:19:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.925 02:19:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.925 02:19:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.925 02:19:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.925 02:19:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.925 02:19:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.925 02:19:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.925 02:19:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.925 02:19:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.925 02:19:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.925 02:19:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.925 02:19:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.925 02:19:14 -- scripts/common.sh@344 -- # : 1 00:07:49.925 02:19:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.925 02:19:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.925 02:19:14 -- scripts/common.sh@364 -- # decimal 1 00:07:49.925 02:19:14 -- scripts/common.sh@352 -- # local d=1 00:07:49.925 02:19:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.926 02:19:14 -- scripts/common.sh@354 -- # echo 1 00:07:49.926 02:19:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.926 02:19:14 -- scripts/common.sh@365 -- # decimal 2 00:07:49.926 02:19:14 -- scripts/common.sh@352 -- # local d=2 00:07:49.926 02:19:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.926 02:19:14 -- scripts/common.sh@354 -- # echo 2 00:07:49.926 02:19:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.926 02:19:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.926 02:19:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.926 02:19:14 -- scripts/common.sh@367 -- # return 0 00:07:49.926 02:19:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.926 02:19:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.926 --rc genhtml_branch_coverage=1 00:07:49.926 --rc genhtml_function_coverage=1 00:07:49.926 --rc genhtml_legend=1 00:07:49.926 --rc geninfo_all_blocks=1 00:07:49.926 --rc geninfo_unexecuted_blocks=1 00:07:49.926 00:07:49.926 ' 00:07:49.926 02:19:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.926 --rc genhtml_branch_coverage=1 00:07:49.926 --rc genhtml_function_coverage=1 00:07:49.926 --rc genhtml_legend=1 00:07:49.926 --rc geninfo_all_blocks=1 00:07:49.926 --rc geninfo_unexecuted_blocks=1 00:07:49.926 00:07:49.926 ' 00:07:49.926 02:19:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.926 --rc genhtml_branch_coverage=1 00:07:49.926 --rc genhtml_function_coverage=1 00:07:49.926 --rc genhtml_legend=1 00:07:49.926 --rc geninfo_all_blocks=1 00:07:49.926 --rc geninfo_unexecuted_blocks=1 00:07:49.926 00:07:49.926 ' 00:07:49.926 02:19:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.926 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.926 --rc genhtml_branch_coverage=1 00:07:49.926 --rc genhtml_function_coverage=1 00:07:49.926 --rc genhtml_legend=1 00:07:49.926 --rc geninfo_all_blocks=1 00:07:49.926 --rc geninfo_unexecuted_blocks=1 00:07:49.926 00:07:49.926 ' 00:07:49.926 02:19:14 -- app/version.sh@17 -- # get_header_version major 00:07:49.926 02:19:14 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:49.926 02:19:14 -- app/version.sh@14 -- # cut -f2 00:07:49.926 02:19:14 -- app/version.sh@14 -- # tr -d '"' 00:07:49.926 02:19:14 -- app/version.sh@17 -- # major=24 00:07:49.926 02:19:14 -- app/version.sh@18 -- # get_header_version minor 00:07:49.926 02:19:14 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:49.926 02:19:14 -- app/version.sh@14 -- # cut -f2 00:07:49.926 02:19:14 -- app/version.sh@14 -- # tr -d '"' 00:07:49.926 02:19:14 -- app/version.sh@18 -- # minor=1 00:07:49.926 02:19:14 -- app/version.sh@19 -- # get_header_version patch 00:07:49.926 02:19:14 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:49.926 02:19:14 -- app/version.sh@14 -- # cut -f2 00:07:49.926 02:19:14 -- app/version.sh@14 -- # tr -d '"' 00:07:49.926 02:19:14 -- app/version.sh@19 -- # patch=1 00:07:49.926 02:19:14 -- app/version.sh@20 -- # get_header_version suffix 00:07:49.926 02:19:14 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:49.926 02:19:14 -- app/version.sh@14 -- # cut -f2 00:07:49.926 02:19:14 -- app/version.sh@14 -- # tr -d '"' 00:07:49.926 02:19:14 -- app/version.sh@20 -- # suffix=-pre 00:07:49.926 02:19:14 -- app/version.sh@22 -- # version=24.1 00:07:49.926 02:19:14 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:49.926 02:19:14 -- app/version.sh@25 -- # version=24.1.1 00:07:49.926 02:19:14 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:49.926 02:19:14 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:49.926 02:19:14 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:49.926 02:19:14 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:49.926 02:19:14 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:49.926 00:07:49.926 real 0m0.190s 00:07:49.926 user 0m0.117s 00:07:49.926 sys 0m0.097s 00:07:49.926 02:19:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.926 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:49.926 ************************************ 00:07:49.926 END TEST version 00:07:49.926 ************************************ 00:07:49.926 02:19:14 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@191 -- # uname -s 00:07:49.926 02:19:14 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:49.926 02:19:14 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:49.926 02:19:14 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:49.926 02:19:14 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:49.926 02:19:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.926 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:49.926 02:19:14 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:49.926 02:19:14 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:49.926 02:19:14 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:49.926 02:19:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:49.926 02:19:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.926 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:49.926 ************************************ 00:07:49.926 START TEST nvmf_tcp 00:07:49.926 ************************************ 00:07:49.926 02:19:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:49.926 * Looking for test storage... 00:07:49.926 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:49.926 02:19:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.926 02:19:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.926 02:19:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:50.186 02:19:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:50.186 02:19:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:50.186 02:19:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:50.186 02:19:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:50.186 02:19:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:50.186 02:19:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:50.186 02:19:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:50.186 02:19:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:50.186 02:19:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:50.186 02:19:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:50.186 02:19:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:50.186 02:19:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:50.186 02:19:14 -- scripts/common.sh@344 -- # : 1 00:07:50.186 02:19:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:50.186 02:19:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:50.186 02:19:14 -- scripts/common.sh@364 -- # decimal 1 00:07:50.186 02:19:14 -- scripts/common.sh@352 -- # local d=1 00:07:50.186 02:19:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:50.186 02:19:14 -- scripts/common.sh@354 -- # echo 1 00:07:50.186 02:19:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:50.186 02:19:14 -- scripts/common.sh@365 -- # decimal 2 00:07:50.186 02:19:14 -- scripts/common.sh@352 -- # local d=2 00:07:50.186 02:19:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:50.186 02:19:14 -- scripts/common.sh@354 -- # echo 2 00:07:50.186 02:19:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:50.186 02:19:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:50.186 02:19:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:50.186 02:19:14 -- scripts/common.sh@367 -- # return 0 00:07:50.186 02:19:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:50.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.186 --rc genhtml_branch_coverage=1 00:07:50.186 --rc genhtml_function_coverage=1 00:07:50.186 --rc genhtml_legend=1 00:07:50.186 --rc geninfo_all_blocks=1 00:07:50.186 --rc geninfo_unexecuted_blocks=1 00:07:50.186 00:07:50.186 ' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:50.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.186 --rc genhtml_branch_coverage=1 00:07:50.186 --rc genhtml_function_coverage=1 00:07:50.186 --rc genhtml_legend=1 00:07:50.186 --rc geninfo_all_blocks=1 00:07:50.186 --rc geninfo_unexecuted_blocks=1 00:07:50.186 00:07:50.186 ' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:50.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.186 --rc genhtml_branch_coverage=1 00:07:50.186 --rc genhtml_function_coverage=1 00:07:50.186 --rc genhtml_legend=1 00:07:50.186 --rc geninfo_all_blocks=1 00:07:50.186 --rc geninfo_unexecuted_blocks=1 00:07:50.186 00:07:50.186 ' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:50.186 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.186 --rc genhtml_branch_coverage=1 00:07:50.186 --rc genhtml_function_coverage=1 00:07:50.186 --rc genhtml_legend=1 00:07:50.186 --rc geninfo_all_blocks=1 00:07:50.186 --rc geninfo_unexecuted_blocks=1 00:07:50.186 00:07:50.186 ' 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.186 02:19:14 -- nvmf/common.sh@7 -- # uname -s 00:07:50.186 02:19:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.186 02:19:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.186 02:19:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.186 02:19:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.186 02:19:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.186 02:19:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.186 02:19:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.186 02:19:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.186 02:19:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.186 02:19:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.186 02:19:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.186 02:19:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.186 02:19:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.186 02:19:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.186 02:19:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.186 02:19:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:50.186 02:19:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.186 02:19:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.186 02:19:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.186 02:19:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.186 02:19:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.186 02:19:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.186 02:19:14 -- paths/export.sh@5 -- # export PATH 00:07:50.186 02:19:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.186 02:19:14 -- nvmf/common.sh@46 -- # : 0 00:07:50.186 02:19:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:50.186 02:19:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:50.186 02:19:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:50.186 02:19:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.186 02:19:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.186 02:19:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:50.186 02:19:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:50.186 02:19:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:50.186 02:19:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:50.186 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:50.186 02:19:14 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:50.186 02:19:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.186 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:50.186 ************************************ 00:07:50.186 START TEST nvmf_example 00:07:50.186 ************************************ 00:07:50.186 02:19:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:50.186 * Looking for test storage... 00:07:50.186 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:50.186 02:19:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:50.186 02:19:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:50.186 02:19:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:50.186 02:19:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:50.186 02:19:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:50.186 02:19:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:50.186 02:19:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:50.186 02:19:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:50.186 02:19:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:50.186 02:19:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:50.186 02:19:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:50.186 02:19:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:50.186 02:19:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:50.186 02:19:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:50.186 02:19:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:50.186 02:19:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:50.186 02:19:14 -- scripts/common.sh@344 -- # : 1 00:07:50.186 02:19:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:50.186 02:19:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:50.186 02:19:14 -- scripts/common.sh@364 -- # decimal 1 00:07:50.186 02:19:14 -- scripts/common.sh@352 -- # local d=1 00:07:50.186 02:19:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:50.186 02:19:14 -- scripts/common.sh@354 -- # echo 1 00:07:50.186 02:19:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:50.186 02:19:14 -- scripts/common.sh@365 -- # decimal 2 00:07:50.187 02:19:14 -- scripts/common.sh@352 -- # local d=2 00:07:50.187 02:19:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:50.187 02:19:14 -- scripts/common.sh@354 -- # echo 2 00:07:50.187 02:19:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:50.187 02:19:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:50.187 02:19:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:50.187 02:19:14 -- scripts/common.sh@367 -- # return 0 00:07:50.187 02:19:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:50.187 02:19:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:50.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.187 --rc genhtml_branch_coverage=1 00:07:50.187 --rc genhtml_function_coverage=1 00:07:50.187 --rc genhtml_legend=1 00:07:50.187 --rc geninfo_all_blocks=1 00:07:50.187 --rc geninfo_unexecuted_blocks=1 00:07:50.187 00:07:50.187 ' 00:07:50.187 02:19:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:50.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.187 --rc genhtml_branch_coverage=1 00:07:50.187 --rc genhtml_function_coverage=1 00:07:50.187 --rc genhtml_legend=1 00:07:50.187 --rc geninfo_all_blocks=1 00:07:50.187 --rc geninfo_unexecuted_blocks=1 00:07:50.187 00:07:50.187 ' 00:07:50.187 02:19:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:50.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.187 --rc genhtml_branch_coverage=1 00:07:50.187 --rc genhtml_function_coverage=1 00:07:50.187 --rc genhtml_legend=1 00:07:50.187 --rc geninfo_all_blocks=1 00:07:50.187 --rc geninfo_unexecuted_blocks=1 00:07:50.187 00:07:50.187 ' 00:07:50.187 02:19:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:50.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:50.187 --rc genhtml_branch_coverage=1 00:07:50.187 --rc genhtml_function_coverage=1 00:07:50.187 --rc genhtml_legend=1 00:07:50.187 --rc geninfo_all_blocks=1 00:07:50.187 --rc geninfo_unexecuted_blocks=1 00:07:50.187 00:07:50.187 ' 00:07:50.187 02:19:14 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.187 02:19:14 -- nvmf/common.sh@7 -- # uname -s 00:07:50.187 02:19:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.187 02:19:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.187 02:19:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.187 02:19:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.187 02:19:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.187 02:19:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.187 02:19:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.187 02:19:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.187 02:19:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.187 02:19:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.187 02:19:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.187 02:19:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.187 02:19:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.187 02:19:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.187 02:19:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.187 02:19:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:50.187 02:19:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.187 02:19:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.187 02:19:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.187 02:19:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.187 02:19:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.187 02:19:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.187 02:19:14 -- paths/export.sh@5 -- # export PATH 00:07:50.187 02:19:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.187 02:19:14 -- nvmf/common.sh@46 -- # : 0 00:07:50.187 02:19:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:50.187 02:19:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:50.187 02:19:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:50.187 02:19:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.187 02:19:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.187 02:19:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:50.187 02:19:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:50.187 02:19:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:50.187 02:19:14 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:50.187 02:19:14 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:50.187 02:19:14 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:50.187 02:19:14 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:50.187 02:19:14 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:50.187 02:19:14 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:50.187 02:19:14 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:50.187 02:19:14 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:50.187 02:19:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:50.187 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:50.187 02:19:14 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:50.187 02:19:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:50.187 02:19:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:50.187 02:19:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:50.187 02:19:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:50.187 02:19:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:50.187 02:19:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:50.187 02:19:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:50.187 02:19:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:50.187 02:19:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:50.187 02:19:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:50.187 02:19:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:50.187 02:19:14 -- common/autotest_common.sh@10 -- # set +x 00:07:52.721 02:19:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:52.721 02:19:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:52.721 02:19:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:52.721 02:19:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:52.721 02:19:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:52.721 02:19:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:52.721 02:19:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:52.721 02:19:16 -- nvmf/common.sh@294 -- # net_devs=() 00:07:52.721 02:19:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:52.721 02:19:16 -- nvmf/common.sh@295 -- # e810=() 00:07:52.721 02:19:16 -- nvmf/common.sh@295 -- # local -ga e810 00:07:52.721 02:19:16 -- nvmf/common.sh@296 -- # x722=() 00:07:52.721 02:19:16 -- nvmf/common.sh@296 -- # local -ga x722 00:07:52.721 02:19:16 -- nvmf/common.sh@297 -- # mlx=() 00:07:52.721 02:19:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:52.721 02:19:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:52.721 02:19:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:52.721 02:19:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:52.721 02:19:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:52.721 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.721 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:52.721 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:52.721 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.721 02:19:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:52.721 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:52.721 02:19:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:52.721 02:19:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.721 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.721 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.721 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.721 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:52.721 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:52.721 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.721 02:19:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.721 02:19:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.721 02:19:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.721 02:19:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.721 02:19:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:52.721 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:52.721 02:19:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.721 02:19:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:52.721 02:19:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:52.721 02:19:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:52.721 02:19:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:52.721 02:19:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:52.721 02:19:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:52.722 02:19:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:52.722 02:19:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:52.722 02:19:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:52.722 02:19:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:52.722 02:19:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:52.722 02:19:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:52.722 02:19:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:52.722 02:19:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:52.722 02:19:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:52.722 02:19:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:52.722 02:19:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:52.722 02:19:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:52.722 02:19:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:52.722 02:19:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:52.722 02:19:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:52.722 02:19:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:52.722 02:19:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:52.722 02:19:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:52.722 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:52.722 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.297 ms 00:07:52.722 00:07:52.722 --- 10.0.0.2 ping statistics --- 00:07:52.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.722 rtt min/avg/max/mdev = 0.297/0.297/0.297/0.000 ms 00:07:52.722 02:19:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:52.722 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:52.722 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:07:52.722 00:07:52.722 --- 10.0.0.1 ping statistics --- 00:07:52.722 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.722 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:07:52.722 02:19:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:52.722 02:19:16 -- nvmf/common.sh@410 -- # return 0 00:07:52.722 02:19:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:52.722 02:19:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:52.722 02:19:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:52.722 02:19:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:52.722 02:19:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:52.722 02:19:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:52.722 02:19:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:52.722 02:19:17 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:52.722 02:19:17 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:52.722 02:19:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:52.722 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.722 02:19:17 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:52.722 02:19:17 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:52.722 02:19:17 -- target/nvmf_example.sh@34 -- # nvmfpid=1965595 00:07:52.722 02:19:17 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:52.722 02:19:17 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:52.722 02:19:17 -- target/nvmf_example.sh@36 -- # waitforlisten 1965595 00:07:52.722 02:19:17 -- common/autotest_common.sh@829 -- # '[' -z 1965595 ']' 00:07:52.722 02:19:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:52.722 02:19:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:52.722 02:19:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:52.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:52.722 02:19:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:52.722 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.722 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.722 02:19:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:52.722 02:19:17 -- common/autotest_common.sh@862 -- # return 0 00:07:52.722 02:19:17 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:52.722 02:19:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:52.722 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.722 02:19:17 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:52.722 02:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.722 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.722 02:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.722 02:19:17 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:52.722 02:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.722 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.980 02:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.980 02:19:17 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:52.980 02:19:17 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:52.980 02:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.980 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.980 02:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.980 02:19:17 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:52.980 02:19:17 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:52.980 02:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.980 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.980 02:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.980 02:19:17 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:52.980 02:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:52.980 02:19:17 -- common/autotest_common.sh@10 -- # set +x 00:07:52.980 02:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:52.980 02:19:17 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:52.980 02:19:17 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:52.980 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.171 Initializing NVMe Controllers 00:08:05.171 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:05.171 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:05.171 Initialization complete. Launching workers. 00:08:05.171 ======================================================== 00:08:05.171 Latency(us) 00:08:05.171 Device Information : IOPS MiB/s Average min max 00:08:05.171 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15735.27 61.47 4066.90 876.68 15344.09 00:08:05.171 ======================================================== 00:08:05.171 Total : 15735.27 61.47 4066.90 876.68 15344.09 00:08:05.171 00:08:05.171 02:19:27 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:05.171 02:19:27 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:05.171 02:19:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:05.171 02:19:27 -- nvmf/common.sh@116 -- # sync 00:08:05.171 02:19:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:05.171 02:19:27 -- nvmf/common.sh@119 -- # set +e 00:08:05.171 02:19:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:05.171 02:19:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:05.171 rmmod nvme_tcp 00:08:05.171 rmmod nvme_fabrics 00:08:05.171 rmmod nvme_keyring 00:08:05.171 02:19:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:05.171 02:19:27 -- nvmf/common.sh@123 -- # set -e 00:08:05.171 02:19:27 -- nvmf/common.sh@124 -- # return 0 00:08:05.171 02:19:27 -- nvmf/common.sh@477 -- # '[' -n 1965595 ']' 00:08:05.171 02:19:27 -- nvmf/common.sh@478 -- # killprocess 1965595 00:08:05.171 02:19:27 -- common/autotest_common.sh@936 -- # '[' -z 1965595 ']' 00:08:05.171 02:19:27 -- common/autotest_common.sh@940 -- # kill -0 1965595 00:08:05.171 02:19:27 -- common/autotest_common.sh@941 -- # uname 00:08:05.171 02:19:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:05.171 02:19:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1965595 00:08:05.171 02:19:27 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:05.171 02:19:27 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:05.171 02:19:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1965595' 00:08:05.171 killing process with pid 1965595 00:08:05.171 02:19:27 -- common/autotest_common.sh@955 -- # kill 1965595 00:08:05.171 02:19:27 -- common/autotest_common.sh@960 -- # wait 1965595 00:08:05.171 nvmf threads initialize successfully 00:08:05.171 bdev subsystem init successfully 00:08:05.171 created a nvmf target service 00:08:05.171 create targets's poll groups done 00:08:05.171 all subsystems of target started 00:08:05.171 nvmf target is running 00:08:05.171 all subsystems of target stopped 00:08:05.171 destroy targets's poll groups done 00:08:05.171 destroyed the nvmf target service 00:08:05.171 bdev subsystem finish successfully 00:08:05.171 nvmf threads destroy successfully 00:08:05.171 02:19:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:05.171 02:19:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:05.171 02:19:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:05.171 02:19:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:05.171 02:19:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:05.171 02:19:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:05.171 02:19:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:05.171 02:19:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:05.429 02:19:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:05.429 02:19:29 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:05.429 02:19:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:05.429 02:19:29 -- common/autotest_common.sh@10 -- # set +x 00:08:05.429 00:08:05.429 real 0m15.377s 00:08:05.429 user 0m42.387s 00:08:05.429 sys 0m3.269s 00:08:05.429 02:19:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:05.429 02:19:30 -- common/autotest_common.sh@10 -- # set +x 00:08:05.429 ************************************ 00:08:05.429 END TEST nvmf_example 00:08:05.429 ************************************ 00:08:05.429 02:19:30 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:05.430 02:19:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:05.430 02:19:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:05.430 02:19:30 -- common/autotest_common.sh@10 -- # set +x 00:08:05.430 ************************************ 00:08:05.430 START TEST nvmf_filesystem 00:08:05.430 ************************************ 00:08:05.430 02:19:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:05.690 * Looking for test storage... 00:08:05.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.690 02:19:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:05.690 02:19:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:05.690 02:19:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:05.690 02:19:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:05.690 02:19:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:05.690 02:19:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:05.690 02:19:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:05.690 02:19:30 -- scripts/common.sh@335 -- # IFS=.-: 00:08:05.690 02:19:30 -- scripts/common.sh@335 -- # read -ra ver1 00:08:05.690 02:19:30 -- scripts/common.sh@336 -- # IFS=.-: 00:08:05.690 02:19:30 -- scripts/common.sh@336 -- # read -ra ver2 00:08:05.690 02:19:30 -- scripts/common.sh@337 -- # local 'op=<' 00:08:05.690 02:19:30 -- scripts/common.sh@339 -- # ver1_l=2 00:08:05.690 02:19:30 -- scripts/common.sh@340 -- # ver2_l=1 00:08:05.690 02:19:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:05.690 02:19:30 -- scripts/common.sh@343 -- # case "$op" in 00:08:05.690 02:19:30 -- scripts/common.sh@344 -- # : 1 00:08:05.690 02:19:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:05.690 02:19:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:05.690 02:19:30 -- scripts/common.sh@364 -- # decimal 1 00:08:05.690 02:19:30 -- scripts/common.sh@352 -- # local d=1 00:08:05.690 02:19:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:05.690 02:19:30 -- scripts/common.sh@354 -- # echo 1 00:08:05.690 02:19:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:05.690 02:19:30 -- scripts/common.sh@365 -- # decimal 2 00:08:05.690 02:19:30 -- scripts/common.sh@352 -- # local d=2 00:08:05.690 02:19:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:05.690 02:19:30 -- scripts/common.sh@354 -- # echo 2 00:08:05.690 02:19:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:05.690 02:19:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:05.690 02:19:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:05.690 02:19:30 -- scripts/common.sh@367 -- # return 0 00:08:05.690 02:19:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:05.690 02:19:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:05.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.690 --rc genhtml_branch_coverage=1 00:08:05.690 --rc genhtml_function_coverage=1 00:08:05.690 --rc genhtml_legend=1 00:08:05.690 --rc geninfo_all_blocks=1 00:08:05.690 --rc geninfo_unexecuted_blocks=1 00:08:05.690 00:08:05.690 ' 00:08:05.690 02:19:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:05.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.690 --rc genhtml_branch_coverage=1 00:08:05.690 --rc genhtml_function_coverage=1 00:08:05.690 --rc genhtml_legend=1 00:08:05.690 --rc geninfo_all_blocks=1 00:08:05.690 --rc geninfo_unexecuted_blocks=1 00:08:05.690 00:08:05.690 ' 00:08:05.690 02:19:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:05.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.690 --rc genhtml_branch_coverage=1 00:08:05.690 --rc genhtml_function_coverage=1 00:08:05.690 --rc genhtml_legend=1 00:08:05.690 --rc geninfo_all_blocks=1 00:08:05.690 --rc geninfo_unexecuted_blocks=1 00:08:05.690 00:08:05.690 ' 00:08:05.690 02:19:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:05.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.690 --rc genhtml_branch_coverage=1 00:08:05.690 --rc genhtml_function_coverage=1 00:08:05.690 --rc genhtml_legend=1 00:08:05.690 --rc geninfo_all_blocks=1 00:08:05.690 --rc geninfo_unexecuted_blocks=1 00:08:05.690 00:08:05.690 ' 00:08:05.690 02:19:30 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:05.690 02:19:30 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:05.690 02:19:30 -- common/autotest_common.sh@34 -- # set -e 00:08:05.690 02:19:30 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:05.690 02:19:30 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:05.690 02:19:30 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:05.690 02:19:30 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:05.690 02:19:30 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:05.690 02:19:30 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:05.690 02:19:30 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:05.690 02:19:30 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:05.690 02:19:30 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:05.690 02:19:30 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:05.690 02:19:30 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:05.690 02:19:30 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:05.690 02:19:30 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:05.690 02:19:30 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:05.690 02:19:30 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:05.690 02:19:30 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:05.690 02:19:30 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:05.690 02:19:30 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:05.690 02:19:30 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:05.690 02:19:30 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:05.690 02:19:30 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:05.690 02:19:30 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:05.690 02:19:30 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:05.690 02:19:30 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:05.690 02:19:30 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:05.690 02:19:30 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:05.690 02:19:30 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:05.690 02:19:30 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:05.690 02:19:30 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:05.690 02:19:30 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:05.690 02:19:30 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:05.690 02:19:30 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:05.690 02:19:30 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:05.690 02:19:30 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:05.690 02:19:30 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:05.690 02:19:30 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:05.690 02:19:30 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:05.690 02:19:30 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:05.690 02:19:30 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:05.690 02:19:30 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:05.690 02:19:30 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:05.690 02:19:30 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:05.690 02:19:30 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:05.690 02:19:30 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:05.690 02:19:30 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:05.690 02:19:30 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:05.690 02:19:30 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:05.690 02:19:30 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:05.690 02:19:30 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:05.690 02:19:30 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:05.690 02:19:30 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:05.690 02:19:30 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:05.690 02:19:30 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:05.690 02:19:30 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:05.690 02:19:30 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:05.690 02:19:30 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:05.690 02:19:30 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:05.690 02:19:30 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:05.690 02:19:30 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:05.690 02:19:30 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:05.690 02:19:30 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:05.690 02:19:30 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:05.690 02:19:30 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:05.690 02:19:30 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:05.690 02:19:30 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:05.690 02:19:30 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:05.690 02:19:30 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:05.690 02:19:30 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:05.690 02:19:30 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:05.690 02:19:30 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:05.690 02:19:30 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:05.690 02:19:30 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:05.690 02:19:30 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:05.690 02:19:30 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:05.690 02:19:30 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:05.690 02:19:30 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:05.690 02:19:30 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:05.690 02:19:30 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:05.690 02:19:30 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:05.690 02:19:30 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:05.690 02:19:30 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:05.690 02:19:30 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:05.691 02:19:30 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:05.691 02:19:30 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:05.691 02:19:30 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:05.691 02:19:30 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:05.691 02:19:30 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:05.691 02:19:30 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:05.691 02:19:30 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:05.691 02:19:30 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:05.691 02:19:30 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:05.691 02:19:30 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:05.691 02:19:30 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:05.691 02:19:30 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:05.691 02:19:30 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:05.691 02:19:30 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:05.691 02:19:30 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:05.691 02:19:30 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:05.691 02:19:30 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:05.691 #define SPDK_CONFIG_H 00:08:05.691 #define SPDK_CONFIG_APPS 1 00:08:05.691 #define SPDK_CONFIG_ARCH native 00:08:05.691 #undef SPDK_CONFIG_ASAN 00:08:05.691 #undef SPDK_CONFIG_AVAHI 00:08:05.691 #undef SPDK_CONFIG_CET 00:08:05.691 #define SPDK_CONFIG_COVERAGE 1 00:08:05.691 #define SPDK_CONFIG_CROSS_PREFIX 00:08:05.691 #undef SPDK_CONFIG_CRYPTO 00:08:05.691 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:05.691 #undef SPDK_CONFIG_CUSTOMOCF 00:08:05.691 #undef SPDK_CONFIG_DAOS 00:08:05.691 #define SPDK_CONFIG_DAOS_DIR 00:08:05.691 #define SPDK_CONFIG_DEBUG 1 00:08:05.691 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:05.691 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:05.691 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:05.691 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:05.691 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:05.691 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:05.691 #define SPDK_CONFIG_EXAMPLES 1 00:08:05.691 #undef SPDK_CONFIG_FC 00:08:05.691 #define SPDK_CONFIG_FC_PATH 00:08:05.691 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:05.691 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:05.691 #undef SPDK_CONFIG_FUSE 00:08:05.691 #undef SPDK_CONFIG_FUZZER 00:08:05.691 #define SPDK_CONFIG_FUZZER_LIB 00:08:05.691 #undef SPDK_CONFIG_GOLANG 00:08:05.691 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:05.691 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:05.691 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:05.691 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:05.691 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:05.691 #define SPDK_CONFIG_IDXD 1 00:08:05.691 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:05.691 #undef SPDK_CONFIG_IPSEC_MB 00:08:05.691 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:05.691 #define SPDK_CONFIG_ISAL 1 00:08:05.691 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:05.691 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:05.691 #define SPDK_CONFIG_LIBDIR 00:08:05.691 #undef SPDK_CONFIG_LTO 00:08:05.691 #define SPDK_CONFIG_MAX_LCORES 00:08:05.691 #define SPDK_CONFIG_NVME_CUSE 1 00:08:05.691 #undef SPDK_CONFIG_OCF 00:08:05.691 #define SPDK_CONFIG_OCF_PATH 00:08:05.691 #define SPDK_CONFIG_OPENSSL_PATH 00:08:05.691 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:05.691 #undef SPDK_CONFIG_PGO_USE 00:08:05.691 #define SPDK_CONFIG_PREFIX /usr/local 00:08:05.691 #undef SPDK_CONFIG_RAID5F 00:08:05.691 #undef SPDK_CONFIG_RBD 00:08:05.691 #define SPDK_CONFIG_RDMA 1 00:08:05.691 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:05.691 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:05.691 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:05.691 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:05.691 #define SPDK_CONFIG_SHARED 1 00:08:05.691 #undef SPDK_CONFIG_SMA 00:08:05.691 #define SPDK_CONFIG_TESTS 1 00:08:05.691 #undef SPDK_CONFIG_TSAN 00:08:05.691 #define SPDK_CONFIG_UBLK 1 00:08:05.691 #define SPDK_CONFIG_UBSAN 1 00:08:05.691 #undef SPDK_CONFIG_UNIT_TESTS 00:08:05.691 #undef SPDK_CONFIG_URING 00:08:05.691 #define SPDK_CONFIG_URING_PATH 00:08:05.691 #undef SPDK_CONFIG_URING_ZNS 00:08:05.691 #undef SPDK_CONFIG_USDT 00:08:05.691 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:05.691 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:05.691 #define SPDK_CONFIG_VFIO_USER 1 00:08:05.691 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:05.691 #define SPDK_CONFIG_VHOST 1 00:08:05.691 #define SPDK_CONFIG_VIRTIO 1 00:08:05.691 #undef SPDK_CONFIG_VTUNE 00:08:05.691 #define SPDK_CONFIG_VTUNE_DIR 00:08:05.691 #define SPDK_CONFIG_WERROR 1 00:08:05.691 #define SPDK_CONFIG_WPDK_DIR 00:08:05.691 #undef SPDK_CONFIG_XNVME 00:08:05.691 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:05.691 02:19:30 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:05.691 02:19:30 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:05.691 02:19:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:05.691 02:19:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:05.691 02:19:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:05.691 02:19:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.691 02:19:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.691 02:19:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.691 02:19:30 -- paths/export.sh@5 -- # export PATH 00:08:05.691 02:19:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.691 02:19:30 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:05.691 02:19:30 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:05.691 02:19:30 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:05.691 02:19:30 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:05.691 02:19:30 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:05.691 02:19:30 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:05.691 02:19:30 -- pm/common@16 -- # TEST_TAG=N/A 00:08:05.691 02:19:30 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:05.691 02:19:30 -- common/autotest_common.sh@52 -- # : 1 00:08:05.691 02:19:30 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:05.691 02:19:30 -- common/autotest_common.sh@56 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:05.691 02:19:30 -- common/autotest_common.sh@58 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:05.691 02:19:30 -- common/autotest_common.sh@60 -- # : 1 00:08:05.691 02:19:30 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:05.691 02:19:30 -- common/autotest_common.sh@62 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:05.691 02:19:30 -- common/autotest_common.sh@64 -- # : 00:08:05.691 02:19:30 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:05.691 02:19:30 -- common/autotest_common.sh@66 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:05.691 02:19:30 -- common/autotest_common.sh@68 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:05.691 02:19:30 -- common/autotest_common.sh@70 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:05.691 02:19:30 -- common/autotest_common.sh@72 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:05.691 02:19:30 -- common/autotest_common.sh@74 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:05.691 02:19:30 -- common/autotest_common.sh@76 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:05.691 02:19:30 -- common/autotest_common.sh@78 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:05.691 02:19:30 -- common/autotest_common.sh@80 -- # : 1 00:08:05.691 02:19:30 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:05.691 02:19:30 -- common/autotest_common.sh@82 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:05.691 02:19:30 -- common/autotest_common.sh@84 -- # : 0 00:08:05.691 02:19:30 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:05.691 02:19:30 -- common/autotest_common.sh@86 -- # : 1 00:08:05.691 02:19:30 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:05.692 02:19:30 -- common/autotest_common.sh@88 -- # : 1 00:08:05.692 02:19:30 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:05.692 02:19:30 -- common/autotest_common.sh@90 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:05.692 02:19:30 -- common/autotest_common.sh@92 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:05.692 02:19:30 -- common/autotest_common.sh@94 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:05.692 02:19:30 -- common/autotest_common.sh@96 -- # : tcp 00:08:05.692 02:19:30 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:05.692 02:19:30 -- common/autotest_common.sh@98 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:05.692 02:19:30 -- common/autotest_common.sh@100 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:05.692 02:19:30 -- common/autotest_common.sh@102 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:05.692 02:19:30 -- common/autotest_common.sh@104 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:05.692 02:19:30 -- common/autotest_common.sh@106 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:05.692 02:19:30 -- common/autotest_common.sh@108 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:05.692 02:19:30 -- common/autotest_common.sh@110 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:05.692 02:19:30 -- common/autotest_common.sh@112 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:05.692 02:19:30 -- common/autotest_common.sh@114 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:05.692 02:19:30 -- common/autotest_common.sh@116 -- # : 1 00:08:05.692 02:19:30 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:05.692 02:19:30 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:05.692 02:19:30 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:05.692 02:19:30 -- common/autotest_common.sh@120 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:05.692 02:19:30 -- common/autotest_common.sh@122 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:05.692 02:19:30 -- common/autotest_common.sh@124 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:05.692 02:19:30 -- common/autotest_common.sh@126 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:05.692 02:19:30 -- common/autotest_common.sh@128 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:05.692 02:19:30 -- common/autotest_common.sh@130 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:05.692 02:19:30 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:05.692 02:19:30 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:05.692 02:19:30 -- common/autotest_common.sh@134 -- # : true 00:08:05.692 02:19:30 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:05.692 02:19:30 -- common/autotest_common.sh@136 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:05.692 02:19:30 -- common/autotest_common.sh@138 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:05.692 02:19:30 -- common/autotest_common.sh@140 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:05.692 02:19:30 -- common/autotest_common.sh@142 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:05.692 02:19:30 -- common/autotest_common.sh@144 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:05.692 02:19:30 -- common/autotest_common.sh@146 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:05.692 02:19:30 -- common/autotest_common.sh@148 -- # : e810 00:08:05.692 02:19:30 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:05.692 02:19:30 -- common/autotest_common.sh@150 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:05.692 02:19:30 -- common/autotest_common.sh@152 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:05.692 02:19:30 -- common/autotest_common.sh@154 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:05.692 02:19:30 -- common/autotest_common.sh@156 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:05.692 02:19:30 -- common/autotest_common.sh@158 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:05.692 02:19:30 -- common/autotest_common.sh@160 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:05.692 02:19:30 -- common/autotest_common.sh@163 -- # : 00:08:05.692 02:19:30 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:05.692 02:19:30 -- common/autotest_common.sh@165 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:05.692 02:19:30 -- common/autotest_common.sh@167 -- # : 0 00:08:05.692 02:19:30 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:05.692 02:19:30 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:05.692 02:19:30 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:05.692 02:19:30 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:05.692 02:19:30 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:05.692 02:19:30 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:05.692 02:19:30 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:05.692 02:19:30 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:05.692 02:19:30 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:05.692 02:19:30 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:05.692 02:19:30 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:05.692 02:19:30 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:05.692 02:19:30 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:05.692 02:19:30 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:05.692 02:19:30 -- common/autotest_common.sh@196 -- # cat 00:08:05.692 02:19:30 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:05.692 02:19:30 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:05.692 02:19:30 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:05.692 02:19:30 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:05.692 02:19:30 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:05.692 02:19:30 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:05.692 02:19:30 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:05.692 02:19:30 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:05.692 02:19:30 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:05.692 02:19:30 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:05.692 02:19:30 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:05.693 02:19:30 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:05.693 02:19:30 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:05.693 02:19:30 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:05.693 02:19:30 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:05.693 02:19:30 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:05.693 02:19:30 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:05.693 02:19:30 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:05.693 02:19:30 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:05.693 02:19:30 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:05.693 02:19:30 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:05.693 02:19:30 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:05.693 02:19:30 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:05.693 02:19:30 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:05.693 02:19:30 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:05.693 02:19:30 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:05.693 02:19:30 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:05.693 02:19:30 -- common/autotest_common.sh@259 -- # valgrind= 00:08:05.693 02:19:30 -- common/autotest_common.sh@265 -- # uname -s 00:08:05.693 02:19:30 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:05.693 02:19:30 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:05.693 02:19:30 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:05.693 02:19:30 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:05.693 02:19:30 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:05.693 02:19:30 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:05.693 02:19:30 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:05.693 02:19:30 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:05.693 02:19:30 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:05.693 02:19:30 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:05.693 02:19:30 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:05.693 02:19:30 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:05.693 02:19:30 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:05.693 02:19:30 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:05.693 02:19:30 -- common/autotest_common.sh@319 -- # [[ -z 1967218 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@319 -- # kill -0 1967218 00:08:05.693 02:19:30 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:05.693 02:19:30 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:05.693 02:19:30 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:05.693 02:19:30 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:05.693 02:19:30 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:05.693 02:19:30 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:05.693 02:19:30 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:05.693 02:19:30 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.yiL5sw 00:08:05.693 02:19:30 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:05.693 02:19:30 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.yiL5sw/tests/target /tmp/spdk.yiL5sw 00:08:05.693 02:19:30 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@328 -- # df -T 00:08:05.693 02:19:30 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=53708443648 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=8280059904 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=30992994304 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993747968 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=503808 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:05.693 02:19:30 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:05.693 02:19:30 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:05.693 02:19:30 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:05.693 02:19:30 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:05.693 * Looking for test storage... 00:08:05.693 02:19:30 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:05.693 02:19:30 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:05.693 02:19:30 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.693 02:19:30 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:05.693 02:19:30 -- common/autotest_common.sh@373 -- # mount=/ 00:08:05.693 02:19:30 -- common/autotest_common.sh@375 -- # target_space=53708443648 00:08:05.693 02:19:30 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:05.693 02:19:30 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:05.693 02:19:30 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@382 -- # new_size=10494652416 00:08:05.693 02:19:30 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:05.693 02:19:30 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.693 02:19:30 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.693 02:19:30 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.693 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:05.693 02:19:30 -- common/autotest_common.sh@390 -- # return 0 00:08:05.693 02:19:30 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:05.693 02:19:30 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:05.693 02:19:30 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:05.693 02:19:30 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:05.693 02:19:30 -- common/autotest_common.sh@1682 -- # true 00:08:05.693 02:19:30 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:05.693 02:19:30 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@27 -- # exec 00:08:05.693 02:19:30 -- common/autotest_common.sh@29 -- # exec 00:08:05.693 02:19:30 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:05.693 02:19:30 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:05.693 02:19:30 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:05.693 02:19:30 -- common/autotest_common.sh@18 -- # set -x 00:08:05.693 02:19:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:05.693 02:19:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:05.693 02:19:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:05.953 02:19:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:05.953 02:19:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:05.953 02:19:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:05.953 02:19:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:05.953 02:19:30 -- scripts/common.sh@335 -- # IFS=.-: 00:08:05.953 02:19:30 -- scripts/common.sh@335 -- # read -ra ver1 00:08:05.953 02:19:30 -- scripts/common.sh@336 -- # IFS=.-: 00:08:05.953 02:19:30 -- scripts/common.sh@336 -- # read -ra ver2 00:08:05.953 02:19:30 -- scripts/common.sh@337 -- # local 'op=<' 00:08:05.953 02:19:30 -- scripts/common.sh@339 -- # ver1_l=2 00:08:05.953 02:19:30 -- scripts/common.sh@340 -- # ver2_l=1 00:08:05.953 02:19:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:05.953 02:19:30 -- scripts/common.sh@343 -- # case "$op" in 00:08:05.953 02:19:30 -- scripts/common.sh@344 -- # : 1 00:08:05.953 02:19:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:05.953 02:19:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:05.953 02:19:30 -- scripts/common.sh@364 -- # decimal 1 00:08:05.953 02:19:30 -- scripts/common.sh@352 -- # local d=1 00:08:05.953 02:19:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:05.953 02:19:30 -- scripts/common.sh@354 -- # echo 1 00:08:05.953 02:19:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:05.953 02:19:30 -- scripts/common.sh@365 -- # decimal 2 00:08:05.953 02:19:30 -- scripts/common.sh@352 -- # local d=2 00:08:05.953 02:19:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:05.953 02:19:30 -- scripts/common.sh@354 -- # echo 2 00:08:05.953 02:19:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:05.953 02:19:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:05.953 02:19:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:05.953 02:19:30 -- scripts/common.sh@367 -- # return 0 00:08:05.953 02:19:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:05.953 02:19:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.953 --rc genhtml_branch_coverage=1 00:08:05.953 --rc genhtml_function_coverage=1 00:08:05.953 --rc genhtml_legend=1 00:08:05.953 --rc geninfo_all_blocks=1 00:08:05.953 --rc geninfo_unexecuted_blocks=1 00:08:05.953 00:08:05.953 ' 00:08:05.953 02:19:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.953 --rc genhtml_branch_coverage=1 00:08:05.953 --rc genhtml_function_coverage=1 00:08:05.953 --rc genhtml_legend=1 00:08:05.953 --rc geninfo_all_blocks=1 00:08:05.953 --rc geninfo_unexecuted_blocks=1 00:08:05.953 00:08:05.953 ' 00:08:05.953 02:19:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.953 --rc genhtml_branch_coverage=1 00:08:05.953 --rc genhtml_function_coverage=1 00:08:05.953 --rc genhtml_legend=1 00:08:05.953 --rc geninfo_all_blocks=1 00:08:05.953 --rc geninfo_unexecuted_blocks=1 00:08:05.953 00:08:05.953 ' 00:08:05.953 02:19:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:05.953 --rc genhtml_branch_coverage=1 00:08:05.953 --rc genhtml_function_coverage=1 00:08:05.953 --rc genhtml_legend=1 00:08:05.953 --rc geninfo_all_blocks=1 00:08:05.953 --rc geninfo_unexecuted_blocks=1 00:08:05.953 00:08:05.953 ' 00:08:05.953 02:19:30 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:05.953 02:19:30 -- nvmf/common.sh@7 -- # uname -s 00:08:05.953 02:19:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:05.953 02:19:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:05.953 02:19:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:05.953 02:19:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:05.953 02:19:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:05.953 02:19:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:05.953 02:19:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:05.953 02:19:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:05.953 02:19:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:05.953 02:19:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:05.953 02:19:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:05.953 02:19:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:05.953 02:19:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:05.953 02:19:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:05.953 02:19:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:05.953 02:19:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:05.953 02:19:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:05.953 02:19:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:05.953 02:19:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:05.953 02:19:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.953 02:19:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.953 02:19:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.953 02:19:30 -- paths/export.sh@5 -- # export PATH 00:08:05.953 02:19:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:05.953 02:19:30 -- nvmf/common.sh@46 -- # : 0 00:08:05.953 02:19:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:05.953 02:19:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:05.953 02:19:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:05.953 02:19:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:05.953 02:19:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:05.953 02:19:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:05.953 02:19:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:05.953 02:19:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:05.953 02:19:30 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:05.953 02:19:30 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:05.953 02:19:30 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:05.953 02:19:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:05.953 02:19:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:05.953 02:19:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:05.953 02:19:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:05.953 02:19:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:05.953 02:19:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:05.954 02:19:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:05.954 02:19:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:05.954 02:19:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:05.954 02:19:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:05.954 02:19:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:05.954 02:19:30 -- common/autotest_common.sh@10 -- # set +x 00:08:07.856 02:19:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:07.856 02:19:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:07.856 02:19:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:07.856 02:19:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:07.856 02:19:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:07.856 02:19:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:07.856 02:19:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:07.856 02:19:32 -- nvmf/common.sh@294 -- # net_devs=() 00:08:07.856 02:19:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:07.856 02:19:32 -- nvmf/common.sh@295 -- # e810=() 00:08:07.856 02:19:32 -- nvmf/common.sh@295 -- # local -ga e810 00:08:07.856 02:19:32 -- nvmf/common.sh@296 -- # x722=() 00:08:07.856 02:19:32 -- nvmf/common.sh@296 -- # local -ga x722 00:08:07.856 02:19:32 -- nvmf/common.sh@297 -- # mlx=() 00:08:07.856 02:19:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:07.856 02:19:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:07.856 02:19:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:07.856 02:19:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:07.856 02:19:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:07.856 02:19:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:07.856 02:19:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:07.856 02:19:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:07.856 02:19:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:07.856 02:19:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:07.857 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:07.857 02:19:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:07.857 02:19:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:07.857 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:07.857 02:19:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:07.857 02:19:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:07.857 02:19:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.857 02:19:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:07.857 02:19:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.857 02:19:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:07.857 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:07.857 02:19:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.857 02:19:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:07.857 02:19:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.857 02:19:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:07.857 02:19:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.857 02:19:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:07.857 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:07.857 02:19:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.857 02:19:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:07.857 02:19:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:07.857 02:19:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:07.857 02:19:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:07.857 02:19:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:07.857 02:19:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:07.857 02:19:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:07.857 02:19:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:07.857 02:19:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:07.857 02:19:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:07.857 02:19:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:07.857 02:19:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:07.857 02:19:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:07.857 02:19:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:07.857 02:19:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:07.857 02:19:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:07.857 02:19:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:07.857 02:19:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:07.857 02:19:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:07.857 02:19:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:07.857 02:19:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:08.116 02:19:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:08.116 02:19:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:08.116 02:19:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:08.116 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:08.116 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:08:08.116 00:08:08.116 --- 10.0.0.2 ping statistics --- 00:08:08.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.116 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:08:08.116 02:19:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:08.116 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:08.116 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:08:08.116 00:08:08.116 --- 10.0.0.1 ping statistics --- 00:08:08.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.116 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:08:08.116 02:19:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:08.116 02:19:32 -- nvmf/common.sh@410 -- # return 0 00:08:08.116 02:19:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:08.116 02:19:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:08.116 02:19:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:08.116 02:19:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:08.116 02:19:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:08.116 02:19:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:08.116 02:19:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:08.116 02:19:32 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:08.116 02:19:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:08.116 02:19:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.116 02:19:32 -- common/autotest_common.sh@10 -- # set +x 00:08:08.116 ************************************ 00:08:08.116 START TEST nvmf_filesystem_no_in_capsule 00:08:08.116 ************************************ 00:08:08.116 02:19:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:08.116 02:19:32 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:08.116 02:19:32 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:08.116 02:19:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:08.116 02:19:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:08.116 02:19:32 -- common/autotest_common.sh@10 -- # set +x 00:08:08.116 02:19:32 -- nvmf/common.sh@469 -- # nvmfpid=1968976 00:08:08.116 02:19:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:08.116 02:19:32 -- nvmf/common.sh@470 -- # waitforlisten 1968976 00:08:08.116 02:19:32 -- common/autotest_common.sh@829 -- # '[' -z 1968976 ']' 00:08:08.116 02:19:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:08.116 02:19:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:08.116 02:19:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:08.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:08.116 02:19:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:08.116 02:19:32 -- common/autotest_common.sh@10 -- # set +x 00:08:08.116 [2024-11-27 02:19:32.602619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:08.116 [2024-11-27 02:19:32.602699] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:08.116 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.116 [2024-11-27 02:19:32.672112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:08.375 [2024-11-27 02:19:32.760299] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:08.375 [2024-11-27 02:19:32.760452] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:08.375 [2024-11-27 02:19:32.760469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:08.375 [2024-11-27 02:19:32.760481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:08.375 [2024-11-27 02:19:32.760628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:08.375 [2024-11-27 02:19:32.760690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:08.375 [2024-11-27 02:19:32.760740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:08.375 [2024-11-27 02:19:32.760743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.940 02:19:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:08.940 02:19:33 -- common/autotest_common.sh@862 -- # return 0 00:08:08.940 02:19:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:08.940 02:19:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:08.940 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 02:19:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:09.198 02:19:33 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:09.198 02:19:33 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 [2024-11-27 02:19:33.580205] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 [2024-11-27 02:19:33.757964] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:09.198 02:19:33 -- common/autotest_common.sh@1369 -- # local bs 00:08:09.198 02:19:33 -- common/autotest_common.sh@1370 -- # local nb 00:08:09.198 02:19:33 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:09.198 02:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.198 02:19:33 -- common/autotest_common.sh@10 -- # set +x 00:08:09.198 02:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.198 02:19:33 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:09.198 { 00:08:09.198 "name": "Malloc1", 00:08:09.198 "aliases": [ 00:08:09.198 "2edf653f-a9bb-4b20-8fc3-3b01ad26ef92" 00:08:09.198 ], 00:08:09.198 "product_name": "Malloc disk", 00:08:09.198 "block_size": 512, 00:08:09.198 "num_blocks": 1048576, 00:08:09.198 "uuid": "2edf653f-a9bb-4b20-8fc3-3b01ad26ef92", 00:08:09.198 "assigned_rate_limits": { 00:08:09.198 "rw_ios_per_sec": 0, 00:08:09.198 "rw_mbytes_per_sec": 0, 00:08:09.198 "r_mbytes_per_sec": 0, 00:08:09.198 "w_mbytes_per_sec": 0 00:08:09.198 }, 00:08:09.198 "claimed": true, 00:08:09.198 "claim_type": "exclusive_write", 00:08:09.198 "zoned": false, 00:08:09.198 "supported_io_types": { 00:08:09.198 "read": true, 00:08:09.198 "write": true, 00:08:09.198 "unmap": true, 00:08:09.198 "write_zeroes": true, 00:08:09.198 "flush": true, 00:08:09.198 "reset": true, 00:08:09.198 "compare": false, 00:08:09.198 "compare_and_write": false, 00:08:09.198 "abort": true, 00:08:09.198 "nvme_admin": false, 00:08:09.198 "nvme_io": false 00:08:09.198 }, 00:08:09.198 "memory_domains": [ 00:08:09.198 { 00:08:09.198 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:09.198 "dma_device_type": 2 00:08:09.198 } 00:08:09.198 ], 00:08:09.198 "driver_specific": {} 00:08:09.198 } 00:08:09.198 ]' 00:08:09.198 02:19:33 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:09.198 02:19:33 -- common/autotest_common.sh@1372 -- # bs=512 00:08:09.198 02:19:33 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:09.456 02:19:33 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:09.456 02:19:33 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:09.456 02:19:33 -- common/autotest_common.sh@1377 -- # echo 512 00:08:09.456 02:19:33 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:09.456 02:19:33 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:10.022 02:19:34 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:10.022 02:19:34 -- common/autotest_common.sh@1187 -- # local i=0 00:08:10.022 02:19:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:10.022 02:19:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:10.022 02:19:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:11.921 02:19:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:11.921 02:19:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:11.921 02:19:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:11.921 02:19:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:11.921 02:19:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:11.921 02:19:36 -- common/autotest_common.sh@1197 -- # return 0 00:08:11.921 02:19:36 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:11.921 02:19:36 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:12.178 02:19:36 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:12.178 02:19:36 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:12.178 02:19:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:12.178 02:19:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:12.178 02:19:36 -- setup/common.sh@80 -- # echo 536870912 00:08:12.178 02:19:36 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:12.178 02:19:36 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:12.178 02:19:36 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:12.178 02:19:36 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:12.436 02:19:36 -- target/filesystem.sh@69 -- # partprobe 00:08:13.369 02:19:37 -- target/filesystem.sh@70 -- # sleep 1 00:08:14.302 02:19:38 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:14.302 02:19:38 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:14.302 02:19:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:14.302 02:19:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:14.302 02:19:38 -- common/autotest_common.sh@10 -- # set +x 00:08:14.302 ************************************ 00:08:14.302 START TEST filesystem_ext4 00:08:14.302 ************************************ 00:08:14.302 02:19:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:14.302 02:19:38 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:14.302 02:19:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:14.303 02:19:38 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:14.303 02:19:38 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:14.303 02:19:38 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:14.303 02:19:38 -- common/autotest_common.sh@914 -- # local i=0 00:08:14.303 02:19:38 -- common/autotest_common.sh@915 -- # local force 00:08:14.303 02:19:38 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:14.303 02:19:38 -- common/autotest_common.sh@918 -- # force=-F 00:08:14.303 02:19:38 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:14.303 mke2fs 1.47.0 (5-Feb-2023) 00:08:14.303 Discarding device blocks: 0/522240 done 00:08:14.303 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:14.303 Filesystem UUID: 1521693c-4f1f-438f-b045-6fa0601d6b09 00:08:14.303 Superblock backups stored on blocks: 00:08:14.303 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:14.303 00:08:14.303 Allocating group tables: 0/64 done 00:08:14.303 Writing inode tables: 0/64 done 00:08:17.581 Creating journal (8192 blocks): done 00:08:17.581 Writing superblocks and filesystem accounting information: 0/64 done 00:08:17.581 00:08:17.581 02:19:41 -- common/autotest_common.sh@931 -- # return 0 00:08:17.581 02:19:41 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.842 02:19:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.842 02:19:47 -- target/filesystem.sh@25 -- # sync 00:08:22.842 02:19:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.842 02:19:47 -- target/filesystem.sh@27 -- # sync 00:08:22.842 02:19:47 -- target/filesystem.sh@29 -- # i=0 00:08:22.842 02:19:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.842 02:19:47 -- target/filesystem.sh@37 -- # kill -0 1968976 00:08:22.842 02:19:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.842 02:19:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.842 02:19:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.842 02:19:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.842 00:08:22.842 real 0m8.426s 00:08:22.842 user 0m0.020s 00:08:22.842 sys 0m0.058s 00:08:22.842 02:19:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:22.842 02:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.842 ************************************ 00:08:22.842 END TEST filesystem_ext4 00:08:22.842 ************************************ 00:08:22.842 02:19:47 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:22.842 02:19:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:22.842 02:19:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.842 02:19:47 -- common/autotest_common.sh@10 -- # set +x 00:08:22.842 ************************************ 00:08:22.842 START TEST filesystem_btrfs 00:08:22.842 ************************************ 00:08:22.842 02:19:47 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:22.842 02:19:47 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:22.842 02:19:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:22.842 02:19:47 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:22.842 02:19:47 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:22.842 02:19:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:22.842 02:19:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:22.842 02:19:47 -- common/autotest_common.sh@915 -- # local force 00:08:22.842 02:19:47 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:22.842 02:19:47 -- common/autotest_common.sh@920 -- # force=-f 00:08:22.842 02:19:47 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:23.100 btrfs-progs v6.8.1 00:08:23.100 See https://btrfs.readthedocs.io for more information. 00:08:23.100 00:08:23.100 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:23.100 NOTE: several default settings have changed in version 5.15, please make sure 00:08:23.100 this does not affect your deployments: 00:08:23.100 - DUP for metadata (-m dup) 00:08:23.100 - enabled no-holes (-O no-holes) 00:08:23.100 - enabled free-space-tree (-R free-space-tree) 00:08:23.100 00:08:23.100 Label: (null) 00:08:23.100 UUID: 2d83c980-13c4-4879-967e-e52d03cbc667 00:08:23.100 Node size: 16384 00:08:23.100 Sector size: 4096 (CPU page size: 4096) 00:08:23.100 Filesystem size: 510.00MiB 00:08:23.100 Block group profiles: 00:08:23.100 Data: single 8.00MiB 00:08:23.100 Metadata: DUP 32.00MiB 00:08:23.100 System: DUP 8.00MiB 00:08:23.100 SSD detected: yes 00:08:23.100 Zoned device: no 00:08:23.100 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:23.100 Checksum: crc32c 00:08:23.100 Number of devices: 1 00:08:23.100 Devices: 00:08:23.100 ID SIZE PATH 00:08:23.100 1 510.00MiB /dev/nvme0n1p1 00:08:23.100 00:08:23.100 02:19:47 -- common/autotest_common.sh@931 -- # return 0 00:08:23.100 02:19:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:24.033 02:19:48 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:24.033 02:19:48 -- target/filesystem.sh@25 -- # sync 00:08:24.033 02:19:48 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:24.033 02:19:48 -- target/filesystem.sh@27 -- # sync 00:08:24.033 02:19:48 -- target/filesystem.sh@29 -- # i=0 00:08:24.033 02:19:48 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:24.033 02:19:48 -- target/filesystem.sh@37 -- # kill -0 1968976 00:08:24.033 02:19:48 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:24.033 02:19:48 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:24.033 02:19:48 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:24.033 02:19:48 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:24.033 00:08:24.033 real 0m1.373s 00:08:24.033 user 0m0.020s 00:08:24.033 sys 0m0.103s 00:08:24.033 02:19:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:24.033 02:19:48 -- common/autotest_common.sh@10 -- # set +x 00:08:24.033 ************************************ 00:08:24.033 END TEST filesystem_btrfs 00:08:24.033 ************************************ 00:08:24.033 02:19:48 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:24.033 02:19:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:24.033 02:19:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:24.033 02:19:48 -- common/autotest_common.sh@10 -- # set +x 00:08:24.033 ************************************ 00:08:24.033 START TEST filesystem_xfs 00:08:24.033 ************************************ 00:08:24.033 02:19:48 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:24.033 02:19:48 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:24.033 02:19:48 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:24.033 02:19:48 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:24.033 02:19:48 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:24.033 02:19:48 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:24.033 02:19:48 -- common/autotest_common.sh@914 -- # local i=0 00:08:24.033 02:19:48 -- common/autotest_common.sh@915 -- # local force 00:08:24.033 02:19:48 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:24.033 02:19:48 -- common/autotest_common.sh@920 -- # force=-f 00:08:24.033 02:19:48 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:24.291 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:24.291 = sectsz=512 attr=2, projid32bit=1 00:08:24.291 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:24.291 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:24.291 data = bsize=4096 blocks=130560, imaxpct=25 00:08:24.291 = sunit=0 swidth=0 blks 00:08:24.291 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:24.291 log =internal log bsize=4096 blocks=16384, version=2 00:08:24.292 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:24.292 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:25.225 Discarding blocks...Done. 00:08:25.225 02:19:49 -- common/autotest_common.sh@931 -- # return 0 00:08:25.225 02:19:49 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:27.753 02:19:51 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:27.753 02:19:51 -- target/filesystem.sh@25 -- # sync 00:08:27.753 02:19:51 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:27.753 02:19:51 -- target/filesystem.sh@27 -- # sync 00:08:27.753 02:19:52 -- target/filesystem.sh@29 -- # i=0 00:08:27.753 02:19:52 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:27.753 02:19:52 -- target/filesystem.sh@37 -- # kill -0 1968976 00:08:27.753 02:19:52 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:27.753 02:19:52 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:27.753 02:19:52 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:27.753 02:19:52 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:27.753 00:08:27.753 real 0m3.482s 00:08:27.753 user 0m0.021s 00:08:27.753 sys 0m0.061s 00:08:27.753 02:19:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:27.753 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:27.753 ************************************ 00:08:27.753 END TEST filesystem_xfs 00:08:27.753 ************************************ 00:08:27.753 02:19:52 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:27.753 02:19:52 -- target/filesystem.sh@93 -- # sync 00:08:27.753 02:19:52 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:28.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.011 02:19:52 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:28.011 02:19:52 -- common/autotest_common.sh@1208 -- # local i=0 00:08:28.011 02:19:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:28.011 02:19:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:28.011 02:19:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:28.011 02:19:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:28.011 02:19:52 -- common/autotest_common.sh@1220 -- # return 0 00:08:28.011 02:19:52 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:28.011 02:19:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:28.011 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:28.011 02:19:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:28.011 02:19:52 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:28.011 02:19:52 -- target/filesystem.sh@101 -- # killprocess 1968976 00:08:28.011 02:19:52 -- common/autotest_common.sh@936 -- # '[' -z 1968976 ']' 00:08:28.011 02:19:52 -- common/autotest_common.sh@940 -- # kill -0 1968976 00:08:28.011 02:19:52 -- common/autotest_common.sh@941 -- # uname 00:08:28.011 02:19:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:28.011 02:19:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1968976 00:08:28.011 02:19:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:28.011 02:19:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:28.011 02:19:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1968976' 00:08:28.011 killing process with pid 1968976 00:08:28.011 02:19:52 -- common/autotest_common.sh@955 -- # kill 1968976 00:08:28.011 02:19:52 -- common/autotest_common.sh@960 -- # wait 1968976 00:08:28.577 02:19:52 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:28.577 00:08:28.577 real 0m20.391s 00:08:28.577 user 1m19.191s 00:08:28.577 sys 0m2.349s 00:08:28.577 02:19:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.577 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:28.577 ************************************ 00:08:28.577 END TEST nvmf_filesystem_no_in_capsule 00:08:28.577 ************************************ 00:08:28.577 02:19:52 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:28.577 02:19:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:28.577 02:19:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.577 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:28.577 ************************************ 00:08:28.577 START TEST nvmf_filesystem_in_capsule 00:08:28.577 ************************************ 00:08:28.577 02:19:52 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:28.577 02:19:52 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:28.577 02:19:52 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:28.578 02:19:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:28.578 02:19:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:28.578 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:28.578 02:19:52 -- nvmf/common.sh@469 -- # nvmfpid=1971565 00:08:28.578 02:19:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:28.578 02:19:52 -- nvmf/common.sh@470 -- # waitforlisten 1971565 00:08:28.578 02:19:52 -- common/autotest_common.sh@829 -- # '[' -z 1971565 ']' 00:08:28.578 02:19:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:28.578 02:19:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:28.578 02:19:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:28.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:28.578 02:19:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:28.578 02:19:52 -- common/autotest_common.sh@10 -- # set +x 00:08:28.578 [2024-11-27 02:19:53.016547] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:28.578 [2024-11-27 02:19:53.016647] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:28.578 EAL: No free 2048 kB hugepages reported on node 1 00:08:28.578 [2024-11-27 02:19:53.082519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:28.578 [2024-11-27 02:19:53.171547] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:28.578 [2024-11-27 02:19:53.171705] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:28.578 [2024-11-27 02:19:53.171721] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:28.578 [2024-11-27 02:19:53.171733] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:28.578 [2024-11-27 02:19:53.171784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:28.578 [2024-11-27 02:19:53.171849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:28.578 [2024-11-27 02:19:53.171913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:28.578 [2024-11-27 02:19:53.171915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.511 02:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:29.511 02:19:54 -- common/autotest_common.sh@862 -- # return 0 00:08:29.511 02:19:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:29.511 02:19:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:29.511 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.511 02:19:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:29.511 02:19:54 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:29.511 02:19:54 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:29.511 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.511 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.511 [2024-11-27 02:19:54.033189] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:29.511 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.511 02:19:54 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:29.511 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.511 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.770 Malloc1 00:08:29.770 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.770 02:19:54 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:29.770 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.770 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.770 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.770 02:19:54 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:29.770 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.770 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.770 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.770 02:19:54 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:29.770 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.770 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.770 [2024-11-27 02:19:54.205517] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:29.770 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.770 02:19:54 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:29.770 02:19:54 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:29.770 02:19:54 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:29.770 02:19:54 -- common/autotest_common.sh@1369 -- # local bs 00:08:29.770 02:19:54 -- common/autotest_common.sh@1370 -- # local nb 00:08:29.770 02:19:54 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:29.770 02:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.770 02:19:54 -- common/autotest_common.sh@10 -- # set +x 00:08:29.770 02:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.770 02:19:54 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:29.770 { 00:08:29.770 "name": "Malloc1", 00:08:29.770 "aliases": [ 00:08:29.770 "eb25c868-3a83-43ae-9608-5f87f4771671" 00:08:29.770 ], 00:08:29.770 "product_name": "Malloc disk", 00:08:29.770 "block_size": 512, 00:08:29.770 "num_blocks": 1048576, 00:08:29.770 "uuid": "eb25c868-3a83-43ae-9608-5f87f4771671", 00:08:29.770 "assigned_rate_limits": { 00:08:29.770 "rw_ios_per_sec": 0, 00:08:29.770 "rw_mbytes_per_sec": 0, 00:08:29.770 "r_mbytes_per_sec": 0, 00:08:29.770 "w_mbytes_per_sec": 0 00:08:29.770 }, 00:08:29.770 "claimed": true, 00:08:29.770 "claim_type": "exclusive_write", 00:08:29.770 "zoned": false, 00:08:29.770 "supported_io_types": { 00:08:29.770 "read": true, 00:08:29.770 "write": true, 00:08:29.770 "unmap": true, 00:08:29.770 "write_zeroes": true, 00:08:29.770 "flush": true, 00:08:29.770 "reset": true, 00:08:29.770 "compare": false, 00:08:29.770 "compare_and_write": false, 00:08:29.770 "abort": true, 00:08:29.770 "nvme_admin": false, 00:08:29.770 "nvme_io": false 00:08:29.770 }, 00:08:29.770 "memory_domains": [ 00:08:29.770 { 00:08:29.770 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:29.770 "dma_device_type": 2 00:08:29.770 } 00:08:29.770 ], 00:08:29.770 "driver_specific": {} 00:08:29.770 } 00:08:29.770 ]' 00:08:29.770 02:19:54 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:29.770 02:19:54 -- common/autotest_common.sh@1372 -- # bs=512 00:08:29.770 02:19:54 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:29.770 02:19:54 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:29.770 02:19:54 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:29.770 02:19:54 -- common/autotest_common.sh@1377 -- # echo 512 00:08:29.770 02:19:54 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:29.770 02:19:54 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:30.337 02:19:54 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:30.337 02:19:54 -- common/autotest_common.sh@1187 -- # local i=0 00:08:30.337 02:19:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:30.337 02:19:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:30.337 02:19:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:32.290 02:19:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:32.290 02:19:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:32.290 02:19:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:32.549 02:19:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:32.549 02:19:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:32.549 02:19:56 -- common/autotest_common.sh@1197 -- # return 0 00:08:32.549 02:19:56 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:32.549 02:19:56 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:32.549 02:19:56 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:32.549 02:19:56 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:32.549 02:19:56 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:32.549 02:19:56 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:32.549 02:19:56 -- setup/common.sh@80 -- # echo 536870912 00:08:32.549 02:19:56 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:32.549 02:19:56 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:32.549 02:19:56 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:32.549 02:19:56 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:32.549 02:19:57 -- target/filesystem.sh@69 -- # partprobe 00:08:32.807 02:19:57 -- target/filesystem.sh@70 -- # sleep 1 00:08:34.182 02:19:58 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:34.182 02:19:58 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:34.182 02:19:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.182 02:19:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.182 02:19:58 -- common/autotest_common.sh@10 -- # set +x 00:08:34.182 ************************************ 00:08:34.182 START TEST filesystem_in_capsule_ext4 00:08:34.182 ************************************ 00:08:34.182 02:19:58 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:34.182 02:19:58 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:34.182 02:19:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.182 02:19:58 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:34.182 02:19:58 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:34.182 02:19:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.182 02:19:58 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.182 02:19:58 -- common/autotest_common.sh@915 -- # local force 00:08:34.182 02:19:58 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:34.182 02:19:58 -- common/autotest_common.sh@918 -- # force=-F 00:08:34.182 02:19:58 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:34.182 mke2fs 1.47.0 (5-Feb-2023) 00:08:34.182 Discarding device blocks: 0/522240 done 00:08:34.182 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:34.182 Filesystem UUID: e3263c93-2c33-423a-8817-7f8e6bb52851 00:08:34.182 Superblock backups stored on blocks: 00:08:34.182 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:34.182 00:08:34.182 Allocating group tables: 0/64 done 00:08:34.182 Writing inode tables: 0/64 done 00:08:34.182 Creating journal (8192 blocks): done 00:08:34.182 Writing superblocks and filesystem accounting information: 0/64 done 00:08:34.182 00:08:34.182 02:19:58 -- common/autotest_common.sh@931 -- # return 0 00:08:34.182 02:19:58 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:40.745 02:20:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:40.745 02:20:04 -- target/filesystem.sh@25 -- # sync 00:08:40.745 02:20:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:40.745 02:20:04 -- target/filesystem.sh@27 -- # sync 00:08:40.745 02:20:04 -- target/filesystem.sh@29 -- # i=0 00:08:40.745 02:20:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:40.745 02:20:04 -- target/filesystem.sh@37 -- # kill -0 1971565 00:08:40.745 02:20:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:40.745 02:20:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:40.745 02:20:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:40.745 02:20:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:40.745 00:08:40.745 real 0m5.828s 00:08:40.745 user 0m0.025s 00:08:40.745 sys 0m0.054s 00:08:40.745 02:20:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:40.745 02:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:40.745 ************************************ 00:08:40.745 END TEST filesystem_in_capsule_ext4 00:08:40.745 ************************************ 00:08:40.745 02:20:04 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:40.745 02:20:04 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.745 02:20:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.745 02:20:04 -- common/autotest_common.sh@10 -- # set +x 00:08:40.745 ************************************ 00:08:40.745 START TEST filesystem_in_capsule_btrfs 00:08:40.745 ************************************ 00:08:40.745 02:20:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:40.745 02:20:04 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:40.745 02:20:04 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.745 02:20:04 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:40.745 02:20:04 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:40.745 02:20:04 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.745 02:20:04 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.745 02:20:04 -- common/autotest_common.sh@915 -- # local force 00:08:40.745 02:20:04 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:40.745 02:20:04 -- common/autotest_common.sh@920 -- # force=-f 00:08:40.745 02:20:04 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:40.745 btrfs-progs v6.8.1 00:08:40.745 See https://btrfs.readthedocs.io for more information. 00:08:40.745 00:08:40.745 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:40.745 NOTE: several default settings have changed in version 5.15, please make sure 00:08:40.745 this does not affect your deployments: 00:08:40.745 - DUP for metadata (-m dup) 00:08:40.745 - enabled no-holes (-O no-holes) 00:08:40.745 - enabled free-space-tree (-R free-space-tree) 00:08:40.745 00:08:40.745 Label: (null) 00:08:40.745 UUID: 22292051-f1a6-44c6-9a63-9d54ca4c110b 00:08:40.745 Node size: 16384 00:08:40.745 Sector size: 4096 (CPU page size: 4096) 00:08:40.745 Filesystem size: 510.00MiB 00:08:40.745 Block group profiles: 00:08:40.745 Data: single 8.00MiB 00:08:40.745 Metadata: DUP 32.00MiB 00:08:40.745 System: DUP 8.00MiB 00:08:40.745 SSD detected: yes 00:08:40.745 Zoned device: no 00:08:40.745 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:40.745 Checksum: crc32c 00:08:40.745 Number of devices: 1 00:08:40.745 Devices: 00:08:40.745 ID SIZE PATH 00:08:40.745 1 510.00MiB /dev/nvme0n1p1 00:08:40.745 00:08:40.745 02:20:04 -- common/autotest_common.sh@931 -- # return 0 00:08:40.745 02:20:04 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:40.745 02:20:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:40.745 02:20:05 -- target/filesystem.sh@25 -- # sync 00:08:40.745 02:20:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:40.745 02:20:05 -- target/filesystem.sh@27 -- # sync 00:08:40.745 02:20:05 -- target/filesystem.sh@29 -- # i=0 00:08:40.745 02:20:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:40.745 02:20:05 -- target/filesystem.sh@37 -- # kill -0 1971565 00:08:40.745 02:20:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:40.745 02:20:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:40.745 02:20:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:40.745 02:20:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:40.745 00:08:40.745 real 0m1.052s 00:08:40.745 user 0m0.014s 00:08:40.745 sys 0m0.110s 00:08:40.745 02:20:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:40.745 02:20:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.745 ************************************ 00:08:40.745 END TEST filesystem_in_capsule_btrfs 00:08:40.745 ************************************ 00:08:40.745 02:20:05 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:40.745 02:20:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.745 02:20:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.745 02:20:05 -- common/autotest_common.sh@10 -- # set +x 00:08:40.745 ************************************ 00:08:40.745 START TEST filesystem_in_capsule_xfs 00:08:40.745 ************************************ 00:08:40.745 02:20:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:40.745 02:20:05 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:40.745 02:20:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.745 02:20:05 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:40.745 02:20:05 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:40.745 02:20:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.745 02:20:05 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.745 02:20:05 -- common/autotest_common.sh@915 -- # local force 00:08:40.745 02:20:05 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:40.745 02:20:05 -- common/autotest_common.sh@920 -- # force=-f 00:08:40.745 02:20:05 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:41.004 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:41.004 = sectsz=512 attr=2, projid32bit=1 00:08:41.004 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:41.004 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:41.004 data = bsize=4096 blocks=130560, imaxpct=25 00:08:41.004 = sunit=0 swidth=0 blks 00:08:41.004 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:41.004 log =internal log bsize=4096 blocks=16384, version=2 00:08:41.004 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:41.004 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:41.938 Discarding blocks...Done. 00:08:41.939 02:20:06 -- common/autotest_common.sh@931 -- # return 0 00:08:41.939 02:20:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.467 02:20:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.467 02:20:08 -- target/filesystem.sh@25 -- # sync 00:08:44.467 02:20:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.467 02:20:08 -- target/filesystem.sh@27 -- # sync 00:08:44.467 02:20:08 -- target/filesystem.sh@29 -- # i=0 00:08:44.467 02:20:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.467 02:20:08 -- target/filesystem.sh@37 -- # kill -0 1971565 00:08:44.468 02:20:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.468 02:20:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.468 02:20:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.468 02:20:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.468 00:08:44.468 real 0m3.396s 00:08:44.468 user 0m0.017s 00:08:44.468 sys 0m0.061s 00:08:44.468 02:20:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.468 02:20:08 -- common/autotest_common.sh@10 -- # set +x 00:08:44.468 ************************************ 00:08:44.468 END TEST filesystem_in_capsule_xfs 00:08:44.468 ************************************ 00:08:44.468 02:20:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:44.468 02:20:08 -- target/filesystem.sh@93 -- # sync 00:08:44.468 02:20:08 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:44.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.468 02:20:09 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:44.468 02:20:09 -- common/autotest_common.sh@1208 -- # local i=0 00:08:44.468 02:20:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:44.468 02:20:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:44.468 02:20:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:44.468 02:20:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:44.743 02:20:09 -- common/autotest_common.sh@1220 -- # return 0 00:08:44.743 02:20:09 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:44.743 02:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:44.743 02:20:09 -- common/autotest_common.sh@10 -- # set +x 00:08:44.743 02:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:44.743 02:20:09 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:44.743 02:20:09 -- target/filesystem.sh@101 -- # killprocess 1971565 00:08:44.743 02:20:09 -- common/autotest_common.sh@936 -- # '[' -z 1971565 ']' 00:08:44.743 02:20:09 -- common/autotest_common.sh@940 -- # kill -0 1971565 00:08:44.743 02:20:09 -- common/autotest_common.sh@941 -- # uname 00:08:44.743 02:20:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:44.743 02:20:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1971565 00:08:44.743 02:20:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:44.743 02:20:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:44.743 02:20:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1971565' 00:08:44.743 killing process with pid 1971565 00:08:44.743 02:20:09 -- common/autotest_common.sh@955 -- # kill 1971565 00:08:44.743 02:20:09 -- common/autotest_common.sh@960 -- # wait 1971565 00:08:45.004 02:20:09 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:45.004 00:08:45.004 real 0m16.637s 00:08:45.004 user 1m4.514s 00:08:45.004 sys 0m2.093s 00:08:45.004 02:20:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:45.004 02:20:09 -- common/autotest_common.sh@10 -- # set +x 00:08:45.004 ************************************ 00:08:45.004 END TEST nvmf_filesystem_in_capsule 00:08:45.004 ************************************ 00:08:45.004 02:20:09 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:45.004 02:20:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:45.004 02:20:09 -- nvmf/common.sh@116 -- # sync 00:08:45.004 02:20:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:45.004 02:20:09 -- nvmf/common.sh@119 -- # set +e 00:08:45.004 02:20:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:45.004 02:20:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:45.262 rmmod nvme_tcp 00:08:45.262 rmmod nvme_fabrics 00:08:45.262 rmmod nvme_keyring 00:08:45.262 02:20:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:45.262 02:20:09 -- nvmf/common.sh@123 -- # set -e 00:08:45.262 02:20:09 -- nvmf/common.sh@124 -- # return 0 00:08:45.262 02:20:09 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:45.262 02:20:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:45.262 02:20:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:45.262 02:20:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:45.263 02:20:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:45.263 02:20:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:45.263 02:20:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:45.263 02:20:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:45.263 02:20:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:47.168 02:20:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:47.168 00:08:47.168 real 0m41.693s 00:08:47.168 user 2m24.743s 00:08:47.168 sys 0m6.058s 00:08:47.168 02:20:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:47.168 02:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:47.168 ************************************ 00:08:47.168 END TEST nvmf_filesystem 00:08:47.168 ************************************ 00:08:47.168 02:20:11 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:47.168 02:20:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:47.168 02:20:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.168 02:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:47.168 ************************************ 00:08:47.168 START TEST nvmf_discovery 00:08:47.168 ************************************ 00:08:47.168 02:20:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:47.427 * Looking for test storage... 00:08:47.427 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:47.427 02:20:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:47.427 02:20:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:47.427 02:20:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:47.427 02:20:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:47.427 02:20:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:47.427 02:20:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:47.427 02:20:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:47.427 02:20:11 -- scripts/common.sh@335 -- # IFS=.-: 00:08:47.427 02:20:11 -- scripts/common.sh@335 -- # read -ra ver1 00:08:47.427 02:20:11 -- scripts/common.sh@336 -- # IFS=.-: 00:08:47.427 02:20:11 -- scripts/common.sh@336 -- # read -ra ver2 00:08:47.427 02:20:11 -- scripts/common.sh@337 -- # local 'op=<' 00:08:47.427 02:20:11 -- scripts/common.sh@339 -- # ver1_l=2 00:08:47.427 02:20:11 -- scripts/common.sh@340 -- # ver2_l=1 00:08:47.427 02:20:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:47.427 02:20:11 -- scripts/common.sh@343 -- # case "$op" in 00:08:47.427 02:20:11 -- scripts/common.sh@344 -- # : 1 00:08:47.427 02:20:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:47.427 02:20:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:47.427 02:20:11 -- scripts/common.sh@364 -- # decimal 1 00:08:47.427 02:20:11 -- scripts/common.sh@352 -- # local d=1 00:08:47.427 02:20:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:47.427 02:20:11 -- scripts/common.sh@354 -- # echo 1 00:08:47.427 02:20:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:47.427 02:20:11 -- scripts/common.sh@365 -- # decimal 2 00:08:47.427 02:20:11 -- scripts/common.sh@352 -- # local d=2 00:08:47.427 02:20:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:47.427 02:20:11 -- scripts/common.sh@354 -- # echo 2 00:08:47.427 02:20:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:47.427 02:20:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:47.427 02:20:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:47.427 02:20:11 -- scripts/common.sh@367 -- # return 0 00:08:47.427 02:20:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:47.427 02:20:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:47.427 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.427 --rc genhtml_branch_coverage=1 00:08:47.427 --rc genhtml_function_coverage=1 00:08:47.427 --rc genhtml_legend=1 00:08:47.427 --rc geninfo_all_blocks=1 00:08:47.427 --rc geninfo_unexecuted_blocks=1 00:08:47.427 00:08:47.427 ' 00:08:47.427 02:20:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:47.427 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.427 --rc genhtml_branch_coverage=1 00:08:47.427 --rc genhtml_function_coverage=1 00:08:47.427 --rc genhtml_legend=1 00:08:47.427 --rc geninfo_all_blocks=1 00:08:47.427 --rc geninfo_unexecuted_blocks=1 00:08:47.427 00:08:47.427 ' 00:08:47.427 02:20:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:47.427 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.427 --rc genhtml_branch_coverage=1 00:08:47.427 --rc genhtml_function_coverage=1 00:08:47.427 --rc genhtml_legend=1 00:08:47.427 --rc geninfo_all_blocks=1 00:08:47.427 --rc geninfo_unexecuted_blocks=1 00:08:47.427 00:08:47.427 ' 00:08:47.427 02:20:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:47.427 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.427 --rc genhtml_branch_coverage=1 00:08:47.427 --rc genhtml_function_coverage=1 00:08:47.427 --rc genhtml_legend=1 00:08:47.427 --rc geninfo_all_blocks=1 00:08:47.427 --rc geninfo_unexecuted_blocks=1 00:08:47.427 00:08:47.427 ' 00:08:47.427 02:20:11 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:47.427 02:20:11 -- nvmf/common.sh@7 -- # uname -s 00:08:47.427 02:20:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:47.427 02:20:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:47.427 02:20:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:47.427 02:20:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:47.427 02:20:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:47.427 02:20:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:47.428 02:20:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:47.428 02:20:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:47.428 02:20:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:47.428 02:20:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:47.428 02:20:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:47.428 02:20:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:47.428 02:20:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:47.428 02:20:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:47.428 02:20:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:47.428 02:20:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:47.428 02:20:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:47.428 02:20:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:47.428 02:20:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:47.428 02:20:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.428 02:20:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.428 02:20:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.428 02:20:11 -- paths/export.sh@5 -- # export PATH 00:08:47.428 02:20:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.428 02:20:11 -- nvmf/common.sh@46 -- # : 0 00:08:47.428 02:20:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:47.428 02:20:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:47.428 02:20:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:47.428 02:20:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:47.428 02:20:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:47.428 02:20:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:47.428 02:20:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:47.428 02:20:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:47.428 02:20:11 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:47.428 02:20:11 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:47.428 02:20:11 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:47.428 02:20:11 -- target/discovery.sh@15 -- # hash nvme 00:08:47.428 02:20:11 -- target/discovery.sh@20 -- # nvmftestinit 00:08:47.428 02:20:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:47.428 02:20:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:47.428 02:20:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:47.428 02:20:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:47.428 02:20:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:47.428 02:20:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.428 02:20:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.428 02:20:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:47.428 02:20:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:47.428 02:20:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:47.428 02:20:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:47.428 02:20:11 -- common/autotest_common.sh@10 -- # set +x 00:08:49.959 02:20:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:49.959 02:20:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:49.959 02:20:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:49.959 02:20:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:49.959 02:20:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:49.959 02:20:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:49.959 02:20:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:49.960 02:20:14 -- nvmf/common.sh@294 -- # net_devs=() 00:08:49.960 02:20:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:49.960 02:20:14 -- nvmf/common.sh@295 -- # e810=() 00:08:49.960 02:20:14 -- nvmf/common.sh@295 -- # local -ga e810 00:08:49.960 02:20:14 -- nvmf/common.sh@296 -- # x722=() 00:08:49.960 02:20:14 -- nvmf/common.sh@296 -- # local -ga x722 00:08:49.960 02:20:14 -- nvmf/common.sh@297 -- # mlx=() 00:08:49.960 02:20:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:49.960 02:20:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:49.960 02:20:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:49.960 02:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:49.960 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:49.960 02:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:49.960 02:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:49.960 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:49.960 02:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:49.960 02:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:49.960 02:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:49.960 02:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:49.960 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:49.960 02:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:49.960 02:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:49.960 02:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:49.960 02:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:49.960 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:49.960 02:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:49.960 02:20:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:49.960 02:20:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:49.960 02:20:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:49.960 02:20:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:49.960 02:20:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:49.960 02:20:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:49.960 02:20:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:49.960 02:20:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:49.960 02:20:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:49.960 02:20:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:49.960 02:20:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:49.960 02:20:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:49.960 02:20:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:49.960 02:20:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:49.960 02:20:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:49.960 02:20:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:49.960 02:20:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:49.960 02:20:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:49.960 02:20:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:49.960 02:20:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:49.960 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:49.960 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:08:49.960 00:08:49.960 --- 10.0.0.2 ping statistics --- 00:08:49.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:49.960 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:08:49.960 02:20:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:49.960 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:49.960 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:08:49.960 00:08:49.960 --- 10.0.0.1 ping statistics --- 00:08:49.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:49.960 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:08:49.960 02:20:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:49.960 02:20:14 -- nvmf/common.sh@410 -- # return 0 00:08:49.960 02:20:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:49.960 02:20:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:49.960 02:20:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:49.960 02:20:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:49.960 02:20:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:49.960 02:20:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:49.960 02:20:14 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:49.960 02:20:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:49.960 02:20:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:49.960 02:20:14 -- common/autotest_common.sh@10 -- # set +x 00:08:49.960 02:20:14 -- nvmf/common.sh@469 -- # nvmfpid=1975785 00:08:49.960 02:20:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:49.960 02:20:14 -- nvmf/common.sh@470 -- # waitforlisten 1975785 00:08:49.960 02:20:14 -- common/autotest_common.sh@829 -- # '[' -z 1975785 ']' 00:08:49.960 02:20:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:49.960 02:20:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:49.961 02:20:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:49.961 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:49.961 02:20:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:49.961 02:20:14 -- common/autotest_common.sh@10 -- # set +x 00:08:49.961 [2024-11-27 02:20:14.288468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:49.961 [2024-11-27 02:20:14.288560] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:49.961 EAL: No free 2048 kB hugepages reported on node 1 00:08:49.961 [2024-11-27 02:20:14.362887] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:49.961 [2024-11-27 02:20:14.455263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:49.961 [2024-11-27 02:20:14.455427] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:49.961 [2024-11-27 02:20:14.455447] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:49.961 [2024-11-27 02:20:14.455461] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:49.961 [2024-11-27 02:20:14.455557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:49.961 [2024-11-27 02:20:14.455589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:49.961 [2024-11-27 02:20:14.455639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:49.961 [2024-11-27 02:20:14.455641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:50.895 02:20:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:50.895 02:20:15 -- common/autotest_common.sh@862 -- # return 0 00:08:50.895 02:20:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:50.895 02:20:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:50.895 02:20:15 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 [2024-11-27 02:20:15.319351] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@26 -- # seq 1 4 00:08:50.895 02:20:15 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:50.895 02:20:15 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 Null1 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 [2024-11-27 02:20:15.359679] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:50.895 02:20:15 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 Null2 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:50.895 02:20:15 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 Null3 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:50.895 02:20:15 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 Null4 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:50.895 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.895 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:50.895 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.895 02:20:15 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:51.154 00:08:51.154 Discovery Log Number of Records 6, Generation counter 6 00:08:51.154 =====Discovery Log Entry 0====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: current discovery subsystem 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4420 00:08:51.154 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: explicit discovery connections, duplicate discovery information 00:08:51.154 sectype: none 00:08:51.154 =====Discovery Log Entry 1====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: nvme subsystem 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4420 00:08:51.154 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: none 00:08:51.154 sectype: none 00:08:51.154 =====Discovery Log Entry 2====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: nvme subsystem 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4420 00:08:51.154 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: none 00:08:51.154 sectype: none 00:08:51.154 =====Discovery Log Entry 3====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: nvme subsystem 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4420 00:08:51.154 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: none 00:08:51.154 sectype: none 00:08:51.154 =====Discovery Log Entry 4====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: nvme subsystem 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4420 00:08:51.154 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: none 00:08:51.154 sectype: none 00:08:51.154 =====Discovery Log Entry 5====== 00:08:51.154 trtype: tcp 00:08:51.154 adrfam: ipv4 00:08:51.154 subtype: discovery subsystem referral 00:08:51.154 treq: not required 00:08:51.154 portid: 0 00:08:51.154 trsvcid: 4430 00:08:51.154 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:51.154 traddr: 10.0.0.2 00:08:51.154 eflags: none 00:08:51.154 sectype: none 00:08:51.154 02:20:15 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:51.154 Perform nvmf subsystem discovery via RPC 00:08:51.154 02:20:15 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:51.154 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.154 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.154 [2024-11-27 02:20:15.704637] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:51.154 [ 00:08:51.154 { 00:08:51.154 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:51.154 "subtype": "Discovery", 00:08:51.154 "listen_addresses": [ 00:08:51.154 { 00:08:51.154 "transport": "TCP", 00:08:51.154 "trtype": "TCP", 00:08:51.154 "adrfam": "IPv4", 00:08:51.154 "traddr": "10.0.0.2", 00:08:51.154 "trsvcid": "4420" 00:08:51.154 } 00:08:51.154 ], 00:08:51.154 "allow_any_host": true, 00:08:51.154 "hosts": [] 00:08:51.154 }, 00:08:51.154 { 00:08:51.154 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:51.154 "subtype": "NVMe", 00:08:51.154 "listen_addresses": [ 00:08:51.154 { 00:08:51.154 "transport": "TCP", 00:08:51.154 "trtype": "TCP", 00:08:51.154 "adrfam": "IPv4", 00:08:51.154 "traddr": "10.0.0.2", 00:08:51.154 "trsvcid": "4420" 00:08:51.154 } 00:08:51.154 ], 00:08:51.154 "allow_any_host": true, 00:08:51.154 "hosts": [], 00:08:51.154 "serial_number": "SPDK00000000000001", 00:08:51.154 "model_number": "SPDK bdev Controller", 00:08:51.154 "max_namespaces": 32, 00:08:51.154 "min_cntlid": 1, 00:08:51.154 "max_cntlid": 65519, 00:08:51.154 "namespaces": [ 00:08:51.154 { 00:08:51.154 "nsid": 1, 00:08:51.154 "bdev_name": "Null1", 00:08:51.154 "name": "Null1", 00:08:51.154 "nguid": "048122D5FB244424965E16692CADEB79", 00:08:51.154 "uuid": "048122d5-fb24-4424-965e-16692cadeb79" 00:08:51.154 } 00:08:51.154 ] 00:08:51.154 }, 00:08:51.154 { 00:08:51.154 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:51.154 "subtype": "NVMe", 00:08:51.154 "listen_addresses": [ 00:08:51.154 { 00:08:51.154 "transport": "TCP", 00:08:51.154 "trtype": "TCP", 00:08:51.154 "adrfam": "IPv4", 00:08:51.154 "traddr": "10.0.0.2", 00:08:51.154 "trsvcid": "4420" 00:08:51.154 } 00:08:51.154 ], 00:08:51.154 "allow_any_host": true, 00:08:51.154 "hosts": [], 00:08:51.154 "serial_number": "SPDK00000000000002", 00:08:51.154 "model_number": "SPDK bdev Controller", 00:08:51.154 "max_namespaces": 32, 00:08:51.154 "min_cntlid": 1, 00:08:51.154 "max_cntlid": 65519, 00:08:51.154 "namespaces": [ 00:08:51.154 { 00:08:51.155 "nsid": 1, 00:08:51.155 "bdev_name": "Null2", 00:08:51.155 "name": "Null2", 00:08:51.155 "nguid": "4A8E8FAF79E94C7E8F4255F88A7625C5", 00:08:51.155 "uuid": "4a8e8faf-79e9-4c7e-8f42-55f88a7625c5" 00:08:51.155 } 00:08:51.155 ] 00:08:51.155 }, 00:08:51.155 { 00:08:51.155 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:51.155 "subtype": "NVMe", 00:08:51.155 "listen_addresses": [ 00:08:51.155 { 00:08:51.155 "transport": "TCP", 00:08:51.155 "trtype": "TCP", 00:08:51.155 "adrfam": "IPv4", 00:08:51.155 "traddr": "10.0.0.2", 00:08:51.155 "trsvcid": "4420" 00:08:51.155 } 00:08:51.155 ], 00:08:51.155 "allow_any_host": true, 00:08:51.155 "hosts": [], 00:08:51.155 "serial_number": "SPDK00000000000003", 00:08:51.155 "model_number": "SPDK bdev Controller", 00:08:51.155 "max_namespaces": 32, 00:08:51.155 "min_cntlid": 1, 00:08:51.155 "max_cntlid": 65519, 00:08:51.155 "namespaces": [ 00:08:51.155 { 00:08:51.155 "nsid": 1, 00:08:51.155 "bdev_name": "Null3", 00:08:51.155 "name": "Null3", 00:08:51.155 "nguid": "EB00EADD64E64D55BFFB86405AD5EBB2", 00:08:51.155 "uuid": "eb00eadd-64e6-4d55-bffb-86405ad5ebb2" 00:08:51.155 } 00:08:51.155 ] 00:08:51.155 }, 00:08:51.155 { 00:08:51.155 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:51.155 "subtype": "NVMe", 00:08:51.155 "listen_addresses": [ 00:08:51.155 { 00:08:51.155 "transport": "TCP", 00:08:51.155 "trtype": "TCP", 00:08:51.155 "adrfam": "IPv4", 00:08:51.155 "traddr": "10.0.0.2", 00:08:51.155 "trsvcid": "4420" 00:08:51.155 } 00:08:51.155 ], 00:08:51.155 "allow_any_host": true, 00:08:51.155 "hosts": [], 00:08:51.155 "serial_number": "SPDK00000000000004", 00:08:51.155 "model_number": "SPDK bdev Controller", 00:08:51.155 "max_namespaces": 32, 00:08:51.155 "min_cntlid": 1, 00:08:51.155 "max_cntlid": 65519, 00:08:51.155 "namespaces": [ 00:08:51.155 { 00:08:51.155 "nsid": 1, 00:08:51.155 "bdev_name": "Null4", 00:08:51.155 "name": "Null4", 00:08:51.155 "nguid": "DD55E09D47AE4E78B2BA804DDA7EFDD6", 00:08:51.155 "uuid": "dd55e09d-47ae-4e78-b2ba-804dda7efdd6" 00:08:51.155 } 00:08:51.155 ] 00:08:51.155 } 00:08:51.155 ] 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@42 -- # seq 1 4 00:08:51.155 02:20:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.155 02:20:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.155 02:20:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.155 02:20:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.155 02:20:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.155 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.155 02:20:15 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:51.155 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.155 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.413 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.413 02:20:15 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:51.413 02:20:15 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:51.413 02:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.413 02:20:15 -- common/autotest_common.sh@10 -- # set +x 00:08:51.413 02:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.413 02:20:15 -- target/discovery.sh@49 -- # check_bdevs= 00:08:51.413 02:20:15 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:51.413 02:20:15 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:51.413 02:20:15 -- target/discovery.sh@57 -- # nvmftestfini 00:08:51.413 02:20:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:51.413 02:20:15 -- nvmf/common.sh@116 -- # sync 00:08:51.413 02:20:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:51.413 02:20:15 -- nvmf/common.sh@119 -- # set +e 00:08:51.413 02:20:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:51.413 02:20:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:51.413 rmmod nvme_tcp 00:08:51.413 rmmod nvme_fabrics 00:08:51.413 rmmod nvme_keyring 00:08:51.413 02:20:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:51.413 02:20:15 -- nvmf/common.sh@123 -- # set -e 00:08:51.413 02:20:15 -- nvmf/common.sh@124 -- # return 0 00:08:51.413 02:20:15 -- nvmf/common.sh@477 -- # '[' -n 1975785 ']' 00:08:51.413 02:20:15 -- nvmf/common.sh@478 -- # killprocess 1975785 00:08:51.413 02:20:15 -- common/autotest_common.sh@936 -- # '[' -z 1975785 ']' 00:08:51.413 02:20:15 -- common/autotest_common.sh@940 -- # kill -0 1975785 00:08:51.413 02:20:15 -- common/autotest_common.sh@941 -- # uname 00:08:51.413 02:20:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:51.413 02:20:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1975785 00:08:51.413 02:20:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:51.413 02:20:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:51.413 02:20:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1975785' 00:08:51.413 killing process with pid 1975785 00:08:51.413 02:20:15 -- common/autotest_common.sh@955 -- # kill 1975785 00:08:51.413 [2024-11-27 02:20:15.914474] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:51.413 02:20:15 -- common/autotest_common.sh@960 -- # wait 1975785 00:08:51.673 02:20:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:51.673 02:20:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:51.673 02:20:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:51.673 02:20:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:51.673 02:20:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:51.673 02:20:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.673 02:20:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.673 02:20:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:53.578 02:20:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:53.578 00:08:53.578 real 0m6.408s 00:08:53.578 user 0m7.877s 00:08:53.578 sys 0m1.971s 00:08:53.578 02:20:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:53.578 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:53.578 ************************************ 00:08:53.578 END TEST nvmf_discovery 00:08:53.578 ************************************ 00:08:53.578 02:20:18 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:53.578 02:20:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:53.578 02:20:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:53.578 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:53.837 ************************************ 00:08:53.837 START TEST nvmf_referrals 00:08:53.837 ************************************ 00:08:53.837 02:20:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:53.837 * Looking for test storage... 00:08:53.837 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:53.837 02:20:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:53.837 02:20:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:53.837 02:20:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:53.837 02:20:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:53.837 02:20:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:53.837 02:20:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:53.837 02:20:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:53.837 02:20:18 -- scripts/common.sh@335 -- # IFS=.-: 00:08:53.837 02:20:18 -- scripts/common.sh@335 -- # read -ra ver1 00:08:53.837 02:20:18 -- scripts/common.sh@336 -- # IFS=.-: 00:08:53.837 02:20:18 -- scripts/common.sh@336 -- # read -ra ver2 00:08:53.837 02:20:18 -- scripts/common.sh@337 -- # local 'op=<' 00:08:53.837 02:20:18 -- scripts/common.sh@339 -- # ver1_l=2 00:08:53.837 02:20:18 -- scripts/common.sh@340 -- # ver2_l=1 00:08:53.837 02:20:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:53.837 02:20:18 -- scripts/common.sh@343 -- # case "$op" in 00:08:53.837 02:20:18 -- scripts/common.sh@344 -- # : 1 00:08:53.837 02:20:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:53.837 02:20:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:53.837 02:20:18 -- scripts/common.sh@364 -- # decimal 1 00:08:53.837 02:20:18 -- scripts/common.sh@352 -- # local d=1 00:08:53.837 02:20:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:53.837 02:20:18 -- scripts/common.sh@354 -- # echo 1 00:08:53.837 02:20:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:53.837 02:20:18 -- scripts/common.sh@365 -- # decimal 2 00:08:53.837 02:20:18 -- scripts/common.sh@352 -- # local d=2 00:08:53.837 02:20:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:53.837 02:20:18 -- scripts/common.sh@354 -- # echo 2 00:08:53.837 02:20:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:53.837 02:20:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:53.837 02:20:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:53.837 02:20:18 -- scripts/common.sh@367 -- # return 0 00:08:53.837 02:20:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:53.837 02:20:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:53.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.837 --rc genhtml_branch_coverage=1 00:08:53.837 --rc genhtml_function_coverage=1 00:08:53.837 --rc genhtml_legend=1 00:08:53.837 --rc geninfo_all_blocks=1 00:08:53.837 --rc geninfo_unexecuted_blocks=1 00:08:53.837 00:08:53.837 ' 00:08:53.837 02:20:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:53.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.837 --rc genhtml_branch_coverage=1 00:08:53.837 --rc genhtml_function_coverage=1 00:08:53.837 --rc genhtml_legend=1 00:08:53.837 --rc geninfo_all_blocks=1 00:08:53.837 --rc geninfo_unexecuted_blocks=1 00:08:53.837 00:08:53.837 ' 00:08:53.837 02:20:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:53.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.837 --rc genhtml_branch_coverage=1 00:08:53.837 --rc genhtml_function_coverage=1 00:08:53.837 --rc genhtml_legend=1 00:08:53.837 --rc geninfo_all_blocks=1 00:08:53.837 --rc geninfo_unexecuted_blocks=1 00:08:53.837 00:08:53.837 ' 00:08:53.837 02:20:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:53.837 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.837 --rc genhtml_branch_coverage=1 00:08:53.837 --rc genhtml_function_coverage=1 00:08:53.837 --rc genhtml_legend=1 00:08:53.837 --rc geninfo_all_blocks=1 00:08:53.837 --rc geninfo_unexecuted_blocks=1 00:08:53.837 00:08:53.837 ' 00:08:53.837 02:20:18 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:53.837 02:20:18 -- nvmf/common.sh@7 -- # uname -s 00:08:53.837 02:20:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:53.837 02:20:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:53.837 02:20:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:53.837 02:20:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:53.837 02:20:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:53.837 02:20:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:53.837 02:20:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:53.837 02:20:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:53.837 02:20:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:53.837 02:20:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:53.837 02:20:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:53.837 02:20:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:53.837 02:20:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:53.837 02:20:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:53.838 02:20:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:53.838 02:20:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:53.838 02:20:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:53.838 02:20:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:53.838 02:20:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:53.838 02:20:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.838 02:20:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.838 02:20:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.838 02:20:18 -- paths/export.sh@5 -- # export PATH 00:08:53.838 02:20:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.838 02:20:18 -- nvmf/common.sh@46 -- # : 0 00:08:53.838 02:20:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:53.838 02:20:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:53.838 02:20:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:53.838 02:20:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:53.838 02:20:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:53.838 02:20:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:53.838 02:20:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:53.838 02:20:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:53.838 02:20:18 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:53.838 02:20:18 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:53.838 02:20:18 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:53.838 02:20:18 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:53.838 02:20:18 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:53.838 02:20:18 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:53.838 02:20:18 -- target/referrals.sh@37 -- # nvmftestinit 00:08:53.838 02:20:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:53.838 02:20:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:53.838 02:20:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:53.838 02:20:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:53.838 02:20:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:53.838 02:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:53.838 02:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:53.838 02:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:53.838 02:20:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:53.838 02:20:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:53.838 02:20:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:53.838 02:20:18 -- common/autotest_common.sh@10 -- # set +x 00:08:55.740 02:20:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:55.740 02:20:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:55.740 02:20:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:55.740 02:20:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:55.740 02:20:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:55.740 02:20:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:55.740 02:20:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:55.740 02:20:20 -- nvmf/common.sh@294 -- # net_devs=() 00:08:55.740 02:20:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:55.740 02:20:20 -- nvmf/common.sh@295 -- # e810=() 00:08:55.740 02:20:20 -- nvmf/common.sh@295 -- # local -ga e810 00:08:55.740 02:20:20 -- nvmf/common.sh@296 -- # x722=() 00:08:55.740 02:20:20 -- nvmf/common.sh@296 -- # local -ga x722 00:08:55.740 02:20:20 -- nvmf/common.sh@297 -- # mlx=() 00:08:55.740 02:20:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:55.740 02:20:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:55.740 02:20:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:55.740 02:20:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:55.740 02:20:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:55.740 02:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.740 02:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:55.740 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:55.740 02:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.740 02:20:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:55.740 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:55.740 02:20:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:55.740 02:20:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:55.740 02:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.740 02:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.740 02:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.740 02:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.740 02:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:55.740 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:55.740 02:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.740 02:20:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.740 02:20:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.741 02:20:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.741 02:20:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.741 02:20:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:55.741 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:55.741 02:20:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.741 02:20:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:55.741 02:20:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:55.741 02:20:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:55.741 02:20:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:55.741 02:20:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:55.741 02:20:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:55.741 02:20:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:55.741 02:20:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:55.741 02:20:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:55.741 02:20:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:55.741 02:20:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:55.741 02:20:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:55.741 02:20:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:55.741 02:20:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:55.741 02:20:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:55.741 02:20:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:55.741 02:20:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:55.741 02:20:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:55.741 02:20:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:55.741 02:20:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:55.741 02:20:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:55.741 02:20:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:55.999 02:20:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:55.999 02:20:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:55.999 02:20:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:55.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:55.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:08:55.999 00:08:55.999 --- 10.0.0.2 ping statistics --- 00:08:55.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.999 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:08:55.999 02:20:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:55.999 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:55.999 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:08:55.999 00:08:55.999 --- 10.0.0.1 ping statistics --- 00:08:55.999 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.999 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:08:55.999 02:20:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:55.999 02:20:20 -- nvmf/common.sh@410 -- # return 0 00:08:55.999 02:20:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:55.999 02:20:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:55.999 02:20:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:55.999 02:20:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:55.999 02:20:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:55.999 02:20:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:55.999 02:20:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:55.999 02:20:20 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:55.999 02:20:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:55.999 02:20:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:55.999 02:20:20 -- common/autotest_common.sh@10 -- # set +x 00:08:55.999 02:20:20 -- nvmf/common.sh@469 -- # nvmfpid=1977919 00:08:55.999 02:20:20 -- nvmf/common.sh@470 -- # waitforlisten 1977919 00:08:56.000 02:20:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:56.000 02:20:20 -- common/autotest_common.sh@829 -- # '[' -z 1977919 ']' 00:08:56.000 02:20:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:56.000 02:20:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:56.000 02:20:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:56.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:56.000 02:20:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:56.000 02:20:20 -- common/autotest_common.sh@10 -- # set +x 00:08:56.000 [2024-11-27 02:20:20.490246] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:56.000 [2024-11-27 02:20:20.490332] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:56.000 EAL: No free 2048 kB hugepages reported on node 1 00:08:56.000 [2024-11-27 02:20:20.560667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:56.258 [2024-11-27 02:20:20.658330] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:56.258 [2024-11-27 02:20:20.658486] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:56.258 [2024-11-27 02:20:20.658506] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:56.258 [2024-11-27 02:20:20.658542] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:56.258 [2024-11-27 02:20:20.658769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:56.258 [2024-11-27 02:20:20.658837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:56.258 [2024-11-27 02:20:20.658894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:56.258 [2024-11-27 02:20:20.658898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.223 02:20:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:57.223 02:20:21 -- common/autotest_common.sh@862 -- # return 0 00:08:57.223 02:20:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:57.223 02:20:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:57.223 02:20:21 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 [2024-11-27 02:20:21.520241] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 [2024-11-27 02:20:21.532433] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.223 02:20:21 -- target/referrals.sh@48 -- # jq length 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:57.223 02:20:21 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:57.223 02:20:21 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:57.223 02:20:21 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.223 02:20:21 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:57.223 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.223 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.223 02:20:21 -- target/referrals.sh@21 -- # sort 00:08:57.223 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:57.223 02:20:21 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:57.223 02:20:21 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:57.223 02:20:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:57.223 02:20:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:57.224 02:20:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:57.224 02:20:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:57.224 02:20:21 -- target/referrals.sh@26 -- # sort 00:08:57.482 02:20:21 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:57.482 02:20:21 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:57.482 02:20:21 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:57.482 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.482 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.482 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.482 02:20:21 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:57.482 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.482 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.482 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.482 02:20:21 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:57.482 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.482 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.482 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.482 02:20:21 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.482 02:20:21 -- target/referrals.sh@56 -- # jq length 00:08:57.482 02:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.482 02:20:21 -- common/autotest_common.sh@10 -- # set +x 00:08:57.482 02:20:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.482 02:20:21 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:57.482 02:20:21 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:57.482 02:20:21 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:57.482 02:20:21 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:57.482 02:20:21 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:57.482 02:20:21 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:57.482 02:20:21 -- target/referrals.sh@26 -- # sort 00:08:57.741 02:20:22 -- target/referrals.sh@26 -- # echo 00:08:57.741 02:20:22 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:57.741 02:20:22 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:57.741 02:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.741 02:20:22 -- common/autotest_common.sh@10 -- # set +x 00:08:57.741 02:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.741 02:20:22 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:57.741 02:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.741 02:20:22 -- common/autotest_common.sh@10 -- # set +x 00:08:57.741 02:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.741 02:20:22 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:57.741 02:20:22 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:57.741 02:20:22 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.741 02:20:22 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:57.741 02:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.741 02:20:22 -- common/autotest_common.sh@10 -- # set +x 00:08:57.741 02:20:22 -- target/referrals.sh@21 -- # sort 00:08:57.741 02:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.741 02:20:22 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:57.741 02:20:22 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:57.741 02:20:22 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:57.741 02:20:22 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:57.741 02:20:22 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:57.741 02:20:22 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:57.741 02:20:22 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:57.741 02:20:22 -- target/referrals.sh@26 -- # sort 00:08:58.000 02:20:22 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:58.000 02:20:22 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:58.000 02:20:22 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:58.000 02:20:22 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:58.000 02:20:22 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:58.000 02:20:22 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.000 02:20:22 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:58.000 02:20:22 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:58.000 02:20:22 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:58.000 02:20:22 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:58.000 02:20:22 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:58.000 02:20:22 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.000 02:20:22 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:58.259 02:20:22 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:58.259 02:20:22 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:58.259 02:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.259 02:20:22 -- common/autotest_common.sh@10 -- # set +x 00:08:58.259 02:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.259 02:20:22 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:58.259 02:20:22 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:58.259 02:20:22 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:58.259 02:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.259 02:20:22 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:58.259 02:20:22 -- common/autotest_common.sh@10 -- # set +x 00:08:58.259 02:20:22 -- target/referrals.sh@21 -- # sort 00:08:58.259 02:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.259 02:20:22 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:58.259 02:20:22 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:58.259 02:20:22 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:58.259 02:20:22 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:58.259 02:20:22 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:58.259 02:20:22 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.259 02:20:22 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:58.259 02:20:22 -- target/referrals.sh@26 -- # sort 00:08:58.517 02:20:23 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:58.517 02:20:23 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:58.517 02:20:23 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:58.517 02:20:23 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:58.517 02:20:23 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:58.517 02:20:23 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.517 02:20:23 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:58.775 02:20:23 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:58.775 02:20:23 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:58.775 02:20:23 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:58.775 02:20:23 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:58.775 02:20:23 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.775 02:20:23 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:58.775 02:20:23 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:58.775 02:20:23 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:58.775 02:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.775 02:20:23 -- common/autotest_common.sh@10 -- # set +x 00:08:58.775 02:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.775 02:20:23 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:58.775 02:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.775 02:20:23 -- target/referrals.sh@82 -- # jq length 00:08:58.775 02:20:23 -- common/autotest_common.sh@10 -- # set +x 00:08:58.775 02:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:59.034 02:20:23 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:59.034 02:20:23 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:59.034 02:20:23 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:59.034 02:20:23 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:59.034 02:20:23 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:59.034 02:20:23 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:59.034 02:20:23 -- target/referrals.sh@26 -- # sort 00:08:59.034 02:20:23 -- target/referrals.sh@26 -- # echo 00:08:59.034 02:20:23 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:59.034 02:20:23 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:59.034 02:20:23 -- target/referrals.sh@86 -- # nvmftestfini 00:08:59.034 02:20:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:59.034 02:20:23 -- nvmf/common.sh@116 -- # sync 00:08:59.034 02:20:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:59.034 02:20:23 -- nvmf/common.sh@119 -- # set +e 00:08:59.034 02:20:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:59.034 02:20:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:59.034 rmmod nvme_tcp 00:08:59.034 rmmod nvme_fabrics 00:08:59.034 rmmod nvme_keyring 00:08:59.292 02:20:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:59.292 02:20:23 -- nvmf/common.sh@123 -- # set -e 00:08:59.292 02:20:23 -- nvmf/common.sh@124 -- # return 0 00:08:59.292 02:20:23 -- nvmf/common.sh@477 -- # '[' -n 1977919 ']' 00:08:59.292 02:20:23 -- nvmf/common.sh@478 -- # killprocess 1977919 00:08:59.292 02:20:23 -- common/autotest_common.sh@936 -- # '[' -z 1977919 ']' 00:08:59.292 02:20:23 -- common/autotest_common.sh@940 -- # kill -0 1977919 00:08:59.292 02:20:23 -- common/autotest_common.sh@941 -- # uname 00:08:59.292 02:20:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:59.292 02:20:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1977919 00:08:59.292 02:20:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:59.292 02:20:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:59.292 02:20:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1977919' 00:08:59.292 killing process with pid 1977919 00:08:59.292 02:20:23 -- common/autotest_common.sh@955 -- # kill 1977919 00:08:59.292 02:20:23 -- common/autotest_common.sh@960 -- # wait 1977919 00:08:59.551 02:20:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:59.551 02:20:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:59.551 02:20:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:59.551 02:20:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:59.551 02:20:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:59.551 02:20:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.551 02:20:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.551 02:20:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:01.458 02:20:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:01.458 00:09:01.458 real 0m7.791s 00:09:01.458 user 0m14.770s 00:09:01.458 sys 0m2.238s 00:09:01.458 02:20:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:01.458 02:20:26 -- common/autotest_common.sh@10 -- # set +x 00:09:01.458 ************************************ 00:09:01.458 END TEST nvmf_referrals 00:09:01.458 ************************************ 00:09:01.458 02:20:26 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:01.458 02:20:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:01.458 02:20:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:01.458 02:20:26 -- common/autotest_common.sh@10 -- # set +x 00:09:01.458 ************************************ 00:09:01.458 START TEST nvmf_connect_disconnect 00:09:01.458 ************************************ 00:09:01.458 02:20:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:01.458 * Looking for test storage... 00:09:01.458 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:01.458 02:20:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:01.458 02:20:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:01.458 02:20:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:01.717 02:20:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:01.717 02:20:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:01.717 02:20:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:01.717 02:20:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:01.717 02:20:26 -- scripts/common.sh@335 -- # IFS=.-: 00:09:01.717 02:20:26 -- scripts/common.sh@335 -- # read -ra ver1 00:09:01.717 02:20:26 -- scripts/common.sh@336 -- # IFS=.-: 00:09:01.717 02:20:26 -- scripts/common.sh@336 -- # read -ra ver2 00:09:01.717 02:20:26 -- scripts/common.sh@337 -- # local 'op=<' 00:09:01.717 02:20:26 -- scripts/common.sh@339 -- # ver1_l=2 00:09:01.717 02:20:26 -- scripts/common.sh@340 -- # ver2_l=1 00:09:01.717 02:20:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:01.717 02:20:26 -- scripts/common.sh@343 -- # case "$op" in 00:09:01.717 02:20:26 -- scripts/common.sh@344 -- # : 1 00:09:01.717 02:20:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:01.718 02:20:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:01.718 02:20:26 -- scripts/common.sh@364 -- # decimal 1 00:09:01.718 02:20:26 -- scripts/common.sh@352 -- # local d=1 00:09:01.718 02:20:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:01.718 02:20:26 -- scripts/common.sh@354 -- # echo 1 00:09:01.718 02:20:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:01.718 02:20:26 -- scripts/common.sh@365 -- # decimal 2 00:09:01.718 02:20:26 -- scripts/common.sh@352 -- # local d=2 00:09:01.718 02:20:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:01.718 02:20:26 -- scripts/common.sh@354 -- # echo 2 00:09:01.718 02:20:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:01.718 02:20:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:01.718 02:20:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:01.718 02:20:26 -- scripts/common.sh@367 -- # return 0 00:09:01.718 02:20:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:01.718 02:20:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:01.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.718 --rc genhtml_branch_coverage=1 00:09:01.718 --rc genhtml_function_coverage=1 00:09:01.718 --rc genhtml_legend=1 00:09:01.718 --rc geninfo_all_blocks=1 00:09:01.718 --rc geninfo_unexecuted_blocks=1 00:09:01.718 00:09:01.718 ' 00:09:01.718 02:20:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:01.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.718 --rc genhtml_branch_coverage=1 00:09:01.718 --rc genhtml_function_coverage=1 00:09:01.718 --rc genhtml_legend=1 00:09:01.718 --rc geninfo_all_blocks=1 00:09:01.718 --rc geninfo_unexecuted_blocks=1 00:09:01.718 00:09:01.718 ' 00:09:01.718 02:20:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:01.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.718 --rc genhtml_branch_coverage=1 00:09:01.718 --rc genhtml_function_coverage=1 00:09:01.718 --rc genhtml_legend=1 00:09:01.718 --rc geninfo_all_blocks=1 00:09:01.718 --rc geninfo_unexecuted_blocks=1 00:09:01.718 00:09:01.718 ' 00:09:01.718 02:20:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:01.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:01.718 --rc genhtml_branch_coverage=1 00:09:01.718 --rc genhtml_function_coverage=1 00:09:01.718 --rc genhtml_legend=1 00:09:01.718 --rc geninfo_all_blocks=1 00:09:01.718 --rc geninfo_unexecuted_blocks=1 00:09:01.718 00:09:01.718 ' 00:09:01.718 02:20:26 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:01.718 02:20:26 -- nvmf/common.sh@7 -- # uname -s 00:09:01.718 02:20:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:01.718 02:20:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:01.718 02:20:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:01.718 02:20:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:01.718 02:20:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:01.718 02:20:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:01.718 02:20:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:01.718 02:20:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:01.718 02:20:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:01.718 02:20:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:01.718 02:20:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:01.718 02:20:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:01.718 02:20:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:01.718 02:20:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:01.718 02:20:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:01.718 02:20:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:01.718 02:20:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:01.718 02:20:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:01.718 02:20:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:01.718 02:20:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.718 02:20:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.718 02:20:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.718 02:20:26 -- paths/export.sh@5 -- # export PATH 00:09:01.718 02:20:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:01.718 02:20:26 -- nvmf/common.sh@46 -- # : 0 00:09:01.718 02:20:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:01.718 02:20:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:01.718 02:20:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:01.718 02:20:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:01.718 02:20:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:01.718 02:20:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:01.718 02:20:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:01.718 02:20:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:01.718 02:20:26 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:01.718 02:20:26 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:01.718 02:20:26 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:01.718 02:20:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:01.718 02:20:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:01.718 02:20:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:01.718 02:20:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:01.718 02:20:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:01.718 02:20:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:01.718 02:20:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:01.718 02:20:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:01.718 02:20:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:01.718 02:20:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:01.718 02:20:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:01.718 02:20:26 -- common/autotest_common.sh@10 -- # set +x 00:09:04.258 02:20:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:04.258 02:20:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:04.258 02:20:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:04.258 02:20:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:04.258 02:20:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:04.258 02:20:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:04.258 02:20:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:04.258 02:20:28 -- nvmf/common.sh@294 -- # net_devs=() 00:09:04.258 02:20:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:04.258 02:20:28 -- nvmf/common.sh@295 -- # e810=() 00:09:04.258 02:20:28 -- nvmf/common.sh@295 -- # local -ga e810 00:09:04.258 02:20:28 -- nvmf/common.sh@296 -- # x722=() 00:09:04.258 02:20:28 -- nvmf/common.sh@296 -- # local -ga x722 00:09:04.258 02:20:28 -- nvmf/common.sh@297 -- # mlx=() 00:09:04.258 02:20:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:04.258 02:20:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:04.258 02:20:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:04.258 02:20:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:04.258 02:20:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:04.258 02:20:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.258 02:20:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:04.258 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:04.258 02:20:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.258 02:20:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:04.258 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:04.258 02:20:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:04.258 02:20:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:04.258 02:20:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.258 02:20:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.258 02:20:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.258 02:20:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.258 02:20:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:04.258 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:04.258 02:20:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.258 02:20:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.258 02:20:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.258 02:20:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.258 02:20:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.258 02:20:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:04.258 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:04.258 02:20:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.258 02:20:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:04.258 02:20:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:04.259 02:20:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:04.259 02:20:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:04.259 02:20:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:04.259 02:20:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:04.259 02:20:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:04.259 02:20:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:04.259 02:20:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:04.259 02:20:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:04.259 02:20:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:04.259 02:20:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:04.259 02:20:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:04.259 02:20:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:04.259 02:20:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:04.259 02:20:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:04.259 02:20:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:04.259 02:20:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:04.259 02:20:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:04.259 02:20:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:04.259 02:20:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:04.259 02:20:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:04.259 02:20:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:04.259 02:20:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:04.259 02:20:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:04.259 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:04.259 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:09:04.259 00:09:04.259 --- 10.0.0.2 ping statistics --- 00:09:04.259 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.259 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:09:04.259 02:20:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:04.259 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:04.259 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:09:04.259 00:09:04.259 --- 10.0.0.1 ping statistics --- 00:09:04.259 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.259 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:09:04.259 02:20:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:04.259 02:20:28 -- nvmf/common.sh@410 -- # return 0 00:09:04.259 02:20:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:04.259 02:20:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:04.259 02:20:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:04.259 02:20:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:04.259 02:20:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:04.259 02:20:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:04.259 02:20:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:04.259 02:20:28 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:04.259 02:20:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:04.259 02:20:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:04.259 02:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:04.259 02:20:28 -- nvmf/common.sh@469 -- # nvmfpid=1980413 00:09:04.259 02:20:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:04.259 02:20:28 -- nvmf/common.sh@470 -- # waitforlisten 1980413 00:09:04.259 02:20:28 -- common/autotest_common.sh@829 -- # '[' -z 1980413 ']' 00:09:04.259 02:20:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:04.259 02:20:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:04.259 02:20:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:04.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:04.259 02:20:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:04.259 02:20:28 -- common/autotest_common.sh@10 -- # set +x 00:09:04.259 [2024-11-27 02:20:28.545575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:04.259 [2024-11-27 02:20:28.545664] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:04.259 EAL: No free 2048 kB hugepages reported on node 1 00:09:04.259 [2024-11-27 02:20:28.612016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:04.259 [2024-11-27 02:20:28.701334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:04.259 [2024-11-27 02:20:28.701500] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:04.259 [2024-11-27 02:20:28.701518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:04.259 [2024-11-27 02:20:28.701554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:04.259 [2024-11-27 02:20:28.701796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:04.259 [2024-11-27 02:20:28.701825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:04.259 [2024-11-27 02:20:28.701878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:04.259 [2024-11-27 02:20:28.701881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:05.191 02:20:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:05.191 02:20:29 -- common/autotest_common.sh@862 -- # return 0 00:09:05.191 02:20:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:05.191 02:20:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 02:20:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:05.191 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 [2024-11-27 02:20:29.550203] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:05.191 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:05.191 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:05.191 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:05.191 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:05.191 02:20:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.191 02:20:29 -- common/autotest_common.sh@10 -- # set +x 00:09:05.191 [2024-11-27 02:20:29.603341] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:05.191 02:20:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:05.191 02:20:29 -- target/connect_disconnect.sh@34 -- # set +x 00:09:07.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.619 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.212 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.688 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.586 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.544 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.600 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.101 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.065 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.510 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.956 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.013 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.439 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.421 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.949 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.849 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.231 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.872 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.772 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.191 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.732 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.630 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.587 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.014 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.541 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.068 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.496 [2024-11-27 02:22:43.871383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8653e0 is same with the state(5) to be set 00:11:19.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.619 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.075 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.557 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.949 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.336 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.767 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.819 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.871 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.768 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:31.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.152 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:52.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.705 02:24:21 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:57.705 02:24:21 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:57.705 02:24:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:57.705 02:24:21 -- nvmf/common.sh@116 -- # sync 00:12:57.705 02:24:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:57.705 02:24:21 -- nvmf/common.sh@119 -- # set +e 00:12:57.705 02:24:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:57.705 02:24:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:57.705 rmmod nvme_tcp 00:12:57.705 rmmod nvme_fabrics 00:12:57.705 rmmod nvme_keyring 00:12:57.705 02:24:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:57.705 02:24:21 -- nvmf/common.sh@123 -- # set -e 00:12:57.705 02:24:21 -- nvmf/common.sh@124 -- # return 0 00:12:57.705 02:24:21 -- nvmf/common.sh@477 -- # '[' -n 1980413 ']' 00:12:57.705 02:24:21 -- nvmf/common.sh@478 -- # killprocess 1980413 00:12:57.705 02:24:21 -- common/autotest_common.sh@936 -- # '[' -z 1980413 ']' 00:12:57.705 02:24:21 -- common/autotest_common.sh@940 -- # kill -0 1980413 00:12:57.705 02:24:21 -- common/autotest_common.sh@941 -- # uname 00:12:57.705 02:24:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:57.705 02:24:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1980413 00:12:57.705 02:24:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:57.705 02:24:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:57.705 02:24:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1980413' 00:12:57.705 killing process with pid 1980413 00:12:57.705 02:24:21 -- common/autotest_common.sh@955 -- # kill 1980413 00:12:57.705 02:24:21 -- common/autotest_common.sh@960 -- # wait 1980413 00:12:57.705 02:24:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:57.705 02:24:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:57.705 02:24:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:57.705 02:24:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:57.705 02:24:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:57.705 02:24:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:57.705 02:24:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:57.705 02:24:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:59.621 02:24:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:59.621 00:12:59.621 real 3m58.123s 00:12:59.621 user 15m7.813s 00:12:59.621 sys 0m35.046s 00:12:59.621 02:24:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:59.621 02:24:24 -- common/autotest_common.sh@10 -- # set +x 00:12:59.621 ************************************ 00:12:59.621 END TEST nvmf_connect_disconnect 00:12:59.621 ************************************ 00:12:59.621 02:24:24 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:59.621 02:24:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:59.621 02:24:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:59.621 02:24:24 -- common/autotest_common.sh@10 -- # set +x 00:12:59.621 ************************************ 00:12:59.621 START TEST nvmf_multitarget 00:12:59.621 ************************************ 00:12:59.621 02:24:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:59.621 * Looking for test storage... 00:12:59.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:59.621 02:24:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:59.621 02:24:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:59.621 02:24:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:59.879 02:24:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:59.879 02:24:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:59.879 02:24:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:59.879 02:24:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:59.879 02:24:24 -- scripts/common.sh@335 -- # IFS=.-: 00:12:59.879 02:24:24 -- scripts/common.sh@335 -- # read -ra ver1 00:12:59.879 02:24:24 -- scripts/common.sh@336 -- # IFS=.-: 00:12:59.879 02:24:24 -- scripts/common.sh@336 -- # read -ra ver2 00:12:59.879 02:24:24 -- scripts/common.sh@337 -- # local 'op=<' 00:12:59.879 02:24:24 -- scripts/common.sh@339 -- # ver1_l=2 00:12:59.879 02:24:24 -- scripts/common.sh@340 -- # ver2_l=1 00:12:59.879 02:24:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:59.879 02:24:24 -- scripts/common.sh@343 -- # case "$op" in 00:12:59.879 02:24:24 -- scripts/common.sh@344 -- # : 1 00:12:59.879 02:24:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:59.879 02:24:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:59.879 02:24:24 -- scripts/common.sh@364 -- # decimal 1 00:12:59.879 02:24:24 -- scripts/common.sh@352 -- # local d=1 00:12:59.879 02:24:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:59.879 02:24:24 -- scripts/common.sh@354 -- # echo 1 00:12:59.879 02:24:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:59.879 02:24:24 -- scripts/common.sh@365 -- # decimal 2 00:12:59.879 02:24:24 -- scripts/common.sh@352 -- # local d=2 00:12:59.879 02:24:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:59.879 02:24:24 -- scripts/common.sh@354 -- # echo 2 00:12:59.879 02:24:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:59.879 02:24:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:59.880 02:24:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:59.880 02:24:24 -- scripts/common.sh@367 -- # return 0 00:12:59.880 02:24:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:59.880 02:24:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:59.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:59.880 --rc genhtml_branch_coverage=1 00:12:59.880 --rc genhtml_function_coverage=1 00:12:59.880 --rc genhtml_legend=1 00:12:59.880 --rc geninfo_all_blocks=1 00:12:59.880 --rc geninfo_unexecuted_blocks=1 00:12:59.880 00:12:59.880 ' 00:12:59.880 02:24:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:59.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:59.880 --rc genhtml_branch_coverage=1 00:12:59.880 --rc genhtml_function_coverage=1 00:12:59.880 --rc genhtml_legend=1 00:12:59.880 --rc geninfo_all_blocks=1 00:12:59.880 --rc geninfo_unexecuted_blocks=1 00:12:59.880 00:12:59.880 ' 00:12:59.880 02:24:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:59.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:59.880 --rc genhtml_branch_coverage=1 00:12:59.880 --rc genhtml_function_coverage=1 00:12:59.880 --rc genhtml_legend=1 00:12:59.880 --rc geninfo_all_blocks=1 00:12:59.880 --rc geninfo_unexecuted_blocks=1 00:12:59.880 00:12:59.880 ' 00:12:59.880 02:24:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:59.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:59.880 --rc genhtml_branch_coverage=1 00:12:59.880 --rc genhtml_function_coverage=1 00:12:59.880 --rc genhtml_legend=1 00:12:59.880 --rc geninfo_all_blocks=1 00:12:59.880 --rc geninfo_unexecuted_blocks=1 00:12:59.880 00:12:59.880 ' 00:12:59.880 02:24:24 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:59.880 02:24:24 -- nvmf/common.sh@7 -- # uname -s 00:12:59.880 02:24:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:59.880 02:24:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:59.880 02:24:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:59.880 02:24:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:59.880 02:24:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:59.880 02:24:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:59.880 02:24:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:59.880 02:24:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:59.880 02:24:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:59.880 02:24:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:59.880 02:24:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.880 02:24:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.880 02:24:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:59.880 02:24:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:59.880 02:24:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:59.880 02:24:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:59.880 02:24:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:59.880 02:24:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:59.880 02:24:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:59.880 02:24:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.880 02:24:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.880 02:24:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.880 02:24:24 -- paths/export.sh@5 -- # export PATH 00:12:59.880 02:24:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:59.880 02:24:24 -- nvmf/common.sh@46 -- # : 0 00:12:59.880 02:24:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:59.880 02:24:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:59.880 02:24:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:59.880 02:24:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:59.880 02:24:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:59.880 02:24:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:59.880 02:24:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:59.880 02:24:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:59.880 02:24:24 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:59.880 02:24:24 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:59.880 02:24:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:59.880 02:24:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:59.880 02:24:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:59.880 02:24:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:59.880 02:24:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:59.880 02:24:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:59.880 02:24:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:59.880 02:24:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:59.880 02:24:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:59.880 02:24:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:59.880 02:24:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:59.880 02:24:24 -- common/autotest_common.sh@10 -- # set +x 00:13:01.781 02:24:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:01.781 02:24:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:01.781 02:24:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:01.781 02:24:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:01.781 02:24:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:01.781 02:24:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:01.781 02:24:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:01.781 02:24:26 -- nvmf/common.sh@294 -- # net_devs=() 00:13:01.781 02:24:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:01.781 02:24:26 -- nvmf/common.sh@295 -- # e810=() 00:13:01.781 02:24:26 -- nvmf/common.sh@295 -- # local -ga e810 00:13:01.781 02:24:26 -- nvmf/common.sh@296 -- # x722=() 00:13:01.781 02:24:26 -- nvmf/common.sh@296 -- # local -ga x722 00:13:01.781 02:24:26 -- nvmf/common.sh@297 -- # mlx=() 00:13:01.781 02:24:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:01.781 02:24:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:01.781 02:24:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:01.781 02:24:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:01.781 02:24:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:01.781 02:24:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:01.781 02:24:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:01.781 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:01.781 02:24:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:01.781 02:24:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:01.781 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:01.781 02:24:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:01.781 02:24:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:01.782 02:24:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:01.782 02:24:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:01.782 02:24:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:01.782 02:24:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:01.782 02:24:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:01.782 02:24:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:01.782 02:24:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:01.782 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:01.782 02:24:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:01.782 02:24:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:01.782 02:24:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:01.782 02:24:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:01.782 02:24:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:01.782 02:24:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:01.782 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:01.782 02:24:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:01.782 02:24:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:01.782 02:24:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:01.782 02:24:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:01.782 02:24:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:01.782 02:24:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:01.782 02:24:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:01.782 02:24:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:01.782 02:24:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:01.782 02:24:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:01.782 02:24:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:01.782 02:24:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:01.782 02:24:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:01.782 02:24:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:01.782 02:24:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:01.782 02:24:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:01.782 02:24:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:01.782 02:24:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:01.782 02:24:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:01.782 02:24:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:01.782 02:24:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:01.782 02:24:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:01.782 02:24:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:02.040 02:24:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:02.040 02:24:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:02.040 02:24:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:02.040 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:02.040 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:13:02.040 00:13:02.040 --- 10.0.0.2 ping statistics --- 00:13:02.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.040 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:13:02.040 02:24:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:02.040 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:02.040 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:13:02.040 00:13:02.040 --- 10.0.0.1 ping statistics --- 00:13:02.040 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:02.040 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:13:02.040 02:24:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:02.040 02:24:26 -- nvmf/common.sh@410 -- # return 0 00:13:02.040 02:24:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:02.040 02:24:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:02.040 02:24:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:02.040 02:24:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:02.040 02:24:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:02.040 02:24:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:02.040 02:24:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:02.040 02:24:26 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:02.040 02:24:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:02.040 02:24:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:02.040 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:13:02.040 02:24:26 -- nvmf/common.sh@469 -- # nvmfpid=2013146 00:13:02.040 02:24:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:02.040 02:24:26 -- nvmf/common.sh@470 -- # waitforlisten 2013146 00:13:02.040 02:24:26 -- common/autotest_common.sh@829 -- # '[' -z 2013146 ']' 00:13:02.040 02:24:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:02.040 02:24:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:02.040 02:24:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:02.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:02.040 02:24:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:02.040 02:24:26 -- common/autotest_common.sh@10 -- # set +x 00:13:02.040 [2024-11-27 02:24:26.513165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:02.041 [2024-11-27 02:24:26.513246] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:02.041 EAL: No free 2048 kB hugepages reported on node 1 00:13:02.041 [2024-11-27 02:24:26.583996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:02.299 [2024-11-27 02:24:26.680269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:02.299 [2024-11-27 02:24:26.680424] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:02.299 [2024-11-27 02:24:26.680444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:02.299 [2024-11-27 02:24:26.680460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:02.299 [2024-11-27 02:24:26.680544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:02.299 [2024-11-27 02:24:26.680582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:02.299 [2024-11-27 02:24:26.680636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:02.299 [2024-11-27 02:24:26.680640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:02.864 02:24:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:02.864 02:24:27 -- common/autotest_common.sh@862 -- # return 0 00:13:02.864 02:24:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:02.864 02:24:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:02.864 02:24:27 -- common/autotest_common.sh@10 -- # set +x 00:13:02.864 02:24:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:02.864 02:24:27 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:03.122 02:24:27 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:03.122 02:24:27 -- target/multitarget.sh@21 -- # jq length 00:13:03.122 02:24:27 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:03.122 02:24:27 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:03.122 "nvmf_tgt_1" 00:13:03.122 02:24:27 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:03.379 "nvmf_tgt_2" 00:13:03.379 02:24:27 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:03.379 02:24:27 -- target/multitarget.sh@28 -- # jq length 00:13:03.379 02:24:27 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:03.379 02:24:27 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:03.636 true 00:13:03.636 02:24:28 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:03.636 true 00:13:03.636 02:24:28 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:03.636 02:24:28 -- target/multitarget.sh@35 -- # jq length 00:13:03.894 02:24:28 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:03.894 02:24:28 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:03.894 02:24:28 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:03.894 02:24:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:03.894 02:24:28 -- nvmf/common.sh@116 -- # sync 00:13:03.894 02:24:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:03.894 02:24:28 -- nvmf/common.sh@119 -- # set +e 00:13:03.894 02:24:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:03.894 02:24:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:03.894 rmmod nvme_tcp 00:13:03.894 rmmod nvme_fabrics 00:13:03.894 rmmod nvme_keyring 00:13:03.894 02:24:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:03.894 02:24:28 -- nvmf/common.sh@123 -- # set -e 00:13:03.894 02:24:28 -- nvmf/common.sh@124 -- # return 0 00:13:03.894 02:24:28 -- nvmf/common.sh@477 -- # '[' -n 2013146 ']' 00:13:03.894 02:24:28 -- nvmf/common.sh@478 -- # killprocess 2013146 00:13:03.894 02:24:28 -- common/autotest_common.sh@936 -- # '[' -z 2013146 ']' 00:13:03.894 02:24:28 -- common/autotest_common.sh@940 -- # kill -0 2013146 00:13:03.894 02:24:28 -- common/autotest_common.sh@941 -- # uname 00:13:03.894 02:24:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:03.894 02:24:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2013146 00:13:03.894 02:24:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:03.894 02:24:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:03.894 02:24:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2013146' 00:13:03.894 killing process with pid 2013146 00:13:03.894 02:24:28 -- common/autotest_common.sh@955 -- # kill 2013146 00:13:03.894 02:24:28 -- common/autotest_common.sh@960 -- # wait 2013146 00:13:04.152 02:24:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:04.152 02:24:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:04.152 02:24:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:04.152 02:24:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:04.152 02:24:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:04.152 02:24:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:04.152 02:24:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:04.152 02:24:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:06.057 02:24:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:06.057 00:13:06.057 real 0m6.461s 00:13:06.057 user 0m9.411s 00:13:06.057 sys 0m1.943s 00:13:06.057 02:24:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:06.057 02:24:30 -- common/autotest_common.sh@10 -- # set +x 00:13:06.057 ************************************ 00:13:06.057 END TEST nvmf_multitarget 00:13:06.057 ************************************ 00:13:06.057 02:24:30 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:06.057 02:24:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:06.057 02:24:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:06.057 02:24:30 -- common/autotest_common.sh@10 -- # set +x 00:13:06.057 ************************************ 00:13:06.057 START TEST nvmf_rpc 00:13:06.057 ************************************ 00:13:06.057 02:24:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:06.316 * Looking for test storage... 00:13:06.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:06.316 02:24:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:06.316 02:24:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:06.316 02:24:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:06.316 02:24:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:06.316 02:24:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:06.316 02:24:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:06.316 02:24:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:06.316 02:24:30 -- scripts/common.sh@335 -- # IFS=.-: 00:13:06.316 02:24:30 -- scripts/common.sh@335 -- # read -ra ver1 00:13:06.316 02:24:30 -- scripts/common.sh@336 -- # IFS=.-: 00:13:06.316 02:24:30 -- scripts/common.sh@336 -- # read -ra ver2 00:13:06.316 02:24:30 -- scripts/common.sh@337 -- # local 'op=<' 00:13:06.316 02:24:30 -- scripts/common.sh@339 -- # ver1_l=2 00:13:06.316 02:24:30 -- scripts/common.sh@340 -- # ver2_l=1 00:13:06.316 02:24:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:06.316 02:24:30 -- scripts/common.sh@343 -- # case "$op" in 00:13:06.316 02:24:30 -- scripts/common.sh@344 -- # : 1 00:13:06.316 02:24:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:06.316 02:24:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:06.316 02:24:30 -- scripts/common.sh@364 -- # decimal 1 00:13:06.316 02:24:30 -- scripts/common.sh@352 -- # local d=1 00:13:06.316 02:24:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:06.316 02:24:30 -- scripts/common.sh@354 -- # echo 1 00:13:06.316 02:24:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:06.316 02:24:30 -- scripts/common.sh@365 -- # decimal 2 00:13:06.316 02:24:30 -- scripts/common.sh@352 -- # local d=2 00:13:06.316 02:24:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:06.316 02:24:30 -- scripts/common.sh@354 -- # echo 2 00:13:06.316 02:24:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:06.316 02:24:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:06.316 02:24:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:06.316 02:24:30 -- scripts/common.sh@367 -- # return 0 00:13:06.316 02:24:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:06.316 02:24:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:06.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:06.316 --rc genhtml_branch_coverage=1 00:13:06.316 --rc genhtml_function_coverage=1 00:13:06.316 --rc genhtml_legend=1 00:13:06.317 --rc geninfo_all_blocks=1 00:13:06.317 --rc geninfo_unexecuted_blocks=1 00:13:06.317 00:13:06.317 ' 00:13:06.317 02:24:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:06.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:06.317 --rc genhtml_branch_coverage=1 00:13:06.317 --rc genhtml_function_coverage=1 00:13:06.317 --rc genhtml_legend=1 00:13:06.317 --rc geninfo_all_blocks=1 00:13:06.317 --rc geninfo_unexecuted_blocks=1 00:13:06.317 00:13:06.317 ' 00:13:06.317 02:24:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:06.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:06.317 --rc genhtml_branch_coverage=1 00:13:06.317 --rc genhtml_function_coverage=1 00:13:06.317 --rc genhtml_legend=1 00:13:06.317 --rc geninfo_all_blocks=1 00:13:06.317 --rc geninfo_unexecuted_blocks=1 00:13:06.317 00:13:06.317 ' 00:13:06.317 02:24:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:06.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:06.317 --rc genhtml_branch_coverage=1 00:13:06.317 --rc genhtml_function_coverage=1 00:13:06.317 --rc genhtml_legend=1 00:13:06.317 --rc geninfo_all_blocks=1 00:13:06.317 --rc geninfo_unexecuted_blocks=1 00:13:06.317 00:13:06.317 ' 00:13:06.317 02:24:30 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:06.317 02:24:30 -- nvmf/common.sh@7 -- # uname -s 00:13:06.317 02:24:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:06.317 02:24:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:06.317 02:24:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:06.317 02:24:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:06.317 02:24:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:06.317 02:24:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:06.317 02:24:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:06.317 02:24:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:06.317 02:24:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:06.317 02:24:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:06.317 02:24:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:06.317 02:24:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:06.317 02:24:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:06.317 02:24:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:06.317 02:24:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:06.317 02:24:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:06.317 02:24:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:06.317 02:24:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:06.317 02:24:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:06.317 02:24:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:06.317 02:24:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:06.317 02:24:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:06.317 02:24:30 -- paths/export.sh@5 -- # export PATH 00:13:06.317 02:24:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:06.317 02:24:30 -- nvmf/common.sh@46 -- # : 0 00:13:06.317 02:24:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:06.317 02:24:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:06.317 02:24:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:06.317 02:24:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:06.317 02:24:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:06.317 02:24:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:06.317 02:24:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:06.317 02:24:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:06.317 02:24:30 -- target/rpc.sh@11 -- # loops=5 00:13:06.317 02:24:30 -- target/rpc.sh@23 -- # nvmftestinit 00:13:06.317 02:24:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:06.317 02:24:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:06.317 02:24:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:06.317 02:24:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:06.317 02:24:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:06.317 02:24:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:06.317 02:24:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:06.317 02:24:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:06.317 02:24:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:06.317 02:24:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:06.317 02:24:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:06.317 02:24:30 -- common/autotest_common.sh@10 -- # set +x 00:13:08.850 02:24:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:08.850 02:24:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:08.850 02:24:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:08.850 02:24:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:08.850 02:24:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:08.850 02:24:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:08.850 02:24:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:08.850 02:24:32 -- nvmf/common.sh@294 -- # net_devs=() 00:13:08.850 02:24:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:08.850 02:24:32 -- nvmf/common.sh@295 -- # e810=() 00:13:08.850 02:24:32 -- nvmf/common.sh@295 -- # local -ga e810 00:13:08.850 02:24:32 -- nvmf/common.sh@296 -- # x722=() 00:13:08.850 02:24:32 -- nvmf/common.sh@296 -- # local -ga x722 00:13:08.850 02:24:32 -- nvmf/common.sh@297 -- # mlx=() 00:13:08.850 02:24:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:08.850 02:24:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:08.850 02:24:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:08.850 02:24:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:08.850 02:24:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:08.850 02:24:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:08.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:08.850 02:24:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:08.850 02:24:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:08.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:08.850 02:24:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:08.850 02:24:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:08.850 02:24:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:08.850 02:24:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:08.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:08.850 02:24:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:08.850 02:24:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:08.850 02:24:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:08.850 02:24:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:08.850 02:24:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:08.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:08.850 02:24:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:08.850 02:24:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:08.850 02:24:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:08.850 02:24:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:08.850 02:24:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:08.850 02:24:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:08.850 02:24:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:08.850 02:24:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:08.850 02:24:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:08.850 02:24:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:08.850 02:24:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:08.850 02:24:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:08.850 02:24:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:08.850 02:24:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:08.850 02:24:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:08.850 02:24:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:08.850 02:24:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:08.850 02:24:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:08.850 02:24:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:08.850 02:24:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:08.850 02:24:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:08.850 02:24:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:08.850 02:24:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:08.850 02:24:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:08.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:08.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:13:08.850 00:13:08.850 --- 10.0.0.2 ping statistics --- 00:13:08.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:08.850 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:13:08.850 02:24:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:08.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:08.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:13:08.850 00:13:08.850 --- 10.0.0.1 ping statistics --- 00:13:08.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:08.850 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:13:08.850 02:24:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:08.850 02:24:33 -- nvmf/common.sh@410 -- # return 0 00:13:08.850 02:24:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:08.850 02:24:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:08.850 02:24:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:08.850 02:24:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:08.850 02:24:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:08.850 02:24:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:08.850 02:24:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:08.850 02:24:33 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:08.850 02:24:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:08.850 02:24:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:08.850 02:24:33 -- common/autotest_common.sh@10 -- # set +x 00:13:08.850 02:24:33 -- nvmf/common.sh@469 -- # nvmfpid=2015402 00:13:08.850 02:24:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:08.850 02:24:33 -- nvmf/common.sh@470 -- # waitforlisten 2015402 00:13:08.850 02:24:33 -- common/autotest_common.sh@829 -- # '[' -z 2015402 ']' 00:13:08.850 02:24:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:08.850 02:24:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:08.850 02:24:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:08.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:08.850 02:24:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:08.850 02:24:33 -- common/autotest_common.sh@10 -- # set +x 00:13:08.851 [2024-11-27 02:24:33.187761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:08.851 [2024-11-27 02:24:33.187857] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:08.851 EAL: No free 2048 kB hugepages reported on node 1 00:13:08.851 [2024-11-27 02:24:33.255974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:08.851 [2024-11-27 02:24:33.349969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:08.851 [2024-11-27 02:24:33.350120] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:08.851 [2024-11-27 02:24:33.350139] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:08.851 [2024-11-27 02:24:33.350153] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:08.851 [2024-11-27 02:24:33.350243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:08.851 [2024-11-27 02:24:33.350303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:08.851 [2024-11-27 02:24:33.350361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:08.851 [2024-11-27 02:24:33.350364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:09.783 02:24:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:09.783 02:24:34 -- common/autotest_common.sh@862 -- # return 0 00:13:09.783 02:24:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:09.783 02:24:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:09.783 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:09.783 02:24:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:09.783 02:24:34 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:09.783 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.783 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:09.783 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.783 02:24:34 -- target/rpc.sh@26 -- # stats='{ 00:13:09.783 "tick_rate": 2700000000, 00:13:09.783 "poll_groups": [ 00:13:09.783 { 00:13:09.783 "name": "nvmf_tgt_poll_group_0", 00:13:09.783 "admin_qpairs": 0, 00:13:09.783 "io_qpairs": 0, 00:13:09.783 "current_admin_qpairs": 0, 00:13:09.783 "current_io_qpairs": 0, 00:13:09.783 "pending_bdev_io": 0, 00:13:09.783 "completed_nvme_io": 0, 00:13:09.783 "transports": [] 00:13:09.783 }, 00:13:09.783 { 00:13:09.783 "name": "nvmf_tgt_poll_group_1", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [] 00:13:09.784 }, 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_2", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [] 00:13:09.784 }, 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_3", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [] 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 }' 00:13:09.784 02:24:34 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:09.784 02:24:34 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:09.784 02:24:34 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:09.784 02:24:34 -- target/rpc.sh@15 -- # wc -l 00:13:09.784 02:24:34 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:09.784 02:24:34 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:09.784 02:24:34 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:09.784 02:24:34 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:09.784 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.784 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:09.784 [2024-11-27 02:24:34.322634] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:09.784 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.784 02:24:34 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:09.784 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.784 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:09.784 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:09.784 02:24:34 -- target/rpc.sh@33 -- # stats='{ 00:13:09.784 "tick_rate": 2700000000, 00:13:09.784 "poll_groups": [ 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_0", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [ 00:13:09.784 { 00:13:09.784 "trtype": "TCP" 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 }, 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_1", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [ 00:13:09.784 { 00:13:09.784 "trtype": "TCP" 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 }, 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_2", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [ 00:13:09.784 { 00:13:09.784 "trtype": "TCP" 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 }, 00:13:09.784 { 00:13:09.784 "name": "nvmf_tgt_poll_group_3", 00:13:09.784 "admin_qpairs": 0, 00:13:09.784 "io_qpairs": 0, 00:13:09.784 "current_admin_qpairs": 0, 00:13:09.784 "current_io_qpairs": 0, 00:13:09.784 "pending_bdev_io": 0, 00:13:09.784 "completed_nvme_io": 0, 00:13:09.784 "transports": [ 00:13:09.784 { 00:13:09.784 "trtype": "TCP" 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 } 00:13:09.784 ] 00:13:09.784 }' 00:13:09.784 02:24:34 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:09.784 02:24:34 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:09.784 02:24:34 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:09.784 02:24:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:09.784 02:24:34 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:09.784 02:24:34 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:09.784 02:24:34 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:09.784 02:24:34 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:09.784 02:24:34 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:09.784 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:09.784 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 Malloc1 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:10.043 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.043 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:10.043 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.043 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:10.043 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.043 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:10.043 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.043 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 [2024-11-27 02:24:34.462956] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:10.043 02:24:34 -- common/autotest_common.sh@650 -- # local es=0 00:13:10.043 02:24:34 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:10.043 02:24:34 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:10.043 02:24:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:10.043 02:24:34 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:10.043 02:24:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:10.043 02:24:34 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:10.043 02:24:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:10.043 02:24:34 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:10.043 02:24:34 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:10.043 02:24:34 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:10.043 [2024-11-27 02:24:34.485422] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:10.043 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:10.043 could not add new controller: failed to write to nvme-fabrics device 00:13:10.043 02:24:34 -- common/autotest_common.sh@653 -- # es=1 00:13:10.043 02:24:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:10.043 02:24:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:10.043 02:24:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:10.043 02:24:34 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:10.043 02:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.043 02:24:34 -- common/autotest_common.sh@10 -- # set +x 00:13:10.043 02:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.043 02:24:34 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:10.608 02:24:35 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:10.608 02:24:35 -- common/autotest_common.sh@1187 -- # local i=0 00:13:10.608 02:24:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:10.608 02:24:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:10.608 02:24:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:12.505 02:24:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:12.505 02:24:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:12.505 02:24:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:12.762 02:24:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:12.762 02:24:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:12.762 02:24:37 -- common/autotest_common.sh@1197 -- # return 0 00:13:12.762 02:24:37 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:12.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:12.762 02:24:37 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:12.762 02:24:37 -- common/autotest_common.sh@1208 -- # local i=0 00:13:12.762 02:24:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:12.762 02:24:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:12.762 02:24:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:12.762 02:24:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:12.762 02:24:37 -- common/autotest_common.sh@1220 -- # return 0 00:13:12.762 02:24:37 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:12.762 02:24:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.762 02:24:37 -- common/autotest_common.sh@10 -- # set +x 00:13:12.762 02:24:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.762 02:24:37 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.762 02:24:37 -- common/autotest_common.sh@650 -- # local es=0 00:13:12.762 02:24:37 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.762 02:24:37 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:12.763 02:24:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.763 02:24:37 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:12.763 02:24:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.763 02:24:37 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:12.763 02:24:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:12.763 02:24:37 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:12.763 02:24:37 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:12.763 02:24:37 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.763 [2024-11-27 02:24:37.288269] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:12.763 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:12.763 could not add new controller: failed to write to nvme-fabrics device 00:13:12.763 02:24:37 -- common/autotest_common.sh@653 -- # es=1 00:13:12.763 02:24:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:12.763 02:24:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:12.763 02:24:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:12.763 02:24:37 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:12.763 02:24:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.763 02:24:37 -- common/autotest_common.sh@10 -- # set +x 00:13:12.763 02:24:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.763 02:24:37 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:13.327 02:24:37 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:13.327 02:24:37 -- common/autotest_common.sh@1187 -- # local i=0 00:13:13.327 02:24:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:13.327 02:24:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:13.328 02:24:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:15.853 02:24:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:15.853 02:24:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:15.853 02:24:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:15.853 02:24:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:15.853 02:24:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:15.853 02:24:39 -- common/autotest_common.sh@1197 -- # return 0 00:13:15.853 02:24:39 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:15.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:15.853 02:24:40 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:15.853 02:24:40 -- common/autotest_common.sh@1208 -- # local i=0 00:13:15.853 02:24:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:15.853 02:24:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:15.853 02:24:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:15.853 02:24:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:15.853 02:24:40 -- common/autotest_common.sh@1220 -- # return 0 00:13:15.853 02:24:40 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:15.853 02:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.853 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:15.853 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.853 02:24:40 -- target/rpc.sh@81 -- # seq 1 5 00:13:15.853 02:24:40 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:15.853 02:24:40 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:15.853 02:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.853 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:15.853 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.853 02:24:40 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:15.853 02:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.853 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:15.853 [2024-11-27 02:24:40.071772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:15.853 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.853 02:24:40 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:15.853 02:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.853 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:15.853 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.853 02:24:40 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:15.853 02:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.853 02:24:40 -- common/autotest_common.sh@10 -- # set +x 00:13:15.853 02:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.853 02:24:40 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.111 02:24:40 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:16.111 02:24:40 -- common/autotest_common.sh@1187 -- # local i=0 00:13:16.111 02:24:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:16.111 02:24:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:16.111 02:24:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:18.634 02:24:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:18.634 02:24:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:18.634 02:24:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:18.634 02:24:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:18.634 02:24:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:18.634 02:24:42 -- common/autotest_common.sh@1197 -- # return 0 00:13:18.634 02:24:42 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:18.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:18.634 02:24:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:18.634 02:24:42 -- common/autotest_common.sh@1208 -- # local i=0 00:13:18.634 02:24:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:18.634 02:24:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.634 02:24:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:18.634 02:24:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.634 02:24:42 -- common/autotest_common.sh@1220 -- # return 0 00:13:18.634 02:24:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:18.634 02:24:42 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 [2024-11-27 02:24:42.851923] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:18.634 02:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.634 02:24:42 -- common/autotest_common.sh@10 -- # set +x 00:13:18.634 02:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.634 02:24:42 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:19.199 02:24:43 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:19.199 02:24:43 -- common/autotest_common.sh@1187 -- # local i=0 00:13:19.199 02:24:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:19.199 02:24:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:19.199 02:24:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:21.092 02:24:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:21.092 02:24:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:21.092 02:24:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:21.092 02:24:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:21.092 02:24:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:21.092 02:24:45 -- common/autotest_common.sh@1197 -- # return 0 00:13:21.092 02:24:45 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:21.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.092 02:24:45 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:21.092 02:24:45 -- common/autotest_common.sh@1208 -- # local i=0 00:13:21.092 02:24:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:21.092 02:24:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.092 02:24:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:21.092 02:24:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:21.092 02:24:45 -- common/autotest_common.sh@1220 -- # return 0 00:13:21.092 02:24:45 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:21.092 02:24:45 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 [2024-11-27 02:24:45.675276] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:21.092 02:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.092 02:24:45 -- common/autotest_common.sh@10 -- # set +x 00:13:21.092 02:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.092 02:24:45 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:22.020 02:24:46 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:22.021 02:24:46 -- common/autotest_common.sh@1187 -- # local i=0 00:13:22.021 02:24:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:22.021 02:24:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:22.021 02:24:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:23.917 02:24:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:23.918 02:24:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:23.918 02:24:48 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.918 02:24:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:23.918 02:24:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.918 02:24:48 -- common/autotest_common.sh@1197 -- # return 0 00:13:23.918 02:24:48 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.918 02:24:48 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.918 02:24:48 -- common/autotest_common.sh@1208 -- # local i=0 00:13:23.918 02:24:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:23.918 02:24:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.918 02:24:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:23.918 02:24:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.918 02:24:48 -- common/autotest_common.sh@1220 -- # return 0 00:13:23.918 02:24:48 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:23.918 02:24:48 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 [2024-11-27 02:24:48.498565] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.918 02:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.918 02:24:48 -- common/autotest_common.sh@10 -- # set +x 00:13:23.918 02:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.918 02:24:48 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.850 02:24:49 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:24.850 02:24:49 -- common/autotest_common.sh@1187 -- # local i=0 00:13:24.850 02:24:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:24.850 02:24:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:24.850 02:24:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:26.749 02:24:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:26.749 02:24:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:26.749 02:24:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:26.749 02:24:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:26.749 02:24:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:26.749 02:24:51 -- common/autotest_common.sh@1197 -- # return 0 00:13:26.749 02:24:51 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:26.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.749 02:24:51 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:26.749 02:24:51 -- common/autotest_common.sh@1208 -- # local i=0 00:13:26.749 02:24:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:26.749 02:24:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.749 02:24:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:26.749 02:24:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.749 02:24:51 -- common/autotest_common.sh@1220 -- # return 0 00:13:26.749 02:24:51 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.749 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.749 02:24:51 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.749 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.749 02:24:51 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:26.749 02:24:51 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.749 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.749 02:24:51 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.749 [2024-11-27 02:24:51.363739] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.749 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.749 02:24:51 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:26.749 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.749 02:24:51 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:26.749 02:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.749 02:24:51 -- common/autotest_common.sh@10 -- # set +x 00:13:27.006 02:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.006 02:24:51 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.571 02:24:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:27.571 02:24:52 -- common/autotest_common.sh@1187 -- # local i=0 00:13:27.571 02:24:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:27.571 02:24:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:27.571 02:24:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:29.470 02:24:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:29.470 02:24:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:29.470 02:24:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:29.470 02:24:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:29.470 02:24:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:29.470 02:24:54 -- common/autotest_common.sh@1197 -- # return 0 00:13:29.470 02:24:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:29.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:29.729 02:24:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:29.729 02:24:54 -- common/autotest_common.sh@1208 -- # local i=0 00:13:29.729 02:24:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:29.729 02:24:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.729 02:24:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:29.729 02:24:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:29.729 02:24:54 -- common/autotest_common.sh@1220 -- # return 0 00:13:29.729 02:24:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@99 -- # seq 1 5 00:13:29.729 02:24:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:29.729 02:24:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 [2024-11-27 02:24:54.219097] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:29.729 02:24:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 [2024-11-27 02:24:54.267153] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.729 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 02:24:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:29.730 02:24:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 [2024-11-27 02:24:54.315306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:29.730 02:24:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.730 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.730 02:24:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.730 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.730 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 [2024-11-27 02:24:54.363483] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:29.988 02:24:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 [2024-11-27 02:24:54.415678] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:29.988 02:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.988 02:24:54 -- common/autotest_common.sh@10 -- # set +x 00:13:29.988 02:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.988 02:24:54 -- target/rpc.sh@110 -- # stats='{ 00:13:29.988 "tick_rate": 2700000000, 00:13:29.988 "poll_groups": [ 00:13:29.988 { 00:13:29.988 "name": "nvmf_tgt_poll_group_0", 00:13:29.988 "admin_qpairs": 2, 00:13:29.988 "io_qpairs": 84, 00:13:29.988 "current_admin_qpairs": 0, 00:13:29.988 "current_io_qpairs": 0, 00:13:29.988 "pending_bdev_io": 0, 00:13:29.988 "completed_nvme_io": 150, 00:13:29.988 "transports": [ 00:13:29.988 { 00:13:29.988 "trtype": "TCP" 00:13:29.988 } 00:13:29.988 ] 00:13:29.988 }, 00:13:29.988 { 00:13:29.988 "name": "nvmf_tgt_poll_group_1", 00:13:29.988 "admin_qpairs": 2, 00:13:29.988 "io_qpairs": 84, 00:13:29.988 "current_admin_qpairs": 0, 00:13:29.988 "current_io_qpairs": 0, 00:13:29.988 "pending_bdev_io": 0, 00:13:29.988 "completed_nvme_io": 153, 00:13:29.988 "transports": [ 00:13:29.988 { 00:13:29.988 "trtype": "TCP" 00:13:29.988 } 00:13:29.988 ] 00:13:29.988 }, 00:13:29.988 { 00:13:29.988 "name": "nvmf_tgt_poll_group_2", 00:13:29.988 "admin_qpairs": 1, 00:13:29.988 "io_qpairs": 84, 00:13:29.988 "current_admin_qpairs": 0, 00:13:29.988 "current_io_qpairs": 0, 00:13:29.988 "pending_bdev_io": 0, 00:13:29.988 "completed_nvme_io": 200, 00:13:29.988 "transports": [ 00:13:29.988 { 00:13:29.988 "trtype": "TCP" 00:13:29.988 } 00:13:29.988 ] 00:13:29.988 }, 00:13:29.988 { 00:13:29.988 "name": "nvmf_tgt_poll_group_3", 00:13:29.988 "admin_qpairs": 2, 00:13:29.988 "io_qpairs": 84, 00:13:29.989 "current_admin_qpairs": 0, 00:13:29.989 "current_io_qpairs": 0, 00:13:29.989 "pending_bdev_io": 0, 00:13:29.989 "completed_nvme_io": 183, 00:13:29.989 "transports": [ 00:13:29.989 { 00:13:29.989 "trtype": "TCP" 00:13:29.989 } 00:13:29.989 ] 00:13:29.989 } 00:13:29.989 ] 00:13:29.989 }' 00:13:29.989 02:24:54 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:29.989 02:24:54 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:29.989 02:24:54 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:29.989 02:24:54 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:29.989 02:24:54 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:29.989 02:24:54 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:29.989 02:24:54 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:29.989 02:24:54 -- target/rpc.sh@123 -- # nvmftestfini 00:13:29.989 02:24:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:29.989 02:24:54 -- nvmf/common.sh@116 -- # sync 00:13:29.989 02:24:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:29.989 02:24:54 -- nvmf/common.sh@119 -- # set +e 00:13:29.989 02:24:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:29.989 02:24:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:29.989 rmmod nvme_tcp 00:13:29.989 rmmod nvme_fabrics 00:13:29.989 rmmod nvme_keyring 00:13:30.260 02:24:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:30.260 02:24:54 -- nvmf/common.sh@123 -- # set -e 00:13:30.260 02:24:54 -- nvmf/common.sh@124 -- # return 0 00:13:30.260 02:24:54 -- nvmf/common.sh@477 -- # '[' -n 2015402 ']' 00:13:30.260 02:24:54 -- nvmf/common.sh@478 -- # killprocess 2015402 00:13:30.260 02:24:54 -- common/autotest_common.sh@936 -- # '[' -z 2015402 ']' 00:13:30.260 02:24:54 -- common/autotest_common.sh@940 -- # kill -0 2015402 00:13:30.260 02:24:54 -- common/autotest_common.sh@941 -- # uname 00:13:30.260 02:24:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:30.260 02:24:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2015402 00:13:30.260 02:24:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:30.260 02:24:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:30.260 02:24:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2015402' 00:13:30.260 killing process with pid 2015402 00:13:30.260 02:24:54 -- common/autotest_common.sh@955 -- # kill 2015402 00:13:30.260 02:24:54 -- common/autotest_common.sh@960 -- # wait 2015402 00:13:30.524 02:24:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:30.524 02:24:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:30.524 02:24:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:30.524 02:24:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:30.524 02:24:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:30.524 02:24:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.524 02:24:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.524 02:24:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.429 02:24:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.429 00:13:32.429 real 0m26.279s 00:13:32.429 user 1m25.760s 00:13:32.429 sys 0m4.374s 00:13:32.429 02:24:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:32.429 02:24:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.429 ************************************ 00:13:32.429 END TEST nvmf_rpc 00:13:32.429 ************************************ 00:13:32.429 02:24:56 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:32.429 02:24:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:32.429 02:24:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:32.429 02:24:56 -- common/autotest_common.sh@10 -- # set +x 00:13:32.429 ************************************ 00:13:32.429 START TEST nvmf_invalid 00:13:32.429 ************************************ 00:13:32.429 02:24:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:32.429 * Looking for test storage... 00:13:32.429 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.429 02:24:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:32.429 02:24:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:32.429 02:24:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:32.688 02:24:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:32.688 02:24:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:32.688 02:24:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:32.688 02:24:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:32.688 02:24:57 -- scripts/common.sh@335 -- # IFS=.-: 00:13:32.688 02:24:57 -- scripts/common.sh@335 -- # read -ra ver1 00:13:32.688 02:24:57 -- scripts/common.sh@336 -- # IFS=.-: 00:13:32.688 02:24:57 -- scripts/common.sh@336 -- # read -ra ver2 00:13:32.688 02:24:57 -- scripts/common.sh@337 -- # local 'op=<' 00:13:32.688 02:24:57 -- scripts/common.sh@339 -- # ver1_l=2 00:13:32.688 02:24:57 -- scripts/common.sh@340 -- # ver2_l=1 00:13:32.688 02:24:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:32.688 02:24:57 -- scripts/common.sh@343 -- # case "$op" in 00:13:32.688 02:24:57 -- scripts/common.sh@344 -- # : 1 00:13:32.688 02:24:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:32.688 02:24:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:32.688 02:24:57 -- scripts/common.sh@364 -- # decimal 1 00:13:32.688 02:24:57 -- scripts/common.sh@352 -- # local d=1 00:13:32.688 02:24:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:32.688 02:24:57 -- scripts/common.sh@354 -- # echo 1 00:13:32.688 02:24:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:32.688 02:24:57 -- scripts/common.sh@365 -- # decimal 2 00:13:32.688 02:24:57 -- scripts/common.sh@352 -- # local d=2 00:13:32.688 02:24:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:32.688 02:24:57 -- scripts/common.sh@354 -- # echo 2 00:13:32.688 02:24:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:32.688 02:24:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:32.688 02:24:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:32.688 02:24:57 -- scripts/common.sh@367 -- # return 0 00:13:32.688 02:24:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:32.688 02:24:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:32.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.688 --rc genhtml_branch_coverage=1 00:13:32.688 --rc genhtml_function_coverage=1 00:13:32.688 --rc genhtml_legend=1 00:13:32.688 --rc geninfo_all_blocks=1 00:13:32.688 --rc geninfo_unexecuted_blocks=1 00:13:32.688 00:13:32.688 ' 00:13:32.688 02:24:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:32.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.688 --rc genhtml_branch_coverage=1 00:13:32.688 --rc genhtml_function_coverage=1 00:13:32.688 --rc genhtml_legend=1 00:13:32.688 --rc geninfo_all_blocks=1 00:13:32.688 --rc geninfo_unexecuted_blocks=1 00:13:32.688 00:13:32.688 ' 00:13:32.688 02:24:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:32.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.688 --rc genhtml_branch_coverage=1 00:13:32.688 --rc genhtml_function_coverage=1 00:13:32.688 --rc genhtml_legend=1 00:13:32.688 --rc geninfo_all_blocks=1 00:13:32.688 --rc geninfo_unexecuted_blocks=1 00:13:32.688 00:13:32.688 ' 00:13:32.688 02:24:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:32.688 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.688 --rc genhtml_branch_coverage=1 00:13:32.688 --rc genhtml_function_coverage=1 00:13:32.688 --rc genhtml_legend=1 00:13:32.688 --rc geninfo_all_blocks=1 00:13:32.688 --rc geninfo_unexecuted_blocks=1 00:13:32.688 00:13:32.688 ' 00:13:32.688 02:24:57 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.688 02:24:57 -- nvmf/common.sh@7 -- # uname -s 00:13:32.688 02:24:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.688 02:24:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.688 02:24:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.688 02:24:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.688 02:24:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.688 02:24:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.688 02:24:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.688 02:24:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.688 02:24:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.688 02:24:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.688 02:24:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.688 02:24:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.688 02:24:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.688 02:24:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.688 02:24:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.688 02:24:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.688 02:24:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.688 02:24:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.688 02:24:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.688 02:24:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.688 02:24:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.688 02:24:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.688 02:24:57 -- paths/export.sh@5 -- # export PATH 00:13:32.688 02:24:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.688 02:24:57 -- nvmf/common.sh@46 -- # : 0 00:13:32.688 02:24:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.688 02:24:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.688 02:24:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.688 02:24:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.688 02:24:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.688 02:24:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.688 02:24:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.688 02:24:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.688 02:24:57 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:32.688 02:24:57 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:32.688 02:24:57 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:32.688 02:24:57 -- target/invalid.sh@14 -- # target=foobar 00:13:32.688 02:24:57 -- target/invalid.sh@16 -- # RANDOM=0 00:13:32.688 02:24:57 -- target/invalid.sh@34 -- # nvmftestinit 00:13:32.688 02:24:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.688 02:24:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.688 02:24:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.688 02:24:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.688 02:24:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.688 02:24:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.688 02:24:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.688 02:24:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.688 02:24:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.689 02:24:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.689 02:24:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.689 02:24:57 -- common/autotest_common.sh@10 -- # set +x 00:13:35.234 02:24:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:35.234 02:24:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:35.234 02:24:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:35.234 02:24:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:35.234 02:24:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:35.234 02:24:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:35.234 02:24:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:35.234 02:24:59 -- nvmf/common.sh@294 -- # net_devs=() 00:13:35.234 02:24:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:35.234 02:24:59 -- nvmf/common.sh@295 -- # e810=() 00:13:35.234 02:24:59 -- nvmf/common.sh@295 -- # local -ga e810 00:13:35.234 02:24:59 -- nvmf/common.sh@296 -- # x722=() 00:13:35.234 02:24:59 -- nvmf/common.sh@296 -- # local -ga x722 00:13:35.234 02:24:59 -- nvmf/common.sh@297 -- # mlx=() 00:13:35.234 02:24:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:35.234 02:24:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:35.234 02:24:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:35.235 02:24:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:35.235 02:24:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:35.235 02:24:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:35.235 02:24:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.235 02:24:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:35.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:35.235 02:24:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.235 02:24:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:35.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:35.235 02:24:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.235 02:24:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.235 02:24:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.235 02:24:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:35.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:35.235 02:24:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.235 02:24:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.235 02:24:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.235 02:24:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:35.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:35.235 02:24:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:35.235 02:24:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:35.235 02:24:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:35.235 02:24:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:35.235 02:24:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:35.235 02:24:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:35.235 02:24:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:35.235 02:24:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:35.235 02:24:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:35.235 02:24:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:35.235 02:24:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:35.235 02:24:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:35.235 02:24:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:35.235 02:24:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:35.235 02:24:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:35.235 02:24:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:35.235 02:24:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:35.235 02:24:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:35.235 02:24:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:35.235 02:24:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:35.235 02:24:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:35.235 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:35.235 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.371 ms 00:13:35.235 00:13:35.235 --- 10.0.0.2 ping statistics --- 00:13:35.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.235 rtt min/avg/max/mdev = 0.371/0.371/0.371/0.000 ms 00:13:35.235 02:24:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:35.235 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:35.235 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:13:35.235 00:13:35.235 --- 10.0.0.1 ping statistics --- 00:13:35.235 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.235 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:13:35.235 02:24:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:35.235 02:24:59 -- nvmf/common.sh@410 -- # return 0 00:13:35.235 02:24:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:35.235 02:24:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:35.235 02:24:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:35.235 02:24:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:35.235 02:24:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:35.235 02:24:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:35.235 02:24:59 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:35.235 02:24:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:35.235 02:24:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:35.235 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:13:35.235 02:24:59 -- nvmf/common.sh@469 -- # nvmfpid=2020113 00:13:35.235 02:24:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:35.235 02:24:59 -- nvmf/common.sh@470 -- # waitforlisten 2020113 00:13:35.235 02:24:59 -- common/autotest_common.sh@829 -- # '[' -z 2020113 ']' 00:13:35.235 02:24:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:35.235 02:24:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:35.235 02:24:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:35.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:35.235 02:24:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:35.235 02:24:59 -- common/autotest_common.sh@10 -- # set +x 00:13:35.235 [2024-11-27 02:24:59.485955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:35.235 [2024-11-27 02:24:59.486048] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:35.235 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.235 [2024-11-27 02:24:59.554264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:35.235 [2024-11-27 02:24:59.641640] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:35.235 [2024-11-27 02:24:59.641838] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:35.235 [2024-11-27 02:24:59.641865] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:35.236 [2024-11-27 02:24:59.641879] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:35.236 [2024-11-27 02:24:59.641941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:35.236 [2024-11-27 02:24:59.641991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:35.236 [2024-11-27 02:24:59.642042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:35.236 [2024-11-27 02:24:59.642045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:36.168 02:25:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:36.168 02:25:00 -- common/autotest_common.sh@862 -- # return 0 00:13:36.168 02:25:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:36.168 02:25:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:36.168 02:25:00 -- common/autotest_common.sh@10 -- # set +x 00:13:36.168 02:25:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:36.168 02:25:00 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:36.168 02:25:00 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode1058 00:13:36.168 [2024-11-27 02:25:00.736049] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:36.168 02:25:00 -- target/invalid.sh@40 -- # out='request: 00:13:36.168 { 00:13:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1058", 00:13:36.168 "tgt_name": "foobar", 00:13:36.168 "method": "nvmf_create_subsystem", 00:13:36.168 "req_id": 1 00:13:36.168 } 00:13:36.168 Got JSON-RPC error response 00:13:36.168 response: 00:13:36.168 { 00:13:36.168 "code": -32603, 00:13:36.168 "message": "Unable to find target foobar" 00:13:36.168 }' 00:13:36.168 02:25:00 -- target/invalid.sh@41 -- # [[ request: 00:13:36.168 { 00:13:36.168 "nqn": "nqn.2016-06.io.spdk:cnode1058", 00:13:36.168 "tgt_name": "foobar", 00:13:36.168 "method": "nvmf_create_subsystem", 00:13:36.168 "req_id": 1 00:13:36.168 } 00:13:36.168 Got JSON-RPC error response 00:13:36.168 response: 00:13:36.168 { 00:13:36.168 "code": -32603, 00:13:36.168 "message": "Unable to find target foobar" 00:13:36.168 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:36.168 02:25:00 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:36.168 02:25:00 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode26080 00:13:36.426 [2024-11-27 02:25:00.984948] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26080: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:36.426 02:25:01 -- target/invalid.sh@45 -- # out='request: 00:13:36.426 { 00:13:36.426 "nqn": "nqn.2016-06.io.spdk:cnode26080", 00:13:36.426 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:36.426 "method": "nvmf_create_subsystem", 00:13:36.426 "req_id": 1 00:13:36.426 } 00:13:36.426 Got JSON-RPC error response 00:13:36.426 response: 00:13:36.426 { 00:13:36.426 "code": -32602, 00:13:36.426 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:36.426 }' 00:13:36.426 02:25:01 -- target/invalid.sh@46 -- # [[ request: 00:13:36.426 { 00:13:36.426 "nqn": "nqn.2016-06.io.spdk:cnode26080", 00:13:36.426 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:36.426 "method": "nvmf_create_subsystem", 00:13:36.426 "req_id": 1 00:13:36.426 } 00:13:36.426 Got JSON-RPC error response 00:13:36.426 response: 00:13:36.426 { 00:13:36.426 "code": -32602, 00:13:36.426 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:36.426 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:36.426 02:25:01 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:36.426 02:25:01 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode26552 00:13:36.683 [2024-11-27 02:25:01.237735] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26552: invalid model number 'SPDK_Controller' 00:13:36.683 02:25:01 -- target/invalid.sh@50 -- # out='request: 00:13:36.683 { 00:13:36.683 "nqn": "nqn.2016-06.io.spdk:cnode26552", 00:13:36.683 "model_number": "SPDK_Controller\u001f", 00:13:36.683 "method": "nvmf_create_subsystem", 00:13:36.683 "req_id": 1 00:13:36.683 } 00:13:36.683 Got JSON-RPC error response 00:13:36.683 response: 00:13:36.683 { 00:13:36.683 "code": -32602, 00:13:36.683 "message": "Invalid MN SPDK_Controller\u001f" 00:13:36.683 }' 00:13:36.683 02:25:01 -- target/invalid.sh@51 -- # [[ request: 00:13:36.683 { 00:13:36.683 "nqn": "nqn.2016-06.io.spdk:cnode26552", 00:13:36.683 "model_number": "SPDK_Controller\u001f", 00:13:36.683 "method": "nvmf_create_subsystem", 00:13:36.683 "req_id": 1 00:13:36.683 } 00:13:36.683 Got JSON-RPC error response 00:13:36.683 response: 00:13:36.683 { 00:13:36.683 "code": -32602, 00:13:36.683 "message": "Invalid MN SPDK_Controller\u001f" 00:13:36.683 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:36.683 02:25:01 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:36.683 02:25:01 -- target/invalid.sh@19 -- # local length=21 ll 00:13:36.683 02:25:01 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:36.683 02:25:01 -- target/invalid.sh@21 -- # local chars 00:13:36.683 02:25:01 -- target/invalid.sh@22 -- # local string 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 76 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+=L 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 121 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+=y 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 94 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+='^' 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 104 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+=h 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 50 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+=2 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # printf %x 89 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:36.683 02:25:01 -- target/invalid.sh@25 -- # string+=Y 00:13:36.683 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 63 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+='?' 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 81 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=Q 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 79 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=O 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 88 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=X 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 113 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=q 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 75 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=K 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 82 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=R 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 117 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=u 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # printf %x 49 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:36.684 02:25:01 -- target/invalid.sh@25 -- # string+=1 00:13:36.684 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # printf %x 100 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # string+=d 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # printf %x 125 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # string+='}' 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # printf %x 71 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # string+=G 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.941 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # printf %x 39 00:13:36.941 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # string+=\' 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # printf %x 86 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # string+=V 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # printf %x 98 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:36.942 02:25:01 -- target/invalid.sh@25 -- # string+=b 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:36.942 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:36.942 02:25:01 -- target/invalid.sh@28 -- # [[ L == \- ]] 00:13:36.942 02:25:01 -- target/invalid.sh@31 -- # echo 'Ly^h2Y?QOXqKRu1d}G'\''Vb' 00:13:36.942 02:25:01 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'Ly^h2Y?QOXqKRu1d}G'\''Vb' nqn.2016-06.io.spdk:cnode15460 00:13:36.942 [2024-11-27 02:25:01.566846] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15460: invalid serial number 'Ly^h2Y?QOXqKRu1d}G'Vb' 00:13:37.201 02:25:01 -- target/invalid.sh@54 -- # out='request: 00:13:37.201 { 00:13:37.201 "nqn": "nqn.2016-06.io.spdk:cnode15460", 00:13:37.201 "serial_number": "Ly^h2Y?QOXqKRu1d}G'\''Vb", 00:13:37.201 "method": "nvmf_create_subsystem", 00:13:37.201 "req_id": 1 00:13:37.201 } 00:13:37.201 Got JSON-RPC error response 00:13:37.201 response: 00:13:37.201 { 00:13:37.201 "code": -32602, 00:13:37.201 "message": "Invalid SN Ly^h2Y?QOXqKRu1d}G'\''Vb" 00:13:37.201 }' 00:13:37.201 02:25:01 -- target/invalid.sh@55 -- # [[ request: 00:13:37.201 { 00:13:37.201 "nqn": "nqn.2016-06.io.spdk:cnode15460", 00:13:37.201 "serial_number": "Ly^h2Y?QOXqKRu1d}G'Vb", 00:13:37.201 "method": "nvmf_create_subsystem", 00:13:37.201 "req_id": 1 00:13:37.201 } 00:13:37.201 Got JSON-RPC error response 00:13:37.201 response: 00:13:37.201 { 00:13:37.201 "code": -32602, 00:13:37.201 "message": "Invalid SN Ly^h2Y?QOXqKRu1d}G'Vb" 00:13:37.201 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:37.201 02:25:01 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:37.201 02:25:01 -- target/invalid.sh@19 -- # local length=41 ll 00:13:37.201 02:25:01 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:37.201 02:25:01 -- target/invalid.sh@21 -- # local chars 00:13:37.201 02:25:01 -- target/invalid.sh@22 -- # local string 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # printf %x 40 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # string+='(' 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # printf %x 92 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # string+='\' 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.201 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.201 02:25:01 -- target/invalid.sh@25 -- # printf %x 102 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=f 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 95 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=_ 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 86 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x56' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=V 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 80 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=P 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 60 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+='<' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 85 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=U 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 120 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=x 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 82 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=R 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 80 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=P 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 96 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+='`' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 127 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 51 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x33' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=3 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 121 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=y 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 33 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+='!' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 48 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=0 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 102 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=f 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 106 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=j 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 59 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=';' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 47 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=/ 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 32 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=' ' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 116 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=t 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 58 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=: 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 102 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=f 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 57 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=9 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 85 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=U 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 116 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=t 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 79 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=O 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 95 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=_ 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 84 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=T 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 40 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+='(' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 93 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=']' 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 61 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+== 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 97 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=a 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 54 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # string+=6 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.202 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.202 02:25:01 -- target/invalid.sh@25 -- # printf %x 124 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # string+='|' 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # printf %x 83 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # string+=S 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # printf %x 122 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # string+=z 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # printf %x 119 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # string+=w 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # printf %x 44 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:37.203 02:25:01 -- target/invalid.sh@25 -- # string+=, 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.203 02:25:01 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.203 02:25:01 -- target/invalid.sh@28 -- # [[ ( == \- ]] 00:13:37.203 02:25:01 -- target/invalid.sh@31 -- # echo '(\f_VP /dev/null' 00:13:40.041 02:25:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:41.948 02:25:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:41.948 00:13:41.948 real 0m9.480s 00:13:41.948 user 0m23.113s 00:13:41.948 sys 0m2.467s 00:13:41.948 02:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:41.948 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:41.948 ************************************ 00:13:41.948 END TEST nvmf_invalid 00:13:41.948 ************************************ 00:13:41.948 02:25:06 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:41.948 02:25:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:41.948 02:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:41.948 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:41.948 ************************************ 00:13:41.948 START TEST nvmf_abort 00:13:41.948 ************************************ 00:13:41.948 02:25:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:41.948 * Looking for test storage... 00:13:41.948 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:41.948 02:25:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:41.948 02:25:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:41.948 02:25:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:42.207 02:25:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:42.207 02:25:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:42.207 02:25:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:42.207 02:25:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:42.207 02:25:06 -- scripts/common.sh@335 -- # IFS=.-: 00:13:42.207 02:25:06 -- scripts/common.sh@335 -- # read -ra ver1 00:13:42.207 02:25:06 -- scripts/common.sh@336 -- # IFS=.-: 00:13:42.207 02:25:06 -- scripts/common.sh@336 -- # read -ra ver2 00:13:42.207 02:25:06 -- scripts/common.sh@337 -- # local 'op=<' 00:13:42.207 02:25:06 -- scripts/common.sh@339 -- # ver1_l=2 00:13:42.207 02:25:06 -- scripts/common.sh@340 -- # ver2_l=1 00:13:42.207 02:25:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:42.207 02:25:06 -- scripts/common.sh@343 -- # case "$op" in 00:13:42.207 02:25:06 -- scripts/common.sh@344 -- # : 1 00:13:42.207 02:25:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:42.207 02:25:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:42.207 02:25:06 -- scripts/common.sh@364 -- # decimal 1 00:13:42.207 02:25:06 -- scripts/common.sh@352 -- # local d=1 00:13:42.207 02:25:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:42.207 02:25:06 -- scripts/common.sh@354 -- # echo 1 00:13:42.207 02:25:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:42.207 02:25:06 -- scripts/common.sh@365 -- # decimal 2 00:13:42.207 02:25:06 -- scripts/common.sh@352 -- # local d=2 00:13:42.207 02:25:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:42.207 02:25:06 -- scripts/common.sh@354 -- # echo 2 00:13:42.207 02:25:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:42.207 02:25:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:42.207 02:25:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:42.207 02:25:06 -- scripts/common.sh@367 -- # return 0 00:13:42.207 02:25:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:42.207 02:25:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:42.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.207 --rc genhtml_branch_coverage=1 00:13:42.207 --rc genhtml_function_coverage=1 00:13:42.207 --rc genhtml_legend=1 00:13:42.207 --rc geninfo_all_blocks=1 00:13:42.207 --rc geninfo_unexecuted_blocks=1 00:13:42.207 00:13:42.207 ' 00:13:42.207 02:25:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:42.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.207 --rc genhtml_branch_coverage=1 00:13:42.207 --rc genhtml_function_coverage=1 00:13:42.207 --rc genhtml_legend=1 00:13:42.207 --rc geninfo_all_blocks=1 00:13:42.207 --rc geninfo_unexecuted_blocks=1 00:13:42.207 00:13:42.207 ' 00:13:42.207 02:25:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:42.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.207 --rc genhtml_branch_coverage=1 00:13:42.207 --rc genhtml_function_coverage=1 00:13:42.207 --rc genhtml_legend=1 00:13:42.207 --rc geninfo_all_blocks=1 00:13:42.207 --rc geninfo_unexecuted_blocks=1 00:13:42.207 00:13:42.207 ' 00:13:42.207 02:25:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:42.207 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:42.207 --rc genhtml_branch_coverage=1 00:13:42.207 --rc genhtml_function_coverage=1 00:13:42.207 --rc genhtml_legend=1 00:13:42.207 --rc geninfo_all_blocks=1 00:13:42.207 --rc geninfo_unexecuted_blocks=1 00:13:42.207 00:13:42.207 ' 00:13:42.207 02:25:06 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:42.207 02:25:06 -- nvmf/common.sh@7 -- # uname -s 00:13:42.207 02:25:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:42.207 02:25:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:42.207 02:25:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:42.207 02:25:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:42.207 02:25:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:42.207 02:25:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:42.207 02:25:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:42.207 02:25:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:42.207 02:25:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:42.207 02:25:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:42.208 02:25:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.208 02:25:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:42.208 02:25:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:42.208 02:25:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:42.208 02:25:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:42.208 02:25:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:42.208 02:25:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:42.208 02:25:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:42.208 02:25:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:42.208 02:25:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.208 02:25:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.208 02:25:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.208 02:25:06 -- paths/export.sh@5 -- # export PATH 00:13:42.208 02:25:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:42.208 02:25:06 -- nvmf/common.sh@46 -- # : 0 00:13:42.208 02:25:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:42.208 02:25:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:42.208 02:25:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:42.208 02:25:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:42.208 02:25:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:42.208 02:25:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:42.208 02:25:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:42.208 02:25:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:42.208 02:25:06 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:42.208 02:25:06 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:42.208 02:25:06 -- target/abort.sh@14 -- # nvmftestinit 00:13:42.208 02:25:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:42.208 02:25:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:42.208 02:25:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:42.208 02:25:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:42.208 02:25:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:42.208 02:25:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:42.208 02:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:42.208 02:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.208 02:25:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:42.208 02:25:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:42.208 02:25:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:42.208 02:25:06 -- common/autotest_common.sh@10 -- # set +x 00:13:44.110 02:25:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:44.110 02:25:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:44.110 02:25:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:44.110 02:25:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:44.110 02:25:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:44.110 02:25:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:44.110 02:25:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:44.110 02:25:08 -- nvmf/common.sh@294 -- # net_devs=() 00:13:44.110 02:25:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:44.110 02:25:08 -- nvmf/common.sh@295 -- # e810=() 00:13:44.110 02:25:08 -- nvmf/common.sh@295 -- # local -ga e810 00:13:44.110 02:25:08 -- nvmf/common.sh@296 -- # x722=() 00:13:44.110 02:25:08 -- nvmf/common.sh@296 -- # local -ga x722 00:13:44.110 02:25:08 -- nvmf/common.sh@297 -- # mlx=() 00:13:44.110 02:25:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:44.110 02:25:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:44.110 02:25:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:44.110 02:25:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:44.110 02:25:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.110 02:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:44.110 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:44.110 02:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:44.110 02:25:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:44.110 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:44.110 02:25:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.110 02:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.110 02:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.110 02:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:44.110 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:44.110 02:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.110 02:25:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:44.110 02:25:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:44.110 02:25:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:44.110 02:25:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:44.110 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:44.110 02:25:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:44.110 02:25:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:44.110 02:25:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:44.110 02:25:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:44.110 02:25:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:44.110 02:25:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:44.110 02:25:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:44.110 02:25:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:44.110 02:25:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:44.110 02:25:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:44.110 02:25:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:44.110 02:25:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:44.110 02:25:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:44.110 02:25:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:44.110 02:25:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:44.110 02:25:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:44.370 02:25:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:44.370 02:25:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:44.370 02:25:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:44.370 02:25:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:44.370 02:25:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:44.370 02:25:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:44.370 02:25:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:44.370 02:25:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:44.370 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:44.370 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.372 ms 00:13:44.370 00:13:44.370 --- 10.0.0.2 ping statistics --- 00:13:44.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.370 rtt min/avg/max/mdev = 0.372/0.372/0.372/0.000 ms 00:13:44.370 02:25:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:44.370 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:44.370 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:13:44.370 00:13:44.370 --- 10.0.0.1 ping statistics --- 00:13:44.370 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:44.370 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:13:44.370 02:25:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:44.370 02:25:08 -- nvmf/common.sh@410 -- # return 0 00:13:44.370 02:25:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:44.370 02:25:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:44.370 02:25:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:44.370 02:25:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:44.370 02:25:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:44.370 02:25:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:44.370 02:25:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:44.370 02:25:08 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:44.370 02:25:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:44.370 02:25:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:44.370 02:25:08 -- common/autotest_common.sh@10 -- # set +x 00:13:44.370 02:25:08 -- nvmf/common.sh@469 -- # nvmfpid=2022910 00:13:44.370 02:25:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:44.370 02:25:08 -- nvmf/common.sh@470 -- # waitforlisten 2022910 00:13:44.370 02:25:09 -- common/autotest_common.sh@829 -- # '[' -z 2022910 ']' 00:13:44.370 02:25:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:44.370 02:25:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:44.370 02:25:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:44.370 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:44.370 02:25:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:44.370 02:25:09 -- common/autotest_common.sh@10 -- # set +x 00:13:44.629 [2024-11-27 02:25:09.046311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:44.629 [2024-11-27 02:25:09.046394] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:44.629 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.629 [2024-11-27 02:25:09.115890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:44.629 [2024-11-27 02:25:09.207553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:44.629 [2024-11-27 02:25:09.207724] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:44.629 [2024-11-27 02:25:09.207742] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:44.629 [2024-11-27 02:25:09.207756] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:44.629 [2024-11-27 02:25:09.207840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:44.629 [2024-11-27 02:25:09.207896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:44.629 [2024-11-27 02:25:09.207900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:45.560 02:25:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:45.560 02:25:10 -- common/autotest_common.sh@862 -- # return 0 00:13:45.560 02:25:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:45.560 02:25:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 02:25:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:45.560 02:25:10 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 [2024-11-27 02:25:10.051001] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 Malloc0 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 Delay0 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 [2024-11-27 02:25:10.125085] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:45.560 02:25:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.560 02:25:10 -- common/autotest_common.sh@10 -- # set +x 00:13:45.560 02:25:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.560 02:25:10 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:45.560 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.819 [2024-11-27 02:25:10.219691] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:47.717 Initializing NVMe Controllers 00:13:47.717 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:47.717 controller IO queue size 128 less than required 00:13:47.717 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:47.717 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:47.718 Initialization complete. Launching workers. 00:13:47.718 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34083 00:13:47.718 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34144, failed to submit 62 00:13:47.718 success 34083, unsuccess 61, failed 0 00:13:47.718 02:25:12 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:47.718 02:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.718 02:25:12 -- common/autotest_common.sh@10 -- # set +x 00:13:47.718 02:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.718 02:25:12 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:47.718 02:25:12 -- target/abort.sh@38 -- # nvmftestfini 00:13:47.718 02:25:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:47.718 02:25:12 -- nvmf/common.sh@116 -- # sync 00:13:47.718 02:25:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:47.718 02:25:12 -- nvmf/common.sh@119 -- # set +e 00:13:47.718 02:25:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:47.718 02:25:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:47.718 rmmod nvme_tcp 00:13:47.718 rmmod nvme_fabrics 00:13:47.718 rmmod nvme_keyring 00:13:47.718 02:25:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:47.718 02:25:12 -- nvmf/common.sh@123 -- # set -e 00:13:47.718 02:25:12 -- nvmf/common.sh@124 -- # return 0 00:13:47.718 02:25:12 -- nvmf/common.sh@477 -- # '[' -n 2022910 ']' 00:13:47.718 02:25:12 -- nvmf/common.sh@478 -- # killprocess 2022910 00:13:47.718 02:25:12 -- common/autotest_common.sh@936 -- # '[' -z 2022910 ']' 00:13:47.718 02:25:12 -- common/autotest_common.sh@940 -- # kill -0 2022910 00:13:47.718 02:25:12 -- common/autotest_common.sh@941 -- # uname 00:13:47.718 02:25:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:47.718 02:25:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2022910 00:13:47.976 02:25:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:47.976 02:25:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:47.976 02:25:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2022910' 00:13:47.976 killing process with pid 2022910 00:13:47.976 02:25:12 -- common/autotest_common.sh@955 -- # kill 2022910 00:13:47.976 02:25:12 -- common/autotest_common.sh@960 -- # wait 2022910 00:13:48.234 02:25:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:48.234 02:25:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:48.234 02:25:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:48.234 02:25:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:48.234 02:25:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:48.234 02:25:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.234 02:25:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.234 02:25:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.139 02:25:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:50.139 00:13:50.139 real 0m8.176s 00:13:50.139 user 0m12.764s 00:13:50.139 sys 0m2.607s 00:13:50.139 02:25:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:50.139 02:25:14 -- common/autotest_common.sh@10 -- # set +x 00:13:50.139 ************************************ 00:13:50.139 END TEST nvmf_abort 00:13:50.139 ************************************ 00:13:50.139 02:25:14 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:50.139 02:25:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:50.139 02:25:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:50.139 02:25:14 -- common/autotest_common.sh@10 -- # set +x 00:13:50.139 ************************************ 00:13:50.139 START TEST nvmf_ns_hotplug_stress 00:13:50.139 ************************************ 00:13:50.139 02:25:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:50.139 * Looking for test storage... 00:13:50.139 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:50.139 02:25:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:50.139 02:25:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:50.139 02:25:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:50.397 02:25:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:50.397 02:25:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:50.397 02:25:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:50.397 02:25:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:50.397 02:25:14 -- scripts/common.sh@335 -- # IFS=.-: 00:13:50.397 02:25:14 -- scripts/common.sh@335 -- # read -ra ver1 00:13:50.397 02:25:14 -- scripts/common.sh@336 -- # IFS=.-: 00:13:50.398 02:25:14 -- scripts/common.sh@336 -- # read -ra ver2 00:13:50.398 02:25:14 -- scripts/common.sh@337 -- # local 'op=<' 00:13:50.398 02:25:14 -- scripts/common.sh@339 -- # ver1_l=2 00:13:50.398 02:25:14 -- scripts/common.sh@340 -- # ver2_l=1 00:13:50.398 02:25:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:50.398 02:25:14 -- scripts/common.sh@343 -- # case "$op" in 00:13:50.398 02:25:14 -- scripts/common.sh@344 -- # : 1 00:13:50.398 02:25:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:50.398 02:25:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:50.398 02:25:14 -- scripts/common.sh@364 -- # decimal 1 00:13:50.398 02:25:14 -- scripts/common.sh@352 -- # local d=1 00:13:50.398 02:25:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:50.398 02:25:14 -- scripts/common.sh@354 -- # echo 1 00:13:50.398 02:25:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:50.398 02:25:14 -- scripts/common.sh@365 -- # decimal 2 00:13:50.398 02:25:14 -- scripts/common.sh@352 -- # local d=2 00:13:50.398 02:25:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:50.398 02:25:14 -- scripts/common.sh@354 -- # echo 2 00:13:50.398 02:25:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:50.398 02:25:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:50.398 02:25:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:50.398 02:25:14 -- scripts/common.sh@367 -- # return 0 00:13:50.398 02:25:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:50.398 02:25:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:50.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.398 --rc genhtml_branch_coverage=1 00:13:50.398 --rc genhtml_function_coverage=1 00:13:50.398 --rc genhtml_legend=1 00:13:50.398 --rc geninfo_all_blocks=1 00:13:50.398 --rc geninfo_unexecuted_blocks=1 00:13:50.398 00:13:50.398 ' 00:13:50.398 02:25:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:50.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.398 --rc genhtml_branch_coverage=1 00:13:50.398 --rc genhtml_function_coverage=1 00:13:50.398 --rc genhtml_legend=1 00:13:50.398 --rc geninfo_all_blocks=1 00:13:50.398 --rc geninfo_unexecuted_blocks=1 00:13:50.398 00:13:50.398 ' 00:13:50.398 02:25:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:50.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.398 --rc genhtml_branch_coverage=1 00:13:50.398 --rc genhtml_function_coverage=1 00:13:50.398 --rc genhtml_legend=1 00:13:50.398 --rc geninfo_all_blocks=1 00:13:50.398 --rc geninfo_unexecuted_blocks=1 00:13:50.398 00:13:50.398 ' 00:13:50.398 02:25:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:50.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.398 --rc genhtml_branch_coverage=1 00:13:50.398 --rc genhtml_function_coverage=1 00:13:50.398 --rc genhtml_legend=1 00:13:50.398 --rc geninfo_all_blocks=1 00:13:50.398 --rc geninfo_unexecuted_blocks=1 00:13:50.398 00:13:50.398 ' 00:13:50.398 02:25:14 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:50.398 02:25:14 -- nvmf/common.sh@7 -- # uname -s 00:13:50.398 02:25:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:50.398 02:25:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:50.398 02:25:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:50.398 02:25:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:50.398 02:25:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:50.398 02:25:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:50.398 02:25:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:50.398 02:25:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:50.398 02:25:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:50.398 02:25:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:50.398 02:25:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.398 02:25:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.398 02:25:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:50.398 02:25:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:50.398 02:25:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:50.398 02:25:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:50.398 02:25:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:50.398 02:25:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:50.398 02:25:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:50.398 02:25:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.398 02:25:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.398 02:25:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.398 02:25:14 -- paths/export.sh@5 -- # export PATH 00:13:50.398 02:25:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.398 02:25:14 -- nvmf/common.sh@46 -- # : 0 00:13:50.398 02:25:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:50.398 02:25:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:50.398 02:25:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:50.398 02:25:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:50.398 02:25:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:50.398 02:25:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:50.398 02:25:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:50.398 02:25:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:50.398 02:25:14 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:50.398 02:25:14 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:50.398 02:25:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:50.398 02:25:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:50.398 02:25:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:50.398 02:25:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:50.398 02:25:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:50.398 02:25:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.398 02:25:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.398 02:25:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.398 02:25:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:50.398 02:25:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:50.398 02:25:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:50.398 02:25:14 -- common/autotest_common.sh@10 -- # set +x 00:13:52.931 02:25:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:52.931 02:25:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:52.931 02:25:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:52.931 02:25:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:52.931 02:25:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:52.931 02:25:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:52.931 02:25:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:52.931 02:25:17 -- nvmf/common.sh@294 -- # net_devs=() 00:13:52.931 02:25:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:52.931 02:25:17 -- nvmf/common.sh@295 -- # e810=() 00:13:52.931 02:25:17 -- nvmf/common.sh@295 -- # local -ga e810 00:13:52.931 02:25:17 -- nvmf/common.sh@296 -- # x722=() 00:13:52.931 02:25:17 -- nvmf/common.sh@296 -- # local -ga x722 00:13:52.931 02:25:17 -- nvmf/common.sh@297 -- # mlx=() 00:13:52.931 02:25:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:52.931 02:25:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:52.931 02:25:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.931 02:25:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:52.931 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:52.931 02:25:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.931 02:25:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:52.931 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:52.931 02:25:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.931 02:25:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.931 02:25:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.931 02:25:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:52.931 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:52.931 02:25:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.931 02:25:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.931 02:25:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.931 02:25:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:52.931 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:52.931 02:25:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:52.931 02:25:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:52.931 02:25:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:52.931 02:25:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:52.931 02:25:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:52.931 02:25:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:52.931 02:25:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:52.931 02:25:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:52.931 02:25:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:52.931 02:25:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:52.931 02:25:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:52.931 02:25:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:52.931 02:25:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:52.931 02:25:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:52.931 02:25:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:52.931 02:25:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:52.931 02:25:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:52.931 02:25:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:52.931 02:25:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:52.931 02:25:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:52.931 02:25:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:52.931 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:52.931 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:13:52.931 00:13:52.931 --- 10.0.0.2 ping statistics --- 00:13:52.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.931 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:13:52.931 02:25:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:52.931 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:52.931 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.274 ms 00:13:52.931 00:13:52.931 --- 10.0.0.1 ping statistics --- 00:13:52.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.931 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:13:52.931 02:25:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:52.931 02:25:17 -- nvmf/common.sh@410 -- # return 0 00:13:52.931 02:25:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:52.931 02:25:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:52.931 02:25:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:52.931 02:25:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:52.931 02:25:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:52.931 02:25:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:52.931 02:25:17 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:52.931 02:25:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:52.931 02:25:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:52.931 02:25:17 -- common/autotest_common.sh@10 -- # set +x 00:13:52.931 02:25:17 -- nvmf/common.sh@469 -- # nvmfpid=2025287 00:13:52.931 02:25:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:52.931 02:25:17 -- nvmf/common.sh@470 -- # waitforlisten 2025287 00:13:52.931 02:25:17 -- common/autotest_common.sh@829 -- # '[' -z 2025287 ']' 00:13:52.931 02:25:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:52.931 02:25:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:52.931 02:25:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:52.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:52.931 02:25:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:52.931 02:25:17 -- common/autotest_common.sh@10 -- # set +x 00:13:52.931 [2024-11-27 02:25:17.217878] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:52.932 [2024-11-27 02:25:17.217945] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:52.932 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.932 [2024-11-27 02:25:17.281056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:52.932 [2024-11-27 02:25:17.366561] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:52.932 [2024-11-27 02:25:17.366695] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:52.932 [2024-11-27 02:25:17.366713] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:52.932 [2024-11-27 02:25:17.366726] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:52.932 [2024-11-27 02:25:17.366777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:52.932 [2024-11-27 02:25:17.366804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:52.932 [2024-11-27 02:25:17.366807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:53.864 02:25:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:53.864 02:25:18 -- common/autotest_common.sh@862 -- # return 0 00:13:53.864 02:25:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:53.864 02:25:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:53.864 02:25:18 -- common/autotest_common.sh@10 -- # set +x 00:13:53.864 02:25:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:53.864 02:25:18 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:53.864 02:25:18 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:54.122 [2024-11-27 02:25:18.512924] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:54.122 02:25:18 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:54.380 02:25:18 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:54.637 [2024-11-27 02:25:19.023662] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:54.637 02:25:19 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:54.895 02:25:19 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:55.152 Malloc0 00:13:55.152 02:25:19 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:55.409 Delay0 00:13:55.409 02:25:19 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.667 02:25:20 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:55.925 NULL1 00:13:55.925 02:25:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:56.183 02:25:20 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2025732 00:13:56.183 02:25:20 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:56.183 02:25:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:13:56.183 02:25:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.183 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.117 Read completed with error (sct=0, sc=11) 00:13:57.118 02:25:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.375 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.376 02:25:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:57.376 02:25:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:57.634 true 00:13:57.891 02:25:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:13:57.891 02:25:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.457 02:25:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.714 02:25:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:58.714 02:25:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:58.972 true 00:13:58.972 02:25:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:13:58.972 02:25:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.231 02:25:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.488 02:25:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:59.488 02:25:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:59.746 true 00:13:59.746 02:25:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:13:59.746 02:25:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.003 02:25:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.260 02:25:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:00.260 02:25:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:00.518 true 00:14:00.518 02:25:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:00.518 02:25:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.891 02:25:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.891 02:25:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:01.891 02:25:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:02.165 true 00:14:02.165 02:25:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:02.165 02:25:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.422 02:25:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.680 02:25:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:02.680 02:25:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:02.937 true 00:14:02.938 02:25:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:02.938 02:25:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.195 02:25:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.452 02:25:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:03.452 02:25:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:03.752 true 00:14:03.752 02:25:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:03.752 02:25:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.709 02:25:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:04.965 02:25:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:04.965 02:25:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:05.222 true 00:14:05.222 02:25:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:05.222 02:25:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.479 02:25:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.736 02:25:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:05.736 02:25:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:05.993 true 00:14:05.993 02:25:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:05.993 02:25:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.926 02:25:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.926 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:06.926 02:25:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:06.926 02:25:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:07.183 true 00:14:07.184 02:25:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:07.184 02:25:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.441 02:25:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.699 02:25:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:07.699 02:25:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:07.955 true 00:14:07.955 02:25:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:07.955 02:25:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.886 02:25:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.144 02:25:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:09.144 02:25:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:09.402 true 00:14:09.402 02:25:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:09.402 02:25:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.660 02:25:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.917 02:25:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:09.917 02:25:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:10.175 true 00:14:10.175 02:25:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:10.175 02:25:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.432 02:25:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.689 02:25:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:10.689 02:25:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:10.689 true 00:14:10.947 02:25:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:10.947 02:25:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.878 02:25:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.878 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.135 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.135 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.135 02:25:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:12.135 02:25:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:12.392 true 00:14:12.392 02:25:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:12.392 02:25:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.650 02:25:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.907 02:25:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:12.907 02:25:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:13.165 true 00:14:13.165 02:25:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:13.165 02:25:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.098 02:25:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.098 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.356 02:25:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:14.356 02:25:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:14.614 true 00:14:14.614 02:25:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:14.614 02:25:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.871 02:25:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.128 02:25:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:15.128 02:25:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:15.387 true 00:14:15.387 02:25:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:15.387 02:25:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.320 02:25:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.578 02:25:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:16.578 02:25:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:16.836 true 00:14:16.836 02:25:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:16.836 02:25:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.094 02:25:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.352 02:25:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:17.352 02:25:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:17.610 true 00:14:17.610 02:25:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:17.610 02:25:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.868 02:25:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.126 02:25:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:18.126 02:25:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:18.384 true 00:14:18.384 02:25:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:18.384 02:25:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.757 02:25:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.757 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.757 02:25:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:19.757 02:25:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:20.014 true 00:14:20.014 02:25:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:20.014 02:25:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.273 02:25:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.531 02:25:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:20.531 02:25:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:20.788 true 00:14:20.788 02:25:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:20.788 02:25:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.720 02:25:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.720 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.720 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.978 02:25:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:21.978 02:25:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:22.235 true 00:14:22.235 02:25:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:22.235 02:25:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.493 02:25:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.750 02:25:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:22.750 02:25:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:23.008 true 00:14:23.008 02:25:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:23.008 02:25:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.941 02:25:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.941 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.941 02:25:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:23.941 02:25:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:24.198 true 00:14:24.198 02:25:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:24.198 02:25:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.456 02:25:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.718 02:25:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:24.718 02:25:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:24.979 true 00:14:24.979 02:25:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:24.979 02:25:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.913 02:25:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.913 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:26.171 02:25:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:26.171 02:25:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:26.429 Initializing NVMe Controllers 00:14:26.429 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:26.429 Controller IO queue size 128, less than required. 00:14:26.429 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:26.429 Controller IO queue size 128, less than required. 00:14:26.429 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:26.429 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:26.429 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:26.429 Initialization complete. Launching workers. 00:14:26.429 ======================================================== 00:14:26.429 Latency(us) 00:14:26.429 Device Information : IOPS MiB/s Average min max 00:14:26.429 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 830.46 0.41 75415.84 2403.50 1046529.24 00:14:26.429 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11208.32 5.47 11420.24 1571.61 443324.84 00:14:26.429 ======================================================== 00:14:26.429 Total : 12038.78 5.88 15834.78 1571.61 1046529.24 00:14:26.429 00:14:26.429 true 00:14:26.429 02:25:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2025732 00:14:26.429 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2025732) - No such process 00:14:26.429 02:25:51 -- target/ns_hotplug_stress.sh@53 -- # wait 2025732 00:14:26.429 02:25:51 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.686 02:25:51 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:26.944 02:25:51 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:26.944 02:25:51 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:26.944 02:25:51 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:26.944 02:25:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:26.944 02:25:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:27.202 null0 00:14:27.202 02:25:51 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:27.202 02:25:51 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:27.202 02:25:51 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:27.459 null1 00:14:27.459 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:27.459 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:27.459 02:25:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:27.717 null2 00:14:27.717 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:27.717 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:27.717 02:25:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:27.974 null3 00:14:27.974 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:27.974 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:27.974 02:25:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:28.232 null4 00:14:28.232 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:28.232 02:25:52 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.232 02:25:52 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:28.489 null5 00:14:28.489 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:28.489 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.489 02:25:53 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:28.747 null6 00:14:28.747 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:28.747 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.747 02:25:53 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:29.006 null7 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@66 -- # wait 2029885 2029886 2029888 2029890 2029892 2029894 2029896 2029898 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.006 02:25:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:29.264 02:25:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:29.521 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:29.778 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:30.035 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:30.292 02:25:54 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:30.549 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.549 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.549 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:30.549 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:30.549 02:25:54 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:30.549 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:30.549 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:30.549 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.807 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.064 02:25:55 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.321 02:25:55 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:31.577 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.577 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:31.577 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.578 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.578 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:31.578 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:31.578 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:31.578 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.835 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.093 02:25:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.351 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:32.628 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.628 02:25:56 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.628 02:25:56 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:32.629 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:32.629 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.921 02:25:57 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.182 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.440 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.440 02:25:57 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.440 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.440 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.440 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.697 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.955 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.214 02:25:58 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.473 02:25:58 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:34.731 02:25:59 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:34.731 02:25:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:34.731 02:25:59 -- nvmf/common.sh@116 -- # sync 00:14:34.731 02:25:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:34.731 02:25:59 -- nvmf/common.sh@119 -- # set +e 00:14:34.731 02:25:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:34.731 02:25:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:34.731 rmmod nvme_tcp 00:14:34.731 rmmod nvme_fabrics 00:14:34.731 rmmod nvme_keyring 00:14:34.731 02:25:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:34.731 02:25:59 -- nvmf/common.sh@123 -- # set -e 00:14:34.731 02:25:59 -- nvmf/common.sh@124 -- # return 0 00:14:34.731 02:25:59 -- nvmf/common.sh@477 -- # '[' -n 2025287 ']' 00:14:34.731 02:25:59 -- nvmf/common.sh@478 -- # killprocess 2025287 00:14:34.731 02:25:59 -- common/autotest_common.sh@936 -- # '[' -z 2025287 ']' 00:14:34.731 02:25:59 -- common/autotest_common.sh@940 -- # kill -0 2025287 00:14:34.731 02:25:59 -- common/autotest_common.sh@941 -- # uname 00:14:34.731 02:25:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:34.731 02:25:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2025287 00:14:34.731 02:25:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:34.731 02:25:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:34.731 02:25:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2025287' 00:14:34.731 killing process with pid 2025287 00:14:34.731 02:25:59 -- common/autotest_common.sh@955 -- # kill 2025287 00:14:34.731 02:25:59 -- common/autotest_common.sh@960 -- # wait 2025287 00:14:34.990 02:25:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:34.990 02:25:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:34.990 02:25:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:34.990 02:25:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:34.990 02:25:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:34.990 02:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:34.990 02:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:34.990 02:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.525 02:26:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:37.525 00:14:37.526 real 0m46.881s 00:14:37.526 user 3m34.274s 00:14:37.526 sys 0m15.322s 00:14:37.526 02:26:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:37.526 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:37.526 ************************************ 00:14:37.526 END TEST nvmf_ns_hotplug_stress 00:14:37.526 ************************************ 00:14:37.526 02:26:01 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:37.526 02:26:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:37.526 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:37.526 ************************************ 00:14:37.526 START TEST nvmf_connect_stress 00:14:37.526 ************************************ 00:14:37.526 02:26:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:37.526 * Looking for test storage... 00:14:37.526 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:37.526 02:26:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:37.526 02:26:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:37.526 02:26:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:37.526 02:26:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:37.526 02:26:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:37.526 02:26:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:37.526 02:26:01 -- scripts/common.sh@335 -- # IFS=.-: 00:14:37.526 02:26:01 -- scripts/common.sh@335 -- # read -ra ver1 00:14:37.526 02:26:01 -- scripts/common.sh@336 -- # IFS=.-: 00:14:37.526 02:26:01 -- scripts/common.sh@336 -- # read -ra ver2 00:14:37.526 02:26:01 -- scripts/common.sh@337 -- # local 'op=<' 00:14:37.526 02:26:01 -- scripts/common.sh@339 -- # ver1_l=2 00:14:37.526 02:26:01 -- scripts/common.sh@340 -- # ver2_l=1 00:14:37.526 02:26:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:37.526 02:26:01 -- scripts/common.sh@343 -- # case "$op" in 00:14:37.526 02:26:01 -- scripts/common.sh@344 -- # : 1 00:14:37.526 02:26:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:37.526 02:26:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:37.526 02:26:01 -- scripts/common.sh@364 -- # decimal 1 00:14:37.526 02:26:01 -- scripts/common.sh@352 -- # local d=1 00:14:37.526 02:26:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:37.526 02:26:01 -- scripts/common.sh@354 -- # echo 1 00:14:37.526 02:26:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:37.526 02:26:01 -- scripts/common.sh@365 -- # decimal 2 00:14:37.526 02:26:01 -- scripts/common.sh@352 -- # local d=2 00:14:37.526 02:26:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:37.526 02:26:01 -- scripts/common.sh@354 -- # echo 2 00:14:37.526 02:26:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:37.526 02:26:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:37.526 02:26:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:37.526 02:26:01 -- scripts/common.sh@367 -- # return 0 00:14:37.526 02:26:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:37.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.526 --rc genhtml_branch_coverage=1 00:14:37.526 --rc genhtml_function_coverage=1 00:14:37.526 --rc genhtml_legend=1 00:14:37.526 --rc geninfo_all_blocks=1 00:14:37.526 --rc geninfo_unexecuted_blocks=1 00:14:37.526 00:14:37.526 ' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:37.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.526 --rc genhtml_branch_coverage=1 00:14:37.526 --rc genhtml_function_coverage=1 00:14:37.526 --rc genhtml_legend=1 00:14:37.526 --rc geninfo_all_blocks=1 00:14:37.526 --rc geninfo_unexecuted_blocks=1 00:14:37.526 00:14:37.526 ' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:37.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.526 --rc genhtml_branch_coverage=1 00:14:37.526 --rc genhtml_function_coverage=1 00:14:37.526 --rc genhtml_legend=1 00:14:37.526 --rc geninfo_all_blocks=1 00:14:37.526 --rc geninfo_unexecuted_blocks=1 00:14:37.526 00:14:37.526 ' 00:14:37.526 02:26:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:37.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.526 --rc genhtml_branch_coverage=1 00:14:37.526 --rc genhtml_function_coverage=1 00:14:37.526 --rc genhtml_legend=1 00:14:37.526 --rc geninfo_all_blocks=1 00:14:37.526 --rc geninfo_unexecuted_blocks=1 00:14:37.526 00:14:37.526 ' 00:14:37.526 02:26:01 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:37.526 02:26:01 -- nvmf/common.sh@7 -- # uname -s 00:14:37.526 02:26:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:37.526 02:26:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:37.526 02:26:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:37.526 02:26:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:37.526 02:26:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:37.526 02:26:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:37.526 02:26:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:37.526 02:26:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:37.526 02:26:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:37.526 02:26:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:37.526 02:26:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.526 02:26:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:37.526 02:26:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:37.526 02:26:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:37.526 02:26:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:37.526 02:26:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:37.526 02:26:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:37.526 02:26:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:37.526 02:26:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:37.526 02:26:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.526 02:26:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.526 02:26:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.526 02:26:01 -- paths/export.sh@5 -- # export PATH 00:14:37.526 02:26:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.526 02:26:01 -- nvmf/common.sh@46 -- # : 0 00:14:37.526 02:26:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:37.526 02:26:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:37.526 02:26:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:37.526 02:26:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:37.526 02:26:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:37.526 02:26:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:37.526 02:26:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:37.526 02:26:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:37.526 02:26:01 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:37.526 02:26:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:37.526 02:26:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:37.526 02:26:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:37.526 02:26:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:37.526 02:26:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:37.526 02:26:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.526 02:26:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:37.526 02:26:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.526 02:26:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:37.526 02:26:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:37.526 02:26:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:37.526 02:26:01 -- common/autotest_common.sh@10 -- # set +x 00:14:39.430 02:26:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.430 02:26:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:39.430 02:26:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:39.430 02:26:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:39.430 02:26:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:39.430 02:26:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:39.430 02:26:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:39.430 02:26:03 -- nvmf/common.sh@294 -- # net_devs=() 00:14:39.430 02:26:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:39.430 02:26:03 -- nvmf/common.sh@295 -- # e810=() 00:14:39.430 02:26:03 -- nvmf/common.sh@295 -- # local -ga e810 00:14:39.430 02:26:03 -- nvmf/common.sh@296 -- # x722=() 00:14:39.430 02:26:03 -- nvmf/common.sh@296 -- # local -ga x722 00:14:39.430 02:26:03 -- nvmf/common.sh@297 -- # mlx=() 00:14:39.430 02:26:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:39.430 02:26:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.430 02:26:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:39.430 02:26:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:39.430 02:26:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:39.430 02:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.430 02:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:39.430 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:39.430 02:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:39.430 02:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:39.430 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:39.430 02:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:39.430 02:26:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.430 02:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.430 02:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.430 02:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.430 02:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:39.430 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:39.430 02:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.430 02:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:39.430 02:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.430 02:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:39.430 02:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.430 02:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:39.430 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:39.430 02:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.430 02:26:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:39.430 02:26:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:39.430 02:26:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:39.430 02:26:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:39.430 02:26:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:39.430 02:26:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:39.430 02:26:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:39.430 02:26:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:39.431 02:26:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:39.431 02:26:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:39.431 02:26:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:39.431 02:26:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:39.431 02:26:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:39.431 02:26:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:39.431 02:26:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:39.431 02:26:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:39.431 02:26:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:39.431 02:26:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:39.431 02:26:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:39.431 02:26:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:39.431 02:26:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:39.431 02:26:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:39.431 02:26:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:39.431 02:26:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:39.431 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:39.431 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:14:39.431 00:14:39.431 --- 10.0.0.2 ping statistics --- 00:14:39.431 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.431 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:14:39.431 02:26:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:39.431 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:39.431 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:14:39.431 00:14:39.431 --- 10.0.0.1 ping statistics --- 00:14:39.431 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:39.431 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:39.431 02:26:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:39.431 02:26:03 -- nvmf/common.sh@410 -- # return 0 00:14:39.431 02:26:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:39.431 02:26:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:39.431 02:26:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:39.431 02:26:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:39.431 02:26:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:39.431 02:26:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:39.431 02:26:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:39.431 02:26:03 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:39.431 02:26:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:39.431 02:26:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:39.431 02:26:03 -- common/autotest_common.sh@10 -- # set +x 00:14:39.431 02:26:03 -- nvmf/common.sh@469 -- # nvmfpid=2032692 00:14:39.431 02:26:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:39.431 02:26:03 -- nvmf/common.sh@470 -- # waitforlisten 2032692 00:14:39.431 02:26:03 -- common/autotest_common.sh@829 -- # '[' -z 2032692 ']' 00:14:39.431 02:26:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:39.431 02:26:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:39.431 02:26:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:39.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:39.431 02:26:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:39.431 02:26:03 -- common/autotest_common.sh@10 -- # set +x 00:14:39.431 [2024-11-27 02:26:04.011825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:39.431 [2024-11-27 02:26:04.011915] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:39.431 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.690 [2024-11-27 02:26:04.081832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:39.690 [2024-11-27 02:26:04.170866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:39.690 [2024-11-27 02:26:04.171025] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:39.690 [2024-11-27 02:26:04.171045] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:39.690 [2024-11-27 02:26:04.171060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:39.690 [2024-11-27 02:26:04.171145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:39.690 [2024-11-27 02:26:04.171263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:39.690 [2024-11-27 02:26:04.171267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:40.625 02:26:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:40.625 02:26:04 -- common/autotest_common.sh@862 -- # return 0 00:14:40.625 02:26:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:40.625 02:26:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:40.625 02:26:04 -- common/autotest_common.sh@10 -- # set +x 00:14:40.625 02:26:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:40.625 02:26:04 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:40.625 02:26:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.625 02:26:04 -- common/autotest_common.sh@10 -- # set +x 00:14:40.625 [2024-11-27 02:26:04.992587] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:40.625 02:26:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.625 02:26:04 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:40.625 02:26:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.625 02:26:04 -- common/autotest_common.sh@10 -- # set +x 00:14:40.625 02:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.625 02:26:05 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:40.625 02:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.625 02:26:05 -- common/autotest_common.sh@10 -- # set +x 00:14:40.625 [2024-11-27 02:26:05.024670] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:40.625 02:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.625 02:26:05 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:40.625 02:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.625 02:26:05 -- common/autotest_common.sh@10 -- # set +x 00:14:40.625 NULL1 00:14:40.625 02:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.625 02:26:05 -- target/connect_stress.sh@21 -- # PERF_PID=2032850 00:14:40.625 02:26:05 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:40.625 02:26:05 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:40.625 02:26:05 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.625 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.625 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.626 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.626 02:26:05 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:40.626 02:26:05 -- target/connect_stress.sh@28 -- # cat 00:14:40.626 02:26:05 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:40.626 02:26:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:40.626 02:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.626 02:26:05 -- common/autotest_common.sh@10 -- # set +x 00:14:40.884 02:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.884 02:26:05 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:40.884 02:26:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:40.884 02:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.884 02:26:05 -- common/autotest_common.sh@10 -- # set +x 00:14:41.141 02:26:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.141 02:26:05 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:41.141 02:26:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.141 02:26:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.141 02:26:05 -- common/autotest_common.sh@10 -- # set +x 00:14:41.707 02:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.707 02:26:06 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:41.707 02:26:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.707 02:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.707 02:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:41.964 02:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.965 02:26:06 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:41.965 02:26:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.965 02:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.965 02:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:42.223 02:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.223 02:26:06 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:42.223 02:26:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.223 02:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.223 02:26:06 -- common/autotest_common.sh@10 -- # set +x 00:14:42.481 02:26:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.481 02:26:07 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:42.481 02:26:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.481 02:26:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.481 02:26:07 -- common/autotest_common.sh@10 -- # set +x 00:14:42.739 02:26:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.739 02:26:07 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:42.739 02:26:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.739 02:26:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.739 02:26:07 -- common/autotest_common.sh@10 -- # set +x 00:14:43.305 02:26:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.305 02:26:07 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:43.305 02:26:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.305 02:26:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.305 02:26:07 -- common/autotest_common.sh@10 -- # set +x 00:14:43.562 02:26:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.562 02:26:07 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:43.562 02:26:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.562 02:26:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.562 02:26:07 -- common/autotest_common.sh@10 -- # set +x 00:14:43.819 02:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.819 02:26:08 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:43.819 02:26:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.819 02:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.819 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:14:44.077 02:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.077 02:26:08 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:44.077 02:26:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.077 02:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.077 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:14:44.334 02:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.334 02:26:08 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:44.334 02:26:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.334 02:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.334 02:26:08 -- common/autotest_common.sh@10 -- # set +x 00:14:44.898 02:26:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.898 02:26:09 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:44.898 02:26:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.898 02:26:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.898 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:14:45.156 02:26:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.156 02:26:09 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:45.156 02:26:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.156 02:26:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.156 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:14:45.413 02:26:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.413 02:26:09 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:45.413 02:26:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.413 02:26:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.413 02:26:09 -- common/autotest_common.sh@10 -- # set +x 00:14:45.670 02:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.670 02:26:10 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:45.670 02:26:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.670 02:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.670 02:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:45.926 02:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.926 02:26:10 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:45.926 02:26:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.926 02:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.926 02:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:46.490 02:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.490 02:26:10 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:46.490 02:26:10 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.490 02:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.490 02:26:10 -- common/autotest_common.sh@10 -- # set +x 00:14:46.746 02:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.746 02:26:11 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:46.746 02:26:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.746 02:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.746 02:26:11 -- common/autotest_common.sh@10 -- # set +x 00:14:47.004 02:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.004 02:26:11 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:47.004 02:26:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.004 02:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.004 02:26:11 -- common/autotest_common.sh@10 -- # set +x 00:14:47.261 02:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.261 02:26:11 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:47.261 02:26:11 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.261 02:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.261 02:26:11 -- common/autotest_common.sh@10 -- # set +x 00:14:47.519 02:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.519 02:26:12 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:47.519 02:26:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.519 02:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.519 02:26:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.083 02:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.083 02:26:12 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:48.083 02:26:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.083 02:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.083 02:26:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.341 02:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.341 02:26:12 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:48.341 02:26:12 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.341 02:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.341 02:26:12 -- common/autotest_common.sh@10 -- # set +x 00:14:48.598 02:26:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.598 02:26:13 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:48.598 02:26:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.599 02:26:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.599 02:26:13 -- common/autotest_common.sh@10 -- # set +x 00:14:48.857 02:26:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.857 02:26:13 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:48.857 02:26:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.857 02:26:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.857 02:26:13 -- common/autotest_common.sh@10 -- # set +x 00:14:49.423 02:26:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.423 02:26:13 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:49.423 02:26:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.423 02:26:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.423 02:26:13 -- common/autotest_common.sh@10 -- # set +x 00:14:49.681 02:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.681 02:26:14 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:49.681 02:26:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.681 02:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.681 02:26:14 -- common/autotest_common.sh@10 -- # set +x 00:14:49.939 02:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.939 02:26:14 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:49.939 02:26:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.939 02:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.939 02:26:14 -- common/autotest_common.sh@10 -- # set +x 00:14:50.197 02:26:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.197 02:26:14 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:50.197 02:26:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.197 02:26:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.197 02:26:14 -- common/autotest_common.sh@10 -- # set +x 00:14:50.455 02:26:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.455 02:26:15 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:50.455 02:26:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.455 02:26:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.455 02:26:15 -- common/autotest_common.sh@10 -- # set +x 00:14:50.713 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:50.971 02:26:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.971 02:26:15 -- target/connect_stress.sh@34 -- # kill -0 2032850 00:14:50.971 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2032850) - No such process 00:14:50.971 02:26:15 -- target/connect_stress.sh@38 -- # wait 2032850 00:14:50.971 02:26:15 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:50.971 02:26:15 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:50.971 02:26:15 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:50.971 02:26:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:50.971 02:26:15 -- nvmf/common.sh@116 -- # sync 00:14:50.971 02:26:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:50.971 02:26:15 -- nvmf/common.sh@119 -- # set +e 00:14:50.971 02:26:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:50.971 02:26:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:50.971 rmmod nvme_tcp 00:14:50.971 rmmod nvme_fabrics 00:14:50.971 rmmod nvme_keyring 00:14:50.971 02:26:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:50.971 02:26:15 -- nvmf/common.sh@123 -- # set -e 00:14:50.971 02:26:15 -- nvmf/common.sh@124 -- # return 0 00:14:50.971 02:26:15 -- nvmf/common.sh@477 -- # '[' -n 2032692 ']' 00:14:50.971 02:26:15 -- nvmf/common.sh@478 -- # killprocess 2032692 00:14:50.971 02:26:15 -- common/autotest_common.sh@936 -- # '[' -z 2032692 ']' 00:14:50.971 02:26:15 -- common/autotest_common.sh@940 -- # kill -0 2032692 00:14:50.971 02:26:15 -- common/autotest_common.sh@941 -- # uname 00:14:50.971 02:26:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:50.971 02:26:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2032692 00:14:50.971 02:26:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:50.971 02:26:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:50.971 02:26:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2032692' 00:14:50.971 killing process with pid 2032692 00:14:50.971 02:26:15 -- common/autotest_common.sh@955 -- # kill 2032692 00:14:50.971 02:26:15 -- common/autotest_common.sh@960 -- # wait 2032692 00:14:51.230 02:26:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:51.230 02:26:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:51.230 02:26:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:51.230 02:26:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:51.230 02:26:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:51.230 02:26:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:51.230 02:26:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:51.230 02:26:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.136 02:26:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:53.136 00:14:53.136 real 0m16.149s 00:14:53.136 user 0m40.956s 00:14:53.136 sys 0m5.772s 00:14:53.136 02:26:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:53.136 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:53.136 ************************************ 00:14:53.136 END TEST nvmf_connect_stress 00:14:53.136 ************************************ 00:14:53.395 02:26:17 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:53.395 02:26:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:53.395 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:53.395 ************************************ 00:14:53.395 START TEST nvmf_fused_ordering 00:14:53.395 ************************************ 00:14:53.395 02:26:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:53.395 * Looking for test storage... 00:14:53.395 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:53.395 02:26:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:53.395 02:26:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:53.395 02:26:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:53.395 02:26:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:53.395 02:26:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:53.395 02:26:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:53.395 02:26:17 -- scripts/common.sh@335 -- # IFS=.-: 00:14:53.395 02:26:17 -- scripts/common.sh@335 -- # read -ra ver1 00:14:53.395 02:26:17 -- scripts/common.sh@336 -- # IFS=.-: 00:14:53.395 02:26:17 -- scripts/common.sh@336 -- # read -ra ver2 00:14:53.395 02:26:17 -- scripts/common.sh@337 -- # local 'op=<' 00:14:53.395 02:26:17 -- scripts/common.sh@339 -- # ver1_l=2 00:14:53.395 02:26:17 -- scripts/common.sh@340 -- # ver2_l=1 00:14:53.395 02:26:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:53.395 02:26:17 -- scripts/common.sh@343 -- # case "$op" in 00:14:53.395 02:26:17 -- scripts/common.sh@344 -- # : 1 00:14:53.395 02:26:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:53.395 02:26:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:53.395 02:26:17 -- scripts/common.sh@364 -- # decimal 1 00:14:53.395 02:26:17 -- scripts/common.sh@352 -- # local d=1 00:14:53.395 02:26:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:53.395 02:26:17 -- scripts/common.sh@354 -- # echo 1 00:14:53.395 02:26:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:53.395 02:26:17 -- scripts/common.sh@365 -- # decimal 2 00:14:53.395 02:26:17 -- scripts/common.sh@352 -- # local d=2 00:14:53.395 02:26:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:53.395 02:26:17 -- scripts/common.sh@354 -- # echo 2 00:14:53.395 02:26:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:53.395 02:26:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:53.395 02:26:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:53.395 02:26:17 -- scripts/common.sh@367 -- # return 0 00:14:53.395 02:26:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:53.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:53.395 --rc genhtml_branch_coverage=1 00:14:53.395 --rc genhtml_function_coverage=1 00:14:53.395 --rc genhtml_legend=1 00:14:53.395 --rc geninfo_all_blocks=1 00:14:53.395 --rc geninfo_unexecuted_blocks=1 00:14:53.395 00:14:53.395 ' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:53.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:53.395 --rc genhtml_branch_coverage=1 00:14:53.395 --rc genhtml_function_coverage=1 00:14:53.395 --rc genhtml_legend=1 00:14:53.395 --rc geninfo_all_blocks=1 00:14:53.395 --rc geninfo_unexecuted_blocks=1 00:14:53.395 00:14:53.395 ' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:53.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:53.395 --rc genhtml_branch_coverage=1 00:14:53.395 --rc genhtml_function_coverage=1 00:14:53.395 --rc genhtml_legend=1 00:14:53.395 --rc geninfo_all_blocks=1 00:14:53.395 --rc geninfo_unexecuted_blocks=1 00:14:53.395 00:14:53.395 ' 00:14:53.395 02:26:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:53.395 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:53.395 --rc genhtml_branch_coverage=1 00:14:53.395 --rc genhtml_function_coverage=1 00:14:53.395 --rc genhtml_legend=1 00:14:53.395 --rc geninfo_all_blocks=1 00:14:53.395 --rc geninfo_unexecuted_blocks=1 00:14:53.395 00:14:53.395 ' 00:14:53.395 02:26:17 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:53.395 02:26:17 -- nvmf/common.sh@7 -- # uname -s 00:14:53.395 02:26:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:53.395 02:26:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:53.395 02:26:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:53.395 02:26:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:53.395 02:26:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:53.395 02:26:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:53.395 02:26:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:53.395 02:26:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:53.395 02:26:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:53.395 02:26:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:53.395 02:26:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:53.395 02:26:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:53.395 02:26:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:53.395 02:26:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:53.395 02:26:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:53.395 02:26:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:53.395 02:26:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:53.395 02:26:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:53.396 02:26:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:53.396 02:26:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.396 02:26:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.396 02:26:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.396 02:26:17 -- paths/export.sh@5 -- # export PATH 00:14:53.396 02:26:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.396 02:26:17 -- nvmf/common.sh@46 -- # : 0 00:14:53.396 02:26:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:53.396 02:26:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:53.396 02:26:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:53.396 02:26:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:53.396 02:26:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:53.396 02:26:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:53.396 02:26:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:53.396 02:26:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:53.396 02:26:17 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:53.396 02:26:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:53.396 02:26:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:53.396 02:26:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:53.396 02:26:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:53.396 02:26:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:53.396 02:26:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:53.396 02:26:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:53.396 02:26:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.396 02:26:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:53.396 02:26:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:53.396 02:26:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:53.396 02:26:17 -- common/autotest_common.sh@10 -- # set +x 00:14:55.298 02:26:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:55.298 02:26:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:55.298 02:26:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:55.298 02:26:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:55.298 02:26:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:55.298 02:26:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:55.298 02:26:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:55.298 02:26:19 -- nvmf/common.sh@294 -- # net_devs=() 00:14:55.298 02:26:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:55.298 02:26:19 -- nvmf/common.sh@295 -- # e810=() 00:14:55.298 02:26:19 -- nvmf/common.sh@295 -- # local -ga e810 00:14:55.298 02:26:19 -- nvmf/common.sh@296 -- # x722=() 00:14:55.298 02:26:19 -- nvmf/common.sh@296 -- # local -ga x722 00:14:55.298 02:26:19 -- nvmf/common.sh@297 -- # mlx=() 00:14:55.298 02:26:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:55.298 02:26:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:55.298 02:26:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:55.298 02:26:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:55.298 02:26:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:55.298 02:26:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:55.298 02:26:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:55.298 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:55.298 02:26:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:55.298 02:26:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:55.298 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:55.298 02:26:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:55.298 02:26:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:55.298 02:26:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:55.298 02:26:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.298 02:26:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:55.298 02:26:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.298 02:26:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:55.298 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:55.298 02:26:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.298 02:26:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:55.298 02:26:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.299 02:26:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:55.299 02:26:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.299 02:26:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:55.299 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:55.299 02:26:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.299 02:26:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:55.299 02:26:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:55.299 02:26:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:55.299 02:26:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:55.299 02:26:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:55.299 02:26:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:55.299 02:26:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:55.299 02:26:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:55.299 02:26:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:55.299 02:26:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:55.299 02:26:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:55.299 02:26:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:55.299 02:26:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:55.299 02:26:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:55.299 02:26:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:55.299 02:26:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:55.299 02:26:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:55.299 02:26:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:55.557 02:26:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:55.557 02:26:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:55.557 02:26:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:55.557 02:26:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:55.557 02:26:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:55.557 02:26:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:55.557 02:26:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:55.557 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:55.557 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:14:55.557 00:14:55.557 --- 10.0.0.2 ping statistics --- 00:14:55.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.557 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:14:55.557 02:26:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:55.557 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:55.557 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.046 ms 00:14:55.557 00:14:55.557 --- 10.0.0.1 ping statistics --- 00:14:55.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.557 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:14:55.557 02:26:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:55.557 02:26:20 -- nvmf/common.sh@410 -- # return 0 00:14:55.557 02:26:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:55.557 02:26:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:55.557 02:26:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:55.557 02:26:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:55.557 02:26:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:55.557 02:26:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:55.557 02:26:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:55.557 02:26:20 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:55.557 02:26:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:55.557 02:26:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:55.557 02:26:20 -- common/autotest_common.sh@10 -- # set +x 00:14:55.557 02:26:20 -- nvmf/common.sh@469 -- # nvmfpid=2036044 00:14:55.557 02:26:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:55.557 02:26:20 -- nvmf/common.sh@470 -- # waitforlisten 2036044 00:14:55.557 02:26:20 -- common/autotest_common.sh@829 -- # '[' -z 2036044 ']' 00:14:55.557 02:26:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:55.557 02:26:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:55.557 02:26:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:55.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:55.557 02:26:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:55.557 02:26:20 -- common/autotest_common.sh@10 -- # set +x 00:14:55.557 [2024-11-27 02:26:20.091954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:55.557 [2024-11-27 02:26:20.092019] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:55.557 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.557 [2024-11-27 02:26:20.160023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:55.815 [2024-11-27 02:26:20.250160] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:55.815 [2024-11-27 02:26:20.250347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.815 [2024-11-27 02:26:20.250367] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.815 [2024-11-27 02:26:20.250392] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.815 [2024-11-27 02:26:20.250437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:56.751 02:26:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:56.751 02:26:21 -- common/autotest_common.sh@862 -- # return 0 00:14:56.751 02:26:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:56.751 02:26:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 02:26:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:56.751 02:26:21 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 [2024-11-27 02:26:21.092092] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 [2024-11-27 02:26:21.108256] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 NULL1 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:56.751 02:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.751 02:26:21 -- common/autotest_common.sh@10 -- # set +x 00:14:56.751 02:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.751 02:26:21 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:56.751 [2024-11-27 02:26:21.152056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:56.751 [2024-11-27 02:26:21.152097] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2036202 ] 00:14:56.751 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.317 Attached to nqn.2016-06.io.spdk:cnode1 00:14:57.317 Namespace ID: 1 size: 1GB 00:14:57.317 fused_ordering(0) 00:14:57.317 fused_ordering(1) 00:14:57.317 fused_ordering(2) 00:14:57.317 fused_ordering(3) 00:14:57.317 fused_ordering(4) 00:14:57.317 fused_ordering(5) 00:14:57.317 fused_ordering(6) 00:14:57.317 fused_ordering(7) 00:14:57.317 fused_ordering(8) 00:14:57.317 fused_ordering(9) 00:14:57.317 fused_ordering(10) 00:14:57.317 fused_ordering(11) 00:14:57.317 fused_ordering(12) 00:14:57.317 fused_ordering(13) 00:14:57.317 fused_ordering(14) 00:14:57.317 fused_ordering(15) 00:14:57.317 fused_ordering(16) 00:14:57.317 fused_ordering(17) 00:14:57.317 fused_ordering(18) 00:14:57.317 fused_ordering(19) 00:14:57.317 fused_ordering(20) 00:14:57.317 fused_ordering(21) 00:14:57.317 fused_ordering(22) 00:14:57.317 fused_ordering(23) 00:14:57.317 fused_ordering(24) 00:14:57.317 fused_ordering(25) 00:14:57.317 fused_ordering(26) 00:14:57.317 fused_ordering(27) 00:14:57.317 fused_ordering(28) 00:14:57.317 fused_ordering(29) 00:14:57.317 fused_ordering(30) 00:14:57.317 fused_ordering(31) 00:14:57.317 fused_ordering(32) 00:14:57.317 fused_ordering(33) 00:14:57.317 fused_ordering(34) 00:14:57.317 fused_ordering(35) 00:14:57.317 fused_ordering(36) 00:14:57.317 fused_ordering(37) 00:14:57.317 fused_ordering(38) 00:14:57.317 fused_ordering(39) 00:14:57.317 fused_ordering(40) 00:14:57.317 fused_ordering(41) 00:14:57.317 fused_ordering(42) 00:14:57.317 fused_ordering(43) 00:14:57.317 fused_ordering(44) 00:14:57.317 fused_ordering(45) 00:14:57.317 fused_ordering(46) 00:14:57.317 fused_ordering(47) 00:14:57.317 fused_ordering(48) 00:14:57.317 fused_ordering(49) 00:14:57.317 fused_ordering(50) 00:14:57.317 fused_ordering(51) 00:14:57.317 fused_ordering(52) 00:14:57.317 fused_ordering(53) 00:14:57.317 fused_ordering(54) 00:14:57.317 fused_ordering(55) 00:14:57.317 fused_ordering(56) 00:14:57.317 fused_ordering(57) 00:14:57.317 fused_ordering(58) 00:14:57.317 fused_ordering(59) 00:14:57.317 fused_ordering(60) 00:14:57.317 fused_ordering(61) 00:14:57.317 fused_ordering(62) 00:14:57.317 fused_ordering(63) 00:14:57.317 fused_ordering(64) 00:14:57.317 fused_ordering(65) 00:14:57.317 fused_ordering(66) 00:14:57.317 fused_ordering(67) 00:14:57.317 fused_ordering(68) 00:14:57.317 fused_ordering(69) 00:14:57.317 fused_ordering(70) 00:14:57.317 fused_ordering(71) 00:14:57.317 fused_ordering(72) 00:14:57.317 fused_ordering(73) 00:14:57.317 fused_ordering(74) 00:14:57.317 fused_ordering(75) 00:14:57.317 fused_ordering(76) 00:14:57.317 fused_ordering(77) 00:14:57.317 fused_ordering(78) 00:14:57.317 fused_ordering(79) 00:14:57.317 fused_ordering(80) 00:14:57.317 fused_ordering(81) 00:14:57.317 fused_ordering(82) 00:14:57.317 fused_ordering(83) 00:14:57.317 fused_ordering(84) 00:14:57.317 fused_ordering(85) 00:14:57.317 fused_ordering(86) 00:14:57.317 fused_ordering(87) 00:14:57.317 fused_ordering(88) 00:14:57.317 fused_ordering(89) 00:14:57.317 fused_ordering(90) 00:14:57.317 fused_ordering(91) 00:14:57.317 fused_ordering(92) 00:14:57.317 fused_ordering(93) 00:14:57.317 fused_ordering(94) 00:14:57.317 fused_ordering(95) 00:14:57.317 fused_ordering(96) 00:14:57.317 fused_ordering(97) 00:14:57.317 fused_ordering(98) 00:14:57.317 fused_ordering(99) 00:14:57.317 fused_ordering(100) 00:14:57.317 fused_ordering(101) 00:14:57.317 fused_ordering(102) 00:14:57.317 fused_ordering(103) 00:14:57.317 fused_ordering(104) 00:14:57.317 fused_ordering(105) 00:14:57.317 fused_ordering(106) 00:14:57.317 fused_ordering(107) 00:14:57.317 fused_ordering(108) 00:14:57.317 fused_ordering(109) 00:14:57.317 fused_ordering(110) 00:14:57.317 fused_ordering(111) 00:14:57.317 fused_ordering(112) 00:14:57.317 fused_ordering(113) 00:14:57.317 fused_ordering(114) 00:14:57.317 fused_ordering(115) 00:14:57.317 fused_ordering(116) 00:14:57.317 fused_ordering(117) 00:14:57.317 fused_ordering(118) 00:14:57.317 fused_ordering(119) 00:14:57.317 fused_ordering(120) 00:14:57.317 fused_ordering(121) 00:14:57.317 fused_ordering(122) 00:14:57.317 fused_ordering(123) 00:14:57.317 fused_ordering(124) 00:14:57.317 fused_ordering(125) 00:14:57.317 fused_ordering(126) 00:14:57.317 fused_ordering(127) 00:14:57.317 fused_ordering(128) 00:14:57.317 fused_ordering(129) 00:14:57.317 fused_ordering(130) 00:14:57.317 fused_ordering(131) 00:14:57.317 fused_ordering(132) 00:14:57.317 fused_ordering(133) 00:14:57.317 fused_ordering(134) 00:14:57.317 fused_ordering(135) 00:14:57.317 fused_ordering(136) 00:14:57.317 fused_ordering(137) 00:14:57.317 fused_ordering(138) 00:14:57.317 fused_ordering(139) 00:14:57.317 fused_ordering(140) 00:14:57.317 fused_ordering(141) 00:14:57.317 fused_ordering(142) 00:14:57.317 fused_ordering(143) 00:14:57.317 fused_ordering(144) 00:14:57.317 fused_ordering(145) 00:14:57.317 fused_ordering(146) 00:14:57.317 fused_ordering(147) 00:14:57.317 fused_ordering(148) 00:14:57.317 fused_ordering(149) 00:14:57.317 fused_ordering(150) 00:14:57.317 fused_ordering(151) 00:14:57.317 fused_ordering(152) 00:14:57.317 fused_ordering(153) 00:14:57.317 fused_ordering(154) 00:14:57.317 fused_ordering(155) 00:14:57.317 fused_ordering(156) 00:14:57.318 fused_ordering(157) 00:14:57.318 fused_ordering(158) 00:14:57.318 fused_ordering(159) 00:14:57.318 fused_ordering(160) 00:14:57.318 fused_ordering(161) 00:14:57.318 fused_ordering(162) 00:14:57.318 fused_ordering(163) 00:14:57.318 fused_ordering(164) 00:14:57.318 fused_ordering(165) 00:14:57.318 fused_ordering(166) 00:14:57.318 fused_ordering(167) 00:14:57.318 fused_ordering(168) 00:14:57.318 fused_ordering(169) 00:14:57.318 fused_ordering(170) 00:14:57.318 fused_ordering(171) 00:14:57.318 fused_ordering(172) 00:14:57.318 fused_ordering(173) 00:14:57.318 fused_ordering(174) 00:14:57.318 fused_ordering(175) 00:14:57.318 fused_ordering(176) 00:14:57.318 fused_ordering(177) 00:14:57.318 fused_ordering(178) 00:14:57.318 fused_ordering(179) 00:14:57.318 fused_ordering(180) 00:14:57.318 fused_ordering(181) 00:14:57.318 fused_ordering(182) 00:14:57.318 fused_ordering(183) 00:14:57.318 fused_ordering(184) 00:14:57.318 fused_ordering(185) 00:14:57.318 fused_ordering(186) 00:14:57.318 fused_ordering(187) 00:14:57.318 fused_ordering(188) 00:14:57.318 fused_ordering(189) 00:14:57.318 fused_ordering(190) 00:14:57.318 fused_ordering(191) 00:14:57.318 fused_ordering(192) 00:14:57.318 fused_ordering(193) 00:14:57.318 fused_ordering(194) 00:14:57.318 fused_ordering(195) 00:14:57.318 fused_ordering(196) 00:14:57.318 fused_ordering(197) 00:14:57.318 fused_ordering(198) 00:14:57.318 fused_ordering(199) 00:14:57.318 fused_ordering(200) 00:14:57.318 fused_ordering(201) 00:14:57.318 fused_ordering(202) 00:14:57.318 fused_ordering(203) 00:14:57.318 fused_ordering(204) 00:14:57.318 fused_ordering(205) 00:14:57.575 fused_ordering(206) 00:14:57.575 fused_ordering(207) 00:14:57.575 fused_ordering(208) 00:14:57.575 fused_ordering(209) 00:14:57.575 fused_ordering(210) 00:14:57.575 fused_ordering(211) 00:14:57.575 fused_ordering(212) 00:14:57.575 fused_ordering(213) 00:14:57.575 fused_ordering(214) 00:14:57.575 fused_ordering(215) 00:14:57.575 fused_ordering(216) 00:14:57.575 fused_ordering(217) 00:14:57.575 fused_ordering(218) 00:14:57.575 fused_ordering(219) 00:14:57.575 fused_ordering(220) 00:14:57.575 fused_ordering(221) 00:14:57.575 fused_ordering(222) 00:14:57.575 fused_ordering(223) 00:14:57.575 fused_ordering(224) 00:14:57.575 fused_ordering(225) 00:14:57.576 fused_ordering(226) 00:14:57.576 fused_ordering(227) 00:14:57.576 fused_ordering(228) 00:14:57.576 fused_ordering(229) 00:14:57.576 fused_ordering(230) 00:14:57.576 fused_ordering(231) 00:14:57.576 fused_ordering(232) 00:14:57.576 fused_ordering(233) 00:14:57.576 fused_ordering(234) 00:14:57.576 fused_ordering(235) 00:14:57.576 fused_ordering(236) 00:14:57.576 fused_ordering(237) 00:14:57.576 fused_ordering(238) 00:14:57.576 fused_ordering(239) 00:14:57.576 fused_ordering(240) 00:14:57.576 fused_ordering(241) 00:14:57.576 fused_ordering(242) 00:14:57.576 fused_ordering(243) 00:14:57.576 fused_ordering(244) 00:14:57.576 fused_ordering(245) 00:14:57.576 fused_ordering(246) 00:14:57.576 fused_ordering(247) 00:14:57.576 fused_ordering(248) 00:14:57.576 fused_ordering(249) 00:14:57.576 fused_ordering(250) 00:14:57.576 fused_ordering(251) 00:14:57.576 fused_ordering(252) 00:14:57.576 fused_ordering(253) 00:14:57.576 fused_ordering(254) 00:14:57.576 fused_ordering(255) 00:14:57.576 fused_ordering(256) 00:14:57.576 fused_ordering(257) 00:14:57.576 fused_ordering(258) 00:14:57.576 fused_ordering(259) 00:14:57.576 fused_ordering(260) 00:14:57.576 fused_ordering(261) 00:14:57.576 fused_ordering(262) 00:14:57.576 fused_ordering(263) 00:14:57.576 fused_ordering(264) 00:14:57.576 fused_ordering(265) 00:14:57.576 fused_ordering(266) 00:14:57.576 fused_ordering(267) 00:14:57.576 fused_ordering(268) 00:14:57.576 fused_ordering(269) 00:14:57.576 fused_ordering(270) 00:14:57.576 fused_ordering(271) 00:14:57.576 fused_ordering(272) 00:14:57.576 fused_ordering(273) 00:14:57.576 fused_ordering(274) 00:14:57.576 fused_ordering(275) 00:14:57.576 fused_ordering(276) 00:14:57.576 fused_ordering(277) 00:14:57.576 fused_ordering(278) 00:14:57.576 fused_ordering(279) 00:14:57.576 fused_ordering(280) 00:14:57.576 fused_ordering(281) 00:14:57.576 fused_ordering(282) 00:14:57.576 fused_ordering(283) 00:14:57.576 fused_ordering(284) 00:14:57.576 fused_ordering(285) 00:14:57.576 fused_ordering(286) 00:14:57.576 fused_ordering(287) 00:14:57.576 fused_ordering(288) 00:14:57.576 fused_ordering(289) 00:14:57.576 fused_ordering(290) 00:14:57.576 fused_ordering(291) 00:14:57.576 fused_ordering(292) 00:14:57.576 fused_ordering(293) 00:14:57.576 fused_ordering(294) 00:14:57.576 fused_ordering(295) 00:14:57.576 fused_ordering(296) 00:14:57.576 fused_ordering(297) 00:14:57.576 fused_ordering(298) 00:14:57.576 fused_ordering(299) 00:14:57.576 fused_ordering(300) 00:14:57.576 fused_ordering(301) 00:14:57.576 fused_ordering(302) 00:14:57.576 fused_ordering(303) 00:14:57.576 fused_ordering(304) 00:14:57.576 fused_ordering(305) 00:14:57.576 fused_ordering(306) 00:14:57.576 fused_ordering(307) 00:14:57.576 fused_ordering(308) 00:14:57.576 fused_ordering(309) 00:14:57.576 fused_ordering(310) 00:14:57.576 fused_ordering(311) 00:14:57.576 fused_ordering(312) 00:14:57.576 fused_ordering(313) 00:14:57.576 fused_ordering(314) 00:14:57.576 fused_ordering(315) 00:14:57.576 fused_ordering(316) 00:14:57.576 fused_ordering(317) 00:14:57.576 fused_ordering(318) 00:14:57.576 fused_ordering(319) 00:14:57.576 fused_ordering(320) 00:14:57.576 fused_ordering(321) 00:14:57.576 fused_ordering(322) 00:14:57.576 fused_ordering(323) 00:14:57.576 fused_ordering(324) 00:14:57.576 fused_ordering(325) 00:14:57.576 fused_ordering(326) 00:14:57.576 fused_ordering(327) 00:14:57.576 fused_ordering(328) 00:14:57.576 fused_ordering(329) 00:14:57.576 fused_ordering(330) 00:14:57.576 fused_ordering(331) 00:14:57.576 fused_ordering(332) 00:14:57.576 fused_ordering(333) 00:14:57.576 fused_ordering(334) 00:14:57.576 fused_ordering(335) 00:14:57.576 fused_ordering(336) 00:14:57.576 fused_ordering(337) 00:14:57.576 fused_ordering(338) 00:14:57.576 fused_ordering(339) 00:14:57.576 fused_ordering(340) 00:14:57.576 fused_ordering(341) 00:14:57.576 fused_ordering(342) 00:14:57.576 fused_ordering(343) 00:14:57.576 fused_ordering(344) 00:14:57.576 fused_ordering(345) 00:14:57.576 fused_ordering(346) 00:14:57.576 fused_ordering(347) 00:14:57.576 fused_ordering(348) 00:14:57.576 fused_ordering(349) 00:14:57.576 fused_ordering(350) 00:14:57.576 fused_ordering(351) 00:14:57.576 fused_ordering(352) 00:14:57.576 fused_ordering(353) 00:14:57.576 fused_ordering(354) 00:14:57.576 fused_ordering(355) 00:14:57.576 fused_ordering(356) 00:14:57.576 fused_ordering(357) 00:14:57.576 fused_ordering(358) 00:14:57.576 fused_ordering(359) 00:14:57.576 fused_ordering(360) 00:14:57.576 fused_ordering(361) 00:14:57.576 fused_ordering(362) 00:14:57.576 fused_ordering(363) 00:14:57.576 fused_ordering(364) 00:14:57.576 fused_ordering(365) 00:14:57.576 fused_ordering(366) 00:14:57.576 fused_ordering(367) 00:14:57.576 fused_ordering(368) 00:14:57.576 fused_ordering(369) 00:14:57.576 fused_ordering(370) 00:14:57.576 fused_ordering(371) 00:14:57.576 fused_ordering(372) 00:14:57.576 fused_ordering(373) 00:14:57.576 fused_ordering(374) 00:14:57.576 fused_ordering(375) 00:14:57.576 fused_ordering(376) 00:14:57.576 fused_ordering(377) 00:14:57.576 fused_ordering(378) 00:14:57.576 fused_ordering(379) 00:14:57.576 fused_ordering(380) 00:14:57.576 fused_ordering(381) 00:14:57.576 fused_ordering(382) 00:14:57.576 fused_ordering(383) 00:14:57.576 fused_ordering(384) 00:14:57.576 fused_ordering(385) 00:14:57.576 fused_ordering(386) 00:14:57.576 fused_ordering(387) 00:14:57.576 fused_ordering(388) 00:14:57.576 fused_ordering(389) 00:14:57.576 fused_ordering(390) 00:14:57.576 fused_ordering(391) 00:14:57.576 fused_ordering(392) 00:14:57.576 fused_ordering(393) 00:14:57.576 fused_ordering(394) 00:14:57.576 fused_ordering(395) 00:14:57.576 fused_ordering(396) 00:14:57.576 fused_ordering(397) 00:14:57.576 fused_ordering(398) 00:14:57.576 fused_ordering(399) 00:14:57.576 fused_ordering(400) 00:14:57.576 fused_ordering(401) 00:14:57.576 fused_ordering(402) 00:14:57.576 fused_ordering(403) 00:14:57.576 fused_ordering(404) 00:14:57.576 fused_ordering(405) 00:14:57.576 fused_ordering(406) 00:14:57.576 fused_ordering(407) 00:14:57.576 fused_ordering(408) 00:14:57.576 fused_ordering(409) 00:14:57.576 fused_ordering(410) 00:14:58.142 fused_ordering(411) 00:14:58.142 fused_ordering(412) 00:14:58.142 fused_ordering(413) 00:14:58.142 fused_ordering(414) 00:14:58.142 fused_ordering(415) 00:14:58.142 fused_ordering(416) 00:14:58.142 fused_ordering(417) 00:14:58.142 fused_ordering(418) 00:14:58.142 fused_ordering(419) 00:14:58.142 fused_ordering(420) 00:14:58.142 fused_ordering(421) 00:14:58.142 fused_ordering(422) 00:14:58.142 fused_ordering(423) 00:14:58.142 fused_ordering(424) 00:14:58.142 fused_ordering(425) 00:14:58.142 fused_ordering(426) 00:14:58.142 fused_ordering(427) 00:14:58.142 fused_ordering(428) 00:14:58.142 fused_ordering(429) 00:14:58.142 fused_ordering(430) 00:14:58.142 fused_ordering(431) 00:14:58.142 fused_ordering(432) 00:14:58.142 fused_ordering(433) 00:14:58.142 fused_ordering(434) 00:14:58.142 fused_ordering(435) 00:14:58.142 fused_ordering(436) 00:14:58.142 fused_ordering(437) 00:14:58.142 fused_ordering(438) 00:14:58.142 fused_ordering(439) 00:14:58.142 fused_ordering(440) 00:14:58.142 fused_ordering(441) 00:14:58.142 fused_ordering(442) 00:14:58.142 fused_ordering(443) 00:14:58.142 fused_ordering(444) 00:14:58.142 fused_ordering(445) 00:14:58.142 fused_ordering(446) 00:14:58.142 fused_ordering(447) 00:14:58.142 fused_ordering(448) 00:14:58.142 fused_ordering(449) 00:14:58.142 fused_ordering(450) 00:14:58.142 fused_ordering(451) 00:14:58.142 fused_ordering(452) 00:14:58.142 fused_ordering(453) 00:14:58.142 fused_ordering(454) 00:14:58.142 fused_ordering(455) 00:14:58.142 fused_ordering(456) 00:14:58.142 fused_ordering(457) 00:14:58.142 fused_ordering(458) 00:14:58.142 fused_ordering(459) 00:14:58.142 fused_ordering(460) 00:14:58.142 fused_ordering(461) 00:14:58.142 fused_ordering(462) 00:14:58.142 fused_ordering(463) 00:14:58.142 fused_ordering(464) 00:14:58.142 fused_ordering(465) 00:14:58.142 fused_ordering(466) 00:14:58.142 fused_ordering(467) 00:14:58.142 fused_ordering(468) 00:14:58.142 fused_ordering(469) 00:14:58.142 fused_ordering(470) 00:14:58.142 fused_ordering(471) 00:14:58.142 fused_ordering(472) 00:14:58.142 fused_ordering(473) 00:14:58.142 fused_ordering(474) 00:14:58.142 fused_ordering(475) 00:14:58.142 fused_ordering(476) 00:14:58.142 fused_ordering(477) 00:14:58.142 fused_ordering(478) 00:14:58.142 fused_ordering(479) 00:14:58.142 fused_ordering(480) 00:14:58.142 fused_ordering(481) 00:14:58.142 fused_ordering(482) 00:14:58.142 fused_ordering(483) 00:14:58.142 fused_ordering(484) 00:14:58.142 fused_ordering(485) 00:14:58.142 fused_ordering(486) 00:14:58.142 fused_ordering(487) 00:14:58.142 fused_ordering(488) 00:14:58.142 fused_ordering(489) 00:14:58.142 fused_ordering(490) 00:14:58.142 fused_ordering(491) 00:14:58.142 fused_ordering(492) 00:14:58.142 fused_ordering(493) 00:14:58.142 fused_ordering(494) 00:14:58.142 fused_ordering(495) 00:14:58.142 fused_ordering(496) 00:14:58.142 fused_ordering(497) 00:14:58.142 fused_ordering(498) 00:14:58.142 fused_ordering(499) 00:14:58.142 fused_ordering(500) 00:14:58.142 fused_ordering(501) 00:14:58.142 fused_ordering(502) 00:14:58.142 fused_ordering(503) 00:14:58.142 fused_ordering(504) 00:14:58.142 fused_ordering(505) 00:14:58.142 fused_ordering(506) 00:14:58.142 fused_ordering(507) 00:14:58.142 fused_ordering(508) 00:14:58.142 fused_ordering(509) 00:14:58.142 fused_ordering(510) 00:14:58.142 fused_ordering(511) 00:14:58.142 fused_ordering(512) 00:14:58.142 fused_ordering(513) 00:14:58.142 fused_ordering(514) 00:14:58.142 fused_ordering(515) 00:14:58.142 fused_ordering(516) 00:14:58.142 fused_ordering(517) 00:14:58.142 fused_ordering(518) 00:14:58.142 fused_ordering(519) 00:14:58.142 fused_ordering(520) 00:14:58.142 fused_ordering(521) 00:14:58.142 fused_ordering(522) 00:14:58.142 fused_ordering(523) 00:14:58.142 fused_ordering(524) 00:14:58.142 fused_ordering(525) 00:14:58.142 fused_ordering(526) 00:14:58.142 fused_ordering(527) 00:14:58.142 fused_ordering(528) 00:14:58.142 fused_ordering(529) 00:14:58.142 fused_ordering(530) 00:14:58.142 fused_ordering(531) 00:14:58.142 fused_ordering(532) 00:14:58.142 fused_ordering(533) 00:14:58.142 fused_ordering(534) 00:14:58.142 fused_ordering(535) 00:14:58.142 fused_ordering(536) 00:14:58.142 fused_ordering(537) 00:14:58.142 fused_ordering(538) 00:14:58.142 fused_ordering(539) 00:14:58.142 fused_ordering(540) 00:14:58.142 fused_ordering(541) 00:14:58.142 fused_ordering(542) 00:14:58.142 fused_ordering(543) 00:14:58.142 fused_ordering(544) 00:14:58.142 fused_ordering(545) 00:14:58.142 fused_ordering(546) 00:14:58.142 fused_ordering(547) 00:14:58.142 fused_ordering(548) 00:14:58.142 fused_ordering(549) 00:14:58.142 fused_ordering(550) 00:14:58.142 fused_ordering(551) 00:14:58.142 fused_ordering(552) 00:14:58.142 fused_ordering(553) 00:14:58.142 fused_ordering(554) 00:14:58.142 fused_ordering(555) 00:14:58.142 fused_ordering(556) 00:14:58.142 fused_ordering(557) 00:14:58.142 fused_ordering(558) 00:14:58.142 fused_ordering(559) 00:14:58.142 fused_ordering(560) 00:14:58.142 fused_ordering(561) 00:14:58.142 fused_ordering(562) 00:14:58.142 fused_ordering(563) 00:14:58.142 fused_ordering(564) 00:14:58.142 fused_ordering(565) 00:14:58.142 fused_ordering(566) 00:14:58.142 fused_ordering(567) 00:14:58.142 fused_ordering(568) 00:14:58.142 fused_ordering(569) 00:14:58.142 fused_ordering(570) 00:14:58.142 fused_ordering(571) 00:14:58.142 fused_ordering(572) 00:14:58.142 fused_ordering(573) 00:14:58.142 fused_ordering(574) 00:14:58.142 fused_ordering(575) 00:14:58.143 fused_ordering(576) 00:14:58.143 fused_ordering(577) 00:14:58.143 fused_ordering(578) 00:14:58.143 fused_ordering(579) 00:14:58.143 fused_ordering(580) 00:14:58.143 fused_ordering(581) 00:14:58.143 fused_ordering(582) 00:14:58.143 fused_ordering(583) 00:14:58.143 fused_ordering(584) 00:14:58.143 fused_ordering(585) 00:14:58.143 fused_ordering(586) 00:14:58.143 fused_ordering(587) 00:14:58.143 fused_ordering(588) 00:14:58.143 fused_ordering(589) 00:14:58.143 fused_ordering(590) 00:14:58.143 fused_ordering(591) 00:14:58.143 fused_ordering(592) 00:14:58.143 fused_ordering(593) 00:14:58.143 fused_ordering(594) 00:14:58.143 fused_ordering(595) 00:14:58.143 fused_ordering(596) 00:14:58.143 fused_ordering(597) 00:14:58.143 fused_ordering(598) 00:14:58.143 fused_ordering(599) 00:14:58.143 fused_ordering(600) 00:14:58.143 fused_ordering(601) 00:14:58.143 fused_ordering(602) 00:14:58.143 fused_ordering(603) 00:14:58.143 fused_ordering(604) 00:14:58.143 fused_ordering(605) 00:14:58.143 fused_ordering(606) 00:14:58.143 fused_ordering(607) 00:14:58.143 fused_ordering(608) 00:14:58.143 fused_ordering(609) 00:14:58.143 fused_ordering(610) 00:14:58.143 fused_ordering(611) 00:14:58.143 fused_ordering(612) 00:14:58.143 fused_ordering(613) 00:14:58.143 fused_ordering(614) 00:14:58.143 fused_ordering(615) 00:14:58.708 fused_ordering(616) 00:14:58.708 fused_ordering(617) 00:14:58.708 fused_ordering(618) 00:14:58.708 fused_ordering(619) 00:14:58.708 fused_ordering(620) 00:14:58.708 fused_ordering(621) 00:14:58.708 fused_ordering(622) 00:14:58.708 fused_ordering(623) 00:14:58.708 fused_ordering(624) 00:14:58.708 fused_ordering(625) 00:14:58.708 fused_ordering(626) 00:14:58.708 fused_ordering(627) 00:14:58.708 fused_ordering(628) 00:14:58.708 fused_ordering(629) 00:14:58.708 fused_ordering(630) 00:14:58.708 fused_ordering(631) 00:14:58.708 fused_ordering(632) 00:14:58.708 fused_ordering(633) 00:14:58.708 fused_ordering(634) 00:14:58.708 fused_ordering(635) 00:14:58.708 fused_ordering(636) 00:14:58.708 fused_ordering(637) 00:14:58.708 fused_ordering(638) 00:14:58.708 fused_ordering(639) 00:14:58.709 fused_ordering(640) 00:14:58.709 fused_ordering(641) 00:14:58.709 fused_ordering(642) 00:14:58.709 fused_ordering(643) 00:14:58.709 fused_ordering(644) 00:14:58.709 fused_ordering(645) 00:14:58.709 fused_ordering(646) 00:14:58.709 fused_ordering(647) 00:14:58.709 fused_ordering(648) 00:14:58.709 fused_ordering(649) 00:14:58.709 fused_ordering(650) 00:14:58.709 fused_ordering(651) 00:14:58.709 fused_ordering(652) 00:14:58.709 fused_ordering(653) 00:14:58.709 fused_ordering(654) 00:14:58.709 fused_ordering(655) 00:14:58.709 fused_ordering(656) 00:14:58.709 fused_ordering(657) 00:14:58.709 fused_ordering(658) 00:14:58.709 fused_ordering(659) 00:14:58.709 fused_ordering(660) 00:14:58.709 fused_ordering(661) 00:14:58.709 fused_ordering(662) 00:14:58.709 fused_ordering(663) 00:14:58.709 fused_ordering(664) 00:14:58.709 fused_ordering(665) 00:14:58.709 fused_ordering(666) 00:14:58.709 fused_ordering(667) 00:14:58.709 fused_ordering(668) 00:14:58.709 fused_ordering(669) 00:14:58.709 fused_ordering(670) 00:14:58.709 fused_ordering(671) 00:14:58.709 fused_ordering(672) 00:14:58.709 fused_ordering(673) 00:14:58.709 fused_ordering(674) 00:14:58.709 fused_ordering(675) 00:14:58.709 fused_ordering(676) 00:14:58.709 fused_ordering(677) 00:14:58.709 fused_ordering(678) 00:14:58.709 fused_ordering(679) 00:14:58.709 fused_ordering(680) 00:14:58.709 fused_ordering(681) 00:14:58.709 fused_ordering(682) 00:14:58.709 fused_ordering(683) 00:14:58.709 fused_ordering(684) 00:14:58.709 fused_ordering(685) 00:14:58.709 fused_ordering(686) 00:14:58.709 fused_ordering(687) 00:14:58.709 fused_ordering(688) 00:14:58.709 fused_ordering(689) 00:14:58.709 fused_ordering(690) 00:14:58.709 fused_ordering(691) 00:14:58.709 fused_ordering(692) 00:14:58.709 fused_ordering(693) 00:14:58.709 fused_ordering(694) 00:14:58.709 fused_ordering(695) 00:14:58.709 fused_ordering(696) 00:14:58.709 fused_ordering(697) 00:14:58.709 fused_ordering(698) 00:14:58.709 fused_ordering(699) 00:14:58.709 fused_ordering(700) 00:14:58.709 fused_ordering(701) 00:14:58.709 fused_ordering(702) 00:14:58.709 fused_ordering(703) 00:14:58.709 fused_ordering(704) 00:14:58.709 fused_ordering(705) 00:14:58.709 fused_ordering(706) 00:14:58.709 fused_ordering(707) 00:14:58.709 fused_ordering(708) 00:14:58.709 fused_ordering(709) 00:14:58.709 fused_ordering(710) 00:14:58.709 fused_ordering(711) 00:14:58.709 fused_ordering(712) 00:14:58.709 fused_ordering(713) 00:14:58.709 fused_ordering(714) 00:14:58.709 fused_ordering(715) 00:14:58.709 fused_ordering(716) 00:14:58.709 fused_ordering(717) 00:14:58.709 fused_ordering(718) 00:14:58.709 fused_ordering(719) 00:14:58.709 fused_ordering(720) 00:14:58.709 fused_ordering(721) 00:14:58.709 fused_ordering(722) 00:14:58.709 fused_ordering(723) 00:14:58.709 fused_ordering(724) 00:14:58.709 fused_ordering(725) 00:14:58.709 fused_ordering(726) 00:14:58.709 fused_ordering(727) 00:14:58.709 fused_ordering(728) 00:14:58.709 fused_ordering(729) 00:14:58.709 fused_ordering(730) 00:14:58.709 fused_ordering(731) 00:14:58.709 fused_ordering(732) 00:14:58.709 fused_ordering(733) 00:14:58.709 fused_ordering(734) 00:14:58.709 fused_ordering(735) 00:14:58.709 fused_ordering(736) 00:14:58.709 fused_ordering(737) 00:14:58.709 fused_ordering(738) 00:14:58.709 fused_ordering(739) 00:14:58.709 fused_ordering(740) 00:14:58.709 fused_ordering(741) 00:14:58.709 fused_ordering(742) 00:14:58.709 fused_ordering(743) 00:14:58.709 fused_ordering(744) 00:14:58.709 fused_ordering(745) 00:14:58.709 fused_ordering(746) 00:14:58.709 fused_ordering(747) 00:14:58.709 fused_ordering(748) 00:14:58.709 fused_ordering(749) 00:14:58.709 fused_ordering(750) 00:14:58.709 fused_ordering(751) 00:14:58.709 fused_ordering(752) 00:14:58.709 fused_ordering(753) 00:14:58.709 fused_ordering(754) 00:14:58.709 fused_ordering(755) 00:14:58.709 fused_ordering(756) 00:14:58.709 fused_ordering(757) 00:14:58.709 fused_ordering(758) 00:14:58.709 fused_ordering(759) 00:14:58.709 fused_ordering(760) 00:14:58.709 fused_ordering(761) 00:14:58.709 fused_ordering(762) 00:14:58.709 fused_ordering(763) 00:14:58.709 fused_ordering(764) 00:14:58.709 fused_ordering(765) 00:14:58.709 fused_ordering(766) 00:14:58.709 fused_ordering(767) 00:14:58.709 fused_ordering(768) 00:14:58.709 fused_ordering(769) 00:14:58.709 fused_ordering(770) 00:14:58.709 fused_ordering(771) 00:14:58.709 fused_ordering(772) 00:14:58.709 fused_ordering(773) 00:14:58.709 fused_ordering(774) 00:14:58.709 fused_ordering(775) 00:14:58.709 fused_ordering(776) 00:14:58.709 fused_ordering(777) 00:14:58.709 fused_ordering(778) 00:14:58.709 fused_ordering(779) 00:14:58.709 fused_ordering(780) 00:14:58.709 fused_ordering(781) 00:14:58.709 fused_ordering(782) 00:14:58.709 fused_ordering(783) 00:14:58.709 fused_ordering(784) 00:14:58.709 fused_ordering(785) 00:14:58.709 fused_ordering(786) 00:14:58.709 fused_ordering(787) 00:14:58.709 fused_ordering(788) 00:14:58.709 fused_ordering(789) 00:14:58.709 fused_ordering(790) 00:14:58.709 fused_ordering(791) 00:14:58.709 fused_ordering(792) 00:14:58.709 fused_ordering(793) 00:14:58.709 fused_ordering(794) 00:14:58.709 fused_ordering(795) 00:14:58.709 fused_ordering(796) 00:14:58.709 fused_ordering(797) 00:14:58.709 fused_ordering(798) 00:14:58.709 fused_ordering(799) 00:14:58.709 fused_ordering(800) 00:14:58.709 fused_ordering(801) 00:14:58.709 fused_ordering(802) 00:14:58.709 fused_ordering(803) 00:14:58.709 fused_ordering(804) 00:14:58.709 fused_ordering(805) 00:14:58.709 fused_ordering(806) 00:14:58.709 fused_ordering(807) 00:14:58.709 fused_ordering(808) 00:14:58.709 fused_ordering(809) 00:14:58.709 fused_ordering(810) 00:14:58.709 fused_ordering(811) 00:14:58.709 fused_ordering(812) 00:14:58.709 fused_ordering(813) 00:14:58.709 fused_ordering(814) 00:14:58.709 fused_ordering(815) 00:14:58.709 fused_ordering(816) 00:14:58.709 fused_ordering(817) 00:14:58.709 fused_ordering(818) 00:14:58.709 fused_ordering(819) 00:14:58.709 fused_ordering(820) 00:14:59.275 fused_ordering(821) 00:14:59.275 fused_ordering(822) 00:14:59.275 fused_ordering(823) 00:14:59.275 fused_ordering(824) 00:14:59.275 fused_ordering(825) 00:14:59.275 fused_ordering(826) 00:14:59.275 fused_ordering(827) 00:14:59.275 fused_ordering(828) 00:14:59.275 fused_ordering(829) 00:14:59.275 fused_ordering(830) 00:14:59.275 fused_ordering(831) 00:14:59.275 fused_ordering(832) 00:14:59.275 fused_ordering(833) 00:14:59.275 fused_ordering(834) 00:14:59.275 fused_ordering(835) 00:14:59.275 fused_ordering(836) 00:14:59.275 fused_ordering(837) 00:14:59.275 fused_ordering(838) 00:14:59.275 fused_ordering(839) 00:14:59.275 fused_ordering(840) 00:14:59.275 fused_ordering(841) 00:14:59.275 fused_ordering(842) 00:14:59.275 fused_ordering(843) 00:14:59.275 fused_ordering(844) 00:14:59.275 fused_ordering(845) 00:14:59.275 fused_ordering(846) 00:14:59.275 fused_ordering(847) 00:14:59.275 fused_ordering(848) 00:14:59.275 fused_ordering(849) 00:14:59.275 fused_ordering(850) 00:14:59.275 fused_ordering(851) 00:14:59.275 fused_ordering(852) 00:14:59.275 fused_ordering(853) 00:14:59.275 fused_ordering(854) 00:14:59.275 fused_ordering(855) 00:14:59.275 fused_ordering(856) 00:14:59.275 fused_ordering(857) 00:14:59.275 fused_ordering(858) 00:14:59.275 fused_ordering(859) 00:14:59.275 fused_ordering(860) 00:14:59.275 fused_ordering(861) 00:14:59.275 fused_ordering(862) 00:14:59.275 fused_ordering(863) 00:14:59.275 fused_ordering(864) 00:14:59.275 fused_ordering(865) 00:14:59.275 fused_ordering(866) 00:14:59.275 fused_ordering(867) 00:14:59.275 fused_ordering(868) 00:14:59.275 fused_ordering(869) 00:14:59.275 fused_ordering(870) 00:14:59.275 fused_ordering(871) 00:14:59.275 fused_ordering(872) 00:14:59.275 fused_ordering(873) 00:14:59.275 fused_ordering(874) 00:14:59.275 fused_ordering(875) 00:14:59.275 fused_ordering(876) 00:14:59.275 fused_ordering(877) 00:14:59.275 fused_ordering(878) 00:14:59.275 fused_ordering(879) 00:14:59.275 fused_ordering(880) 00:14:59.275 fused_ordering(881) 00:14:59.275 fused_ordering(882) 00:14:59.275 fused_ordering(883) 00:14:59.275 fused_ordering(884) 00:14:59.275 fused_ordering(885) 00:14:59.275 fused_ordering(886) 00:14:59.275 fused_ordering(887) 00:14:59.275 fused_ordering(888) 00:14:59.275 fused_ordering(889) 00:14:59.275 fused_ordering(890) 00:14:59.275 fused_ordering(891) 00:14:59.275 fused_ordering(892) 00:14:59.275 fused_ordering(893) 00:14:59.275 fused_ordering(894) 00:14:59.275 fused_ordering(895) 00:14:59.275 fused_ordering(896) 00:14:59.275 fused_ordering(897) 00:14:59.275 fused_ordering(898) 00:14:59.275 fused_ordering(899) 00:14:59.275 fused_ordering(900) 00:14:59.275 fused_ordering(901) 00:14:59.275 fused_ordering(902) 00:14:59.275 fused_ordering(903) 00:14:59.275 fused_ordering(904) 00:14:59.275 fused_ordering(905) 00:14:59.275 fused_ordering(906) 00:14:59.275 fused_ordering(907) 00:14:59.275 fused_ordering(908) 00:14:59.275 fused_ordering(909) 00:14:59.275 fused_ordering(910) 00:14:59.275 fused_ordering(911) 00:14:59.275 fused_ordering(912) 00:14:59.275 fused_ordering(913) 00:14:59.275 fused_ordering(914) 00:14:59.275 fused_ordering(915) 00:14:59.275 fused_ordering(916) 00:14:59.275 fused_ordering(917) 00:14:59.275 fused_ordering(918) 00:14:59.275 fused_ordering(919) 00:14:59.275 fused_ordering(920) 00:14:59.275 fused_ordering(921) 00:14:59.275 fused_ordering(922) 00:14:59.275 fused_ordering(923) 00:14:59.276 fused_ordering(924) 00:14:59.276 fused_ordering(925) 00:14:59.276 fused_ordering(926) 00:14:59.276 fused_ordering(927) 00:14:59.276 fused_ordering(928) 00:14:59.276 fused_ordering(929) 00:14:59.276 fused_ordering(930) 00:14:59.276 fused_ordering(931) 00:14:59.276 fused_ordering(932) 00:14:59.276 fused_ordering(933) 00:14:59.276 fused_ordering(934) 00:14:59.276 fused_ordering(935) 00:14:59.276 fused_ordering(936) 00:14:59.276 fused_ordering(937) 00:14:59.276 fused_ordering(938) 00:14:59.276 fused_ordering(939) 00:14:59.276 fused_ordering(940) 00:14:59.276 fused_ordering(941) 00:14:59.276 fused_ordering(942) 00:14:59.276 fused_ordering(943) 00:14:59.276 fused_ordering(944) 00:14:59.276 fused_ordering(945) 00:14:59.276 fused_ordering(946) 00:14:59.276 fused_ordering(947) 00:14:59.276 fused_ordering(948) 00:14:59.276 fused_ordering(949) 00:14:59.276 fused_ordering(950) 00:14:59.276 fused_ordering(951) 00:14:59.276 fused_ordering(952) 00:14:59.276 fused_ordering(953) 00:14:59.276 fused_ordering(954) 00:14:59.276 fused_ordering(955) 00:14:59.276 fused_ordering(956) 00:14:59.276 fused_ordering(957) 00:14:59.276 fused_ordering(958) 00:14:59.276 fused_ordering(959) 00:14:59.276 fused_ordering(960) 00:14:59.276 fused_ordering(961) 00:14:59.276 fused_ordering(962) 00:14:59.276 fused_ordering(963) 00:14:59.276 fused_ordering(964) 00:14:59.276 fused_ordering(965) 00:14:59.276 fused_ordering(966) 00:14:59.276 fused_ordering(967) 00:14:59.276 fused_ordering(968) 00:14:59.276 fused_ordering(969) 00:14:59.276 fused_ordering(970) 00:14:59.276 fused_ordering(971) 00:14:59.276 fused_ordering(972) 00:14:59.276 fused_ordering(973) 00:14:59.276 fused_ordering(974) 00:14:59.276 fused_ordering(975) 00:14:59.276 fused_ordering(976) 00:14:59.276 fused_ordering(977) 00:14:59.276 fused_ordering(978) 00:14:59.276 fused_ordering(979) 00:14:59.276 fused_ordering(980) 00:14:59.276 fused_ordering(981) 00:14:59.276 fused_ordering(982) 00:14:59.276 fused_ordering(983) 00:14:59.276 fused_ordering(984) 00:14:59.276 fused_ordering(985) 00:14:59.276 fused_ordering(986) 00:14:59.276 fused_ordering(987) 00:14:59.276 fused_ordering(988) 00:14:59.276 fused_ordering(989) 00:14:59.276 fused_ordering(990) 00:14:59.276 fused_ordering(991) 00:14:59.276 fused_ordering(992) 00:14:59.276 fused_ordering(993) 00:14:59.276 fused_ordering(994) 00:14:59.276 fused_ordering(995) 00:14:59.276 fused_ordering(996) 00:14:59.276 fused_ordering(997) 00:14:59.276 fused_ordering(998) 00:14:59.276 fused_ordering(999) 00:14:59.276 fused_ordering(1000) 00:14:59.276 fused_ordering(1001) 00:14:59.276 fused_ordering(1002) 00:14:59.276 fused_ordering(1003) 00:14:59.276 fused_ordering(1004) 00:14:59.276 fused_ordering(1005) 00:14:59.276 fused_ordering(1006) 00:14:59.276 fused_ordering(1007) 00:14:59.276 fused_ordering(1008) 00:14:59.276 fused_ordering(1009) 00:14:59.276 fused_ordering(1010) 00:14:59.276 fused_ordering(1011) 00:14:59.276 fused_ordering(1012) 00:14:59.276 fused_ordering(1013) 00:14:59.276 fused_ordering(1014) 00:14:59.276 fused_ordering(1015) 00:14:59.276 fused_ordering(1016) 00:14:59.276 fused_ordering(1017) 00:14:59.276 fused_ordering(1018) 00:14:59.276 fused_ordering(1019) 00:14:59.276 fused_ordering(1020) 00:14:59.276 fused_ordering(1021) 00:14:59.276 fused_ordering(1022) 00:14:59.276 fused_ordering(1023) 00:14:59.276 02:26:23 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:59.276 02:26:23 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:59.276 02:26:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:59.276 02:26:23 -- nvmf/common.sh@116 -- # sync 00:14:59.276 02:26:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:59.276 02:26:23 -- nvmf/common.sh@119 -- # set +e 00:14:59.276 02:26:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:59.276 02:26:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:59.276 rmmod nvme_tcp 00:14:59.276 rmmod nvme_fabrics 00:14:59.276 rmmod nvme_keyring 00:14:59.276 02:26:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:59.276 02:26:23 -- nvmf/common.sh@123 -- # set -e 00:14:59.276 02:26:23 -- nvmf/common.sh@124 -- # return 0 00:14:59.276 02:26:23 -- nvmf/common.sh@477 -- # '[' -n 2036044 ']' 00:14:59.276 02:26:23 -- nvmf/common.sh@478 -- # killprocess 2036044 00:14:59.276 02:26:23 -- common/autotest_common.sh@936 -- # '[' -z 2036044 ']' 00:14:59.276 02:26:23 -- common/autotest_common.sh@940 -- # kill -0 2036044 00:14:59.276 02:26:23 -- common/autotest_common.sh@941 -- # uname 00:14:59.276 02:26:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:59.276 02:26:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2036044 00:14:59.276 02:26:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:59.276 02:26:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:59.276 02:26:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2036044' 00:14:59.276 killing process with pid 2036044 00:14:59.276 02:26:23 -- common/autotest_common.sh@955 -- # kill 2036044 00:14:59.276 02:26:23 -- common/autotest_common.sh@960 -- # wait 2036044 00:14:59.534 02:26:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:59.535 02:26:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:59.535 02:26:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:59.535 02:26:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:59.535 02:26:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:59.535 02:26:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:59.535 02:26:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:59.535 02:26:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.069 02:26:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:02.069 00:15:02.069 real 0m8.332s 00:15:02.069 user 0m5.821s 00:15:02.069 sys 0m3.404s 00:15:02.069 02:26:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:02.069 02:26:26 -- common/autotest_common.sh@10 -- # set +x 00:15:02.069 ************************************ 00:15:02.069 END TEST nvmf_fused_ordering 00:15:02.069 ************************************ 00:15:02.069 02:26:26 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:02.069 02:26:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:02.069 02:26:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:02.069 02:26:26 -- common/autotest_common.sh@10 -- # set +x 00:15:02.069 ************************************ 00:15:02.069 START TEST nvmf_delete_subsystem 00:15:02.069 ************************************ 00:15:02.069 02:26:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:02.069 * Looking for test storage... 00:15:02.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:02.069 02:26:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:02.069 02:26:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:02.069 02:26:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:02.069 02:26:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:02.069 02:26:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:02.069 02:26:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:02.069 02:26:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:02.069 02:26:26 -- scripts/common.sh@335 -- # IFS=.-: 00:15:02.069 02:26:26 -- scripts/common.sh@335 -- # read -ra ver1 00:15:02.069 02:26:26 -- scripts/common.sh@336 -- # IFS=.-: 00:15:02.069 02:26:26 -- scripts/common.sh@336 -- # read -ra ver2 00:15:02.069 02:26:26 -- scripts/common.sh@337 -- # local 'op=<' 00:15:02.069 02:26:26 -- scripts/common.sh@339 -- # ver1_l=2 00:15:02.069 02:26:26 -- scripts/common.sh@340 -- # ver2_l=1 00:15:02.069 02:26:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:02.069 02:26:26 -- scripts/common.sh@343 -- # case "$op" in 00:15:02.069 02:26:26 -- scripts/common.sh@344 -- # : 1 00:15:02.069 02:26:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:02.069 02:26:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:02.069 02:26:26 -- scripts/common.sh@364 -- # decimal 1 00:15:02.069 02:26:26 -- scripts/common.sh@352 -- # local d=1 00:15:02.069 02:26:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:02.069 02:26:26 -- scripts/common.sh@354 -- # echo 1 00:15:02.069 02:26:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:02.069 02:26:26 -- scripts/common.sh@365 -- # decimal 2 00:15:02.069 02:26:26 -- scripts/common.sh@352 -- # local d=2 00:15:02.069 02:26:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:02.069 02:26:26 -- scripts/common.sh@354 -- # echo 2 00:15:02.069 02:26:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:02.069 02:26:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:02.069 02:26:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:02.069 02:26:26 -- scripts/common.sh@367 -- # return 0 00:15:02.069 02:26:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:02.069 02:26:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:02.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.069 --rc genhtml_branch_coverage=1 00:15:02.069 --rc genhtml_function_coverage=1 00:15:02.069 --rc genhtml_legend=1 00:15:02.069 --rc geninfo_all_blocks=1 00:15:02.069 --rc geninfo_unexecuted_blocks=1 00:15:02.069 00:15:02.069 ' 00:15:02.069 02:26:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:02.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.069 --rc genhtml_branch_coverage=1 00:15:02.069 --rc genhtml_function_coverage=1 00:15:02.069 --rc genhtml_legend=1 00:15:02.069 --rc geninfo_all_blocks=1 00:15:02.069 --rc geninfo_unexecuted_blocks=1 00:15:02.069 00:15:02.069 ' 00:15:02.070 02:26:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:02.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.070 --rc genhtml_branch_coverage=1 00:15:02.070 --rc genhtml_function_coverage=1 00:15:02.070 --rc genhtml_legend=1 00:15:02.070 --rc geninfo_all_blocks=1 00:15:02.070 --rc geninfo_unexecuted_blocks=1 00:15:02.070 00:15:02.070 ' 00:15:02.070 02:26:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:02.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.070 --rc genhtml_branch_coverage=1 00:15:02.070 --rc genhtml_function_coverage=1 00:15:02.070 --rc genhtml_legend=1 00:15:02.070 --rc geninfo_all_blocks=1 00:15:02.070 --rc geninfo_unexecuted_blocks=1 00:15:02.070 00:15:02.070 ' 00:15:02.070 02:26:26 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:02.070 02:26:26 -- nvmf/common.sh@7 -- # uname -s 00:15:02.070 02:26:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:02.070 02:26:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:02.070 02:26:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:02.070 02:26:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:02.070 02:26:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:02.070 02:26:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:02.070 02:26:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:02.070 02:26:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:02.070 02:26:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:02.070 02:26:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:02.070 02:26:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.070 02:26:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.070 02:26:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:02.070 02:26:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:02.070 02:26:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:02.070 02:26:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:02.070 02:26:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:02.070 02:26:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:02.070 02:26:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:02.070 02:26:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.070 02:26:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.070 02:26:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.070 02:26:26 -- paths/export.sh@5 -- # export PATH 00:15:02.070 02:26:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.070 02:26:26 -- nvmf/common.sh@46 -- # : 0 00:15:02.070 02:26:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:02.070 02:26:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:02.070 02:26:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:02.070 02:26:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:02.070 02:26:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:02.070 02:26:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:02.070 02:26:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:02.070 02:26:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:02.070 02:26:26 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:02.070 02:26:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:02.070 02:26:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:02.070 02:26:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:02.070 02:26:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:02.070 02:26:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:02.070 02:26:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.070 02:26:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.070 02:26:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.070 02:26:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:02.070 02:26:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:02.070 02:26:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:02.070 02:26:26 -- common/autotest_common.sh@10 -- # set +x 00:15:03.972 02:26:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:03.972 02:26:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:03.972 02:26:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:03.972 02:26:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:03.972 02:26:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:03.972 02:26:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:03.972 02:26:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:03.972 02:26:28 -- nvmf/common.sh@294 -- # net_devs=() 00:15:03.972 02:26:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:03.972 02:26:28 -- nvmf/common.sh@295 -- # e810=() 00:15:03.972 02:26:28 -- nvmf/common.sh@295 -- # local -ga e810 00:15:03.972 02:26:28 -- nvmf/common.sh@296 -- # x722=() 00:15:03.972 02:26:28 -- nvmf/common.sh@296 -- # local -ga x722 00:15:03.972 02:26:28 -- nvmf/common.sh@297 -- # mlx=() 00:15:03.972 02:26:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:03.972 02:26:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:03.972 02:26:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:03.972 02:26:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:03.972 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:03.972 02:26:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:03.972 02:26:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:03.972 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:03.972 02:26:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:03.972 02:26:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.972 02:26:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.972 02:26:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:03.972 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:03.972 02:26:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:03.972 02:26:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.972 02:26:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.972 02:26:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:03.972 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:03.972 02:26:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:03.972 02:26:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:03.972 02:26:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:03.972 02:26:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:03.972 02:26:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:03.972 02:26:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:03.972 02:26:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:03.972 02:26:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:03.972 02:26:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:03.972 02:26:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:03.972 02:26:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:03.972 02:26:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:03.972 02:26:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:03.972 02:26:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:03.972 02:26:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:03.972 02:26:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:03.972 02:26:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:03.972 02:26:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:03.972 02:26:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:03.972 02:26:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:03.972 02:26:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:03.972 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:03.972 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:15:03.972 00:15:03.972 --- 10.0.0.2 ping statistics --- 00:15:03.972 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:03.972 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:15:03.972 02:26:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:03.972 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:03.972 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:15:03.972 00:15:03.972 --- 10.0.0.1 ping statistics --- 00:15:03.972 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:03.972 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:15:03.972 02:26:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:03.972 02:26:28 -- nvmf/common.sh@410 -- # return 0 00:15:03.972 02:26:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:03.972 02:26:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:03.972 02:26:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:03.972 02:26:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:03.972 02:26:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:03.972 02:26:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:03.972 02:26:28 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:03.972 02:26:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:03.972 02:26:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:03.972 02:26:28 -- common/autotest_common.sh@10 -- # set +x 00:15:03.972 02:26:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:03.972 02:26:28 -- nvmf/common.sh@469 -- # nvmfpid=2038510 00:15:03.972 02:26:28 -- nvmf/common.sh@470 -- # waitforlisten 2038510 00:15:03.972 02:26:28 -- common/autotest_common.sh@829 -- # '[' -z 2038510 ']' 00:15:03.972 02:26:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:03.972 02:26:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:03.972 02:26:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:03.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:03.972 02:26:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:03.972 02:26:28 -- common/autotest_common.sh@10 -- # set +x 00:15:03.972 [2024-11-27 02:26:28.519686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:03.972 [2024-11-27 02:26:28.519763] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:03.972 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.972 [2024-11-27 02:26:28.583187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:04.229 [2024-11-27 02:26:28.671202] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:04.229 [2024-11-27 02:26:28.671376] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.229 [2024-11-27 02:26:28.671395] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.229 [2024-11-27 02:26:28.671410] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.229 [2024-11-27 02:26:28.671487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:04.229 [2024-11-27 02:26:28.671488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:05.191 02:26:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:05.191 02:26:29 -- common/autotest_common.sh@862 -- # return 0 00:15:05.191 02:26:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:05.191 02:26:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 02:26:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 [2024-11-27 02:26:29.496695] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 [2024-11-27 02:26:29.512907] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 NULL1 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 Delay0 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:05.191 02:26:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.191 02:26:29 -- common/autotest_common.sh@10 -- # set +x 00:15:05.191 02:26:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@28 -- # perf_pid=2038604 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:05.191 02:26:29 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:05.192 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.192 [2024-11-27 02:26:29.587589] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:07.161 02:26:31 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.161 02:26:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.161 02:26:31 -- common/autotest_common.sh@10 -- # set +x 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 starting I/O failed: -6 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 starting I/O failed: -6 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 starting I/O failed: -6 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 starting I/O failed: -6 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 starting I/O failed: -6 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Write completed with error (sct=0, sc=8) 00:15:07.161 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 [2024-11-27 02:26:31.709021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f746400c1d0 is same with the state(5) to be set 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.162 Read completed with error (sct=0, sc=8) 00:15:07.162 Write completed with error (sct=0, sc=8) 00:15:07.162 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Write completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 Read completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 Write completed with error (sct=0, sc=8) 00:15:07.163 starting I/O failed: -6 00:15:07.163 starting I/O failed: -6 00:15:07.163 starting I/O failed: -6 00:15:07.163 starting I/O failed: -6 00:15:08.096 [2024-11-27 02:26:32.684926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24549c0 is same with the state(5) to be set 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 [2024-11-27 02:26:32.710657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f746400c480 is same with the state(5) to be set 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.096 Write completed with error (sct=0, sc=8) 00:15:08.096 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 [2024-11-27 02:26:32.711052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f746400bf20 is same with the state(5) to be set 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 [2024-11-27 02:26:32.711652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2453240 is same with the state(5) to be set 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 Write completed with error (sct=0, sc=8) 00:15:08.097 Read completed with error (sct=0, sc=8) 00:15:08.097 [2024-11-27 02:26:32.711919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2452ce0 is same with the state(5) to be set 00:15:08.097 [2024-11-27 02:26:32.712853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24549c0 (9): Bad file descriptor 00:15:08.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:08.097 02:26:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.097 02:26:32 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:08.097 02:26:32 -- target/delete_subsystem.sh@35 -- # kill -0 2038604 00:15:08.097 02:26:32 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:08.097 Initializing NVMe Controllers 00:15:08.097 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:08.097 Controller IO queue size 128, less than required. 00:15:08.097 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:08.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:08.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:08.097 Initialization complete. Launching workers. 00:15:08.097 ======================================================== 00:15:08.097 Latency(us) 00:15:08.097 Device Information : IOPS MiB/s Average min max 00:15:08.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 187.62 0.09 901828.72 742.74 1012678.75 00:15:08.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 166.78 0.08 901322.11 586.57 1011556.26 00:15:08.097 ======================================================== 00:15:08.097 Total : 354.40 0.17 901590.31 586.57 1012678.75 00:15:08.097 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@35 -- # kill -0 2038604 00:15:08.663 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2038604) - No such process 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@45 -- # NOT wait 2038604 00:15:08.663 02:26:33 -- common/autotest_common.sh@650 -- # local es=0 00:15:08.663 02:26:33 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2038604 00:15:08.663 02:26:33 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:08.663 02:26:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:08.663 02:26:33 -- common/autotest_common.sh@642 -- # type -t wait 00:15:08.663 02:26:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:08.663 02:26:33 -- common/autotest_common.sh@653 -- # wait 2038604 00:15:08.663 02:26:33 -- common/autotest_common.sh@653 -- # es=1 00:15:08.663 02:26:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:08.663 02:26:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:08.663 02:26:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:08.663 02:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.663 02:26:33 -- common/autotest_common.sh@10 -- # set +x 00:15:08.663 02:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:08.663 02:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.663 02:26:33 -- common/autotest_common.sh@10 -- # set +x 00:15:08.663 [2024-11-27 02:26:33.236801] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:08.663 02:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:08.663 02:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.663 02:26:33 -- common/autotest_common.sh@10 -- # set +x 00:15:08.663 02:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@54 -- # perf_pid=2039129 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:08.663 02:26:33 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:08.663 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.663 [2024-11-27 02:26:33.290195] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:09.228 02:26:33 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:09.228 02:26:33 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:09.228 02:26:33 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:09.795 02:26:34 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:09.795 02:26:34 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:09.795 02:26:34 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:10.360 02:26:34 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:10.360 02:26:34 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:10.360 02:26:34 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:10.926 02:26:35 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:10.926 02:26:35 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:10.926 02:26:35 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:11.184 02:26:35 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:11.184 02:26:35 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:11.184 02:26:35 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:11.750 02:26:36 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:11.750 02:26:36 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:11.750 02:26:36 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:12.008 Initializing NVMe Controllers 00:15:12.008 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:12.008 Controller IO queue size 128, less than required. 00:15:12.008 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:12.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:12.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:12.008 Initialization complete. Launching workers. 00:15:12.008 ======================================================== 00:15:12.008 Latency(us) 00:15:12.008 Device Information : IOPS MiB/s Average min max 00:15:12.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004583.97 1000173.69 1043208.10 00:15:12.008 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004043.62 1000187.49 1011242.17 00:15:12.008 ======================================================== 00:15:12.008 Total : 256.00 0.12 1004313.80 1000173.69 1043208.10 00:15:12.008 00:15:12.266 02:26:36 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:12.266 02:26:36 -- target/delete_subsystem.sh@57 -- # kill -0 2039129 00:15:12.266 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2039129) - No such process 00:15:12.266 02:26:36 -- target/delete_subsystem.sh@67 -- # wait 2039129 00:15:12.266 02:26:36 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:12.266 02:26:36 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:12.266 02:26:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:12.266 02:26:36 -- nvmf/common.sh@116 -- # sync 00:15:12.266 02:26:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:12.266 02:26:36 -- nvmf/common.sh@119 -- # set +e 00:15:12.266 02:26:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:12.266 02:26:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:12.266 rmmod nvme_tcp 00:15:12.266 rmmod nvme_fabrics 00:15:12.266 rmmod nvme_keyring 00:15:12.266 02:26:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:12.266 02:26:36 -- nvmf/common.sh@123 -- # set -e 00:15:12.266 02:26:36 -- nvmf/common.sh@124 -- # return 0 00:15:12.266 02:26:36 -- nvmf/common.sh@477 -- # '[' -n 2038510 ']' 00:15:12.266 02:26:36 -- nvmf/common.sh@478 -- # killprocess 2038510 00:15:12.266 02:26:36 -- common/autotest_common.sh@936 -- # '[' -z 2038510 ']' 00:15:12.266 02:26:36 -- common/autotest_common.sh@940 -- # kill -0 2038510 00:15:12.266 02:26:36 -- common/autotest_common.sh@941 -- # uname 00:15:12.266 02:26:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:12.266 02:26:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2038510 00:15:12.266 02:26:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:12.266 02:26:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:12.266 02:26:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2038510' 00:15:12.266 killing process with pid 2038510 00:15:12.266 02:26:36 -- common/autotest_common.sh@955 -- # kill 2038510 00:15:12.266 02:26:36 -- common/autotest_common.sh@960 -- # wait 2038510 00:15:12.525 02:26:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:12.525 02:26:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:12.525 02:26:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:12.525 02:26:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:12.525 02:26:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:12.525 02:26:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:12.525 02:26:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:12.525 02:26:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:15.061 02:26:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:15.061 00:15:15.061 real 0m13.003s 00:15:15.061 user 0m29.390s 00:15:15.061 sys 0m2.881s 00:15:15.061 02:26:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:15.061 02:26:39 -- common/autotest_common.sh@10 -- # set +x 00:15:15.061 ************************************ 00:15:15.061 END TEST nvmf_delete_subsystem 00:15:15.061 ************************************ 00:15:15.061 02:26:39 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:15.061 02:26:39 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:15.062 02:26:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:15.062 02:26:39 -- common/autotest_common.sh@10 -- # set +x 00:15:15.062 ************************************ 00:15:15.062 START TEST nvmf_nvme_cli 00:15:15.062 ************************************ 00:15:15.062 02:26:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:15.062 * Looking for test storage... 00:15:15.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:15.062 02:26:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:15.062 02:26:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:15.062 02:26:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:15.062 02:26:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:15.062 02:26:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:15.062 02:26:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:15.062 02:26:39 -- scripts/common.sh@335 -- # IFS=.-: 00:15:15.062 02:26:39 -- scripts/common.sh@335 -- # read -ra ver1 00:15:15.062 02:26:39 -- scripts/common.sh@336 -- # IFS=.-: 00:15:15.062 02:26:39 -- scripts/common.sh@336 -- # read -ra ver2 00:15:15.062 02:26:39 -- scripts/common.sh@337 -- # local 'op=<' 00:15:15.062 02:26:39 -- scripts/common.sh@339 -- # ver1_l=2 00:15:15.062 02:26:39 -- scripts/common.sh@340 -- # ver2_l=1 00:15:15.062 02:26:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:15.062 02:26:39 -- scripts/common.sh@343 -- # case "$op" in 00:15:15.062 02:26:39 -- scripts/common.sh@344 -- # : 1 00:15:15.062 02:26:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:15.062 02:26:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:15.062 02:26:39 -- scripts/common.sh@364 -- # decimal 1 00:15:15.062 02:26:39 -- scripts/common.sh@352 -- # local d=1 00:15:15.062 02:26:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:15.062 02:26:39 -- scripts/common.sh@354 -- # echo 1 00:15:15.062 02:26:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:15.062 02:26:39 -- scripts/common.sh@365 -- # decimal 2 00:15:15.062 02:26:39 -- scripts/common.sh@352 -- # local d=2 00:15:15.062 02:26:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:15.062 02:26:39 -- scripts/common.sh@354 -- # echo 2 00:15:15.062 02:26:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:15.062 02:26:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:15.062 02:26:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:15.062 02:26:39 -- scripts/common.sh@367 -- # return 0 00:15:15.062 02:26:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:15.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.062 --rc genhtml_branch_coverage=1 00:15:15.062 --rc genhtml_function_coverage=1 00:15:15.062 --rc genhtml_legend=1 00:15:15.062 --rc geninfo_all_blocks=1 00:15:15.062 --rc geninfo_unexecuted_blocks=1 00:15:15.062 00:15:15.062 ' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:15.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.062 --rc genhtml_branch_coverage=1 00:15:15.062 --rc genhtml_function_coverage=1 00:15:15.062 --rc genhtml_legend=1 00:15:15.062 --rc geninfo_all_blocks=1 00:15:15.062 --rc geninfo_unexecuted_blocks=1 00:15:15.062 00:15:15.062 ' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:15.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.062 --rc genhtml_branch_coverage=1 00:15:15.062 --rc genhtml_function_coverage=1 00:15:15.062 --rc genhtml_legend=1 00:15:15.062 --rc geninfo_all_blocks=1 00:15:15.062 --rc geninfo_unexecuted_blocks=1 00:15:15.062 00:15:15.062 ' 00:15:15.062 02:26:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:15.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:15.062 --rc genhtml_branch_coverage=1 00:15:15.062 --rc genhtml_function_coverage=1 00:15:15.062 --rc genhtml_legend=1 00:15:15.062 --rc geninfo_all_blocks=1 00:15:15.062 --rc geninfo_unexecuted_blocks=1 00:15:15.062 00:15:15.062 ' 00:15:15.062 02:26:39 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:15.062 02:26:39 -- nvmf/common.sh@7 -- # uname -s 00:15:15.062 02:26:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:15.062 02:26:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:15.062 02:26:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:15.062 02:26:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:15.062 02:26:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:15.062 02:26:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:15.062 02:26:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:15.062 02:26:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:15.062 02:26:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:15.062 02:26:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:15.062 02:26:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:15.062 02:26:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:15.062 02:26:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:15.062 02:26:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:15.062 02:26:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:15.062 02:26:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:15.062 02:26:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:15.062 02:26:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:15.062 02:26:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:15.062 02:26:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.062 02:26:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.062 02:26:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.062 02:26:39 -- paths/export.sh@5 -- # export PATH 00:15:15.062 02:26:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:15.062 02:26:39 -- nvmf/common.sh@46 -- # : 0 00:15:15.062 02:26:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:15.062 02:26:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:15.062 02:26:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:15.062 02:26:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:15.062 02:26:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:15.062 02:26:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:15.062 02:26:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:15.062 02:26:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:15.062 02:26:39 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:15.062 02:26:39 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:15.062 02:26:39 -- target/nvme_cli.sh@14 -- # devs=() 00:15:15.062 02:26:39 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:15.062 02:26:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:15.062 02:26:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:15.062 02:26:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:15.062 02:26:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:15.062 02:26:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:15.062 02:26:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:15.062 02:26:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:15.062 02:26:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:15.062 02:26:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:15.062 02:26:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:15.062 02:26:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:15.062 02:26:39 -- common/autotest_common.sh@10 -- # set +x 00:15:16.966 02:26:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:16.966 02:26:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:16.966 02:26:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:16.966 02:26:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:16.966 02:26:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:16.966 02:26:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:16.966 02:26:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:16.966 02:26:41 -- nvmf/common.sh@294 -- # net_devs=() 00:15:16.966 02:26:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:16.966 02:26:41 -- nvmf/common.sh@295 -- # e810=() 00:15:16.966 02:26:41 -- nvmf/common.sh@295 -- # local -ga e810 00:15:16.966 02:26:41 -- nvmf/common.sh@296 -- # x722=() 00:15:16.966 02:26:41 -- nvmf/common.sh@296 -- # local -ga x722 00:15:16.966 02:26:41 -- nvmf/common.sh@297 -- # mlx=() 00:15:16.966 02:26:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:16.966 02:26:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:16.966 02:26:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:16.966 02:26:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:16.966 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:16.966 02:26:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:16.966 02:26:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:16.966 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:16.966 02:26:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:16.966 02:26:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:16.966 02:26:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:16.966 02:26:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:16.966 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:16.966 02:26:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:16.966 02:26:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:16.966 02:26:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:16.966 02:26:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:16.966 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:16.966 02:26:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:16.966 02:26:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:16.966 02:26:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:16.966 02:26:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:16.966 02:26:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:16.966 02:26:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:16.966 02:26:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:16.966 02:26:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:16.966 02:26:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:16.966 02:26:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:16.966 02:26:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:16.966 02:26:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:16.966 02:26:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:16.966 02:26:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:16.966 02:26:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:16.966 02:26:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:16.966 02:26:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:16.966 02:26:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:16.966 02:26:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:16.966 02:26:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:16.966 02:26:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:16.966 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:16.966 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:15:16.966 00:15:16.966 --- 10.0.0.2 ping statistics --- 00:15:16.966 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:16.966 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:15:16.966 02:26:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:16.966 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:16.966 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:15:16.966 00:15:16.966 --- 10.0.0.1 ping statistics --- 00:15:16.966 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:16.966 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:15:16.966 02:26:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:16.966 02:26:41 -- nvmf/common.sh@410 -- # return 0 00:15:16.966 02:26:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:16.966 02:26:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:16.966 02:26:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:16.966 02:26:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:16.966 02:26:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:16.966 02:26:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:16.966 02:26:41 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:16.966 02:26:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:16.966 02:26:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:16.966 02:26:41 -- common/autotest_common.sh@10 -- # set +x 00:15:16.966 02:26:41 -- nvmf/common.sh@469 -- # nvmfpid=2041504 00:15:16.966 02:26:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:16.966 02:26:41 -- nvmf/common.sh@470 -- # waitforlisten 2041504 00:15:16.966 02:26:41 -- common/autotest_common.sh@829 -- # '[' -z 2041504 ']' 00:15:16.966 02:26:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:16.966 02:26:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:16.966 02:26:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:16.966 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:16.966 02:26:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:16.967 02:26:41 -- common/autotest_common.sh@10 -- # set +x 00:15:16.967 [2024-11-27 02:26:41.575198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:16.967 [2024-11-27 02:26:41.575290] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:17.225 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.225 [2024-11-27 02:26:41.646121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:17.225 [2024-11-27 02:26:41.736157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:17.225 [2024-11-27 02:26:41.736327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:17.225 [2024-11-27 02:26:41.736347] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:17.225 [2024-11-27 02:26:41.736362] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:17.225 [2024-11-27 02:26:41.736432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:17.225 [2024-11-27 02:26:41.736513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:17.225 [2024-11-27 02:26:41.736610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:17.225 [2024-11-27 02:26:41.736614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:18.159 02:26:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:18.159 02:26:42 -- common/autotest_common.sh@862 -- # return 0 00:15:18.159 02:26:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:18.159 02:26:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 02:26:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:18.159 02:26:42 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 [2024-11-27 02:26:42.555069] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:18.159 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.159 02:26:42 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 Malloc0 00:15:18.159 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.159 02:26:42 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 Malloc1 00:15:18.159 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.159 02:26:42 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.159 02:26:42 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.159 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.159 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.159 02:26:42 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:18.159 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.160 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.160 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.160 02:26:42 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:18.160 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.160 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.160 [2024-11-27 02:26:42.636586] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:18.160 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.160 02:26:42 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:18.160 02:26:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.160 02:26:42 -- common/autotest_common.sh@10 -- # set +x 00:15:18.160 02:26:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.160 02:26:42 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:18.417 00:15:18.417 Discovery Log Number of Records 2, Generation counter 2 00:15:18.417 =====Discovery Log Entry 0====== 00:15:18.417 trtype: tcp 00:15:18.417 adrfam: ipv4 00:15:18.417 subtype: current discovery subsystem 00:15:18.417 treq: not required 00:15:18.417 portid: 0 00:15:18.417 trsvcid: 4420 00:15:18.417 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:18.417 traddr: 10.0.0.2 00:15:18.417 eflags: explicit discovery connections, duplicate discovery information 00:15:18.417 sectype: none 00:15:18.417 =====Discovery Log Entry 1====== 00:15:18.417 trtype: tcp 00:15:18.417 adrfam: ipv4 00:15:18.417 subtype: nvme subsystem 00:15:18.417 treq: not required 00:15:18.417 portid: 0 00:15:18.417 trsvcid: 4420 00:15:18.417 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:18.417 traddr: 10.0.0.2 00:15:18.418 eflags: none 00:15:18.418 sectype: none 00:15:18.418 02:26:42 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:18.418 02:26:42 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:18.418 02:26:42 -- nvmf/common.sh@510 -- # local dev _ 00:15:18.418 02:26:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:18.418 02:26:42 -- nvmf/common.sh@509 -- # nvme list 00:15:18.418 02:26:42 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:18.418 02:26:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:18.418 02:26:42 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:18.418 02:26:42 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:18.418 02:26:42 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:18.418 02:26:42 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:18.984 02:26:43 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:18.984 02:26:43 -- common/autotest_common.sh@1187 -- # local i=0 00:15:18.984 02:26:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:18.984 02:26:43 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:18.984 02:26:43 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:18.984 02:26:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:21.510 02:26:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:21.510 02:26:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:21.510 02:26:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:21.510 02:26:45 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:21.510 02:26:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:21.510 02:26:45 -- common/autotest_common.sh@1197 -- # return 0 00:15:21.510 02:26:45 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:21.510 02:26:45 -- nvmf/common.sh@510 -- # local dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@509 -- # nvme list 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:21.510 /dev/nvme0n2 ]] 00:15:21.510 02:26:45 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:21.510 02:26:45 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:21.510 02:26:45 -- nvmf/common.sh@510 -- # local dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@509 -- # nvme list 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.510 02:26:45 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:21.510 02:26:45 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:21.510 02:26:45 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:21.511 02:26:45 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:21.511 02:26:45 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:21.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:21.511 02:26:46 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:21.511 02:26:46 -- common/autotest_common.sh@1208 -- # local i=0 00:15:21.511 02:26:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:21.511 02:26:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:21.511 02:26:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:21.511 02:26:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:21.511 02:26:46 -- common/autotest_common.sh@1220 -- # return 0 00:15:21.511 02:26:46 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:21.511 02:26:46 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:21.511 02:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.511 02:26:46 -- common/autotest_common.sh@10 -- # set +x 00:15:21.511 02:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.511 02:26:46 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:21.511 02:26:46 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:21.511 02:26:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:21.511 02:26:46 -- nvmf/common.sh@116 -- # sync 00:15:21.511 02:26:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:21.511 02:26:46 -- nvmf/common.sh@119 -- # set +e 00:15:21.511 02:26:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:21.511 02:26:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:21.511 rmmod nvme_tcp 00:15:21.769 rmmod nvme_fabrics 00:15:21.769 rmmod nvme_keyring 00:15:21.769 02:26:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:21.769 02:26:46 -- nvmf/common.sh@123 -- # set -e 00:15:21.769 02:26:46 -- nvmf/common.sh@124 -- # return 0 00:15:21.769 02:26:46 -- nvmf/common.sh@477 -- # '[' -n 2041504 ']' 00:15:21.769 02:26:46 -- nvmf/common.sh@478 -- # killprocess 2041504 00:15:21.769 02:26:46 -- common/autotest_common.sh@936 -- # '[' -z 2041504 ']' 00:15:21.769 02:26:46 -- common/autotest_common.sh@940 -- # kill -0 2041504 00:15:21.769 02:26:46 -- common/autotest_common.sh@941 -- # uname 00:15:21.769 02:26:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:21.769 02:26:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2041504 00:15:21.769 02:26:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:21.769 02:26:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:21.769 02:26:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2041504' 00:15:21.769 killing process with pid 2041504 00:15:21.769 02:26:46 -- common/autotest_common.sh@955 -- # kill 2041504 00:15:21.769 02:26:46 -- common/autotest_common.sh@960 -- # wait 2041504 00:15:22.027 02:26:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.027 02:26:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.027 02:26:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.027 02:26:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.027 02:26:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.027 02:26:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.027 02:26:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.027 02:26:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:23.929 02:26:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:23.929 00:15:23.929 real 0m9.373s 00:15:23.929 user 0m19.754s 00:15:23.929 sys 0m2.276s 00:15:23.929 02:26:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:23.929 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:15:23.929 ************************************ 00:15:23.929 END TEST nvmf_nvme_cli 00:15:23.929 ************************************ 00:15:24.188 02:26:48 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:24.188 02:26:48 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:24.188 02:26:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:24.188 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:15:24.188 ************************************ 00:15:24.188 START TEST nvmf_vfio_user 00:15:24.188 ************************************ 00:15:24.188 02:26:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:24.188 * Looking for test storage... 00:15:24.188 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:24.188 02:26:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:24.188 02:26:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:24.188 02:26:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:24.188 02:26:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:24.188 02:26:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:24.188 02:26:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:24.188 02:26:48 -- scripts/common.sh@335 -- # IFS=.-: 00:15:24.188 02:26:48 -- scripts/common.sh@335 -- # read -ra ver1 00:15:24.188 02:26:48 -- scripts/common.sh@336 -- # IFS=.-: 00:15:24.188 02:26:48 -- scripts/common.sh@336 -- # read -ra ver2 00:15:24.188 02:26:48 -- scripts/common.sh@337 -- # local 'op=<' 00:15:24.188 02:26:48 -- scripts/common.sh@339 -- # ver1_l=2 00:15:24.188 02:26:48 -- scripts/common.sh@340 -- # ver2_l=1 00:15:24.188 02:26:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:24.188 02:26:48 -- scripts/common.sh@343 -- # case "$op" in 00:15:24.188 02:26:48 -- scripts/common.sh@344 -- # : 1 00:15:24.188 02:26:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:24.188 02:26:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:24.188 02:26:48 -- scripts/common.sh@364 -- # decimal 1 00:15:24.188 02:26:48 -- scripts/common.sh@352 -- # local d=1 00:15:24.188 02:26:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:24.188 02:26:48 -- scripts/common.sh@354 -- # echo 1 00:15:24.188 02:26:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:24.188 02:26:48 -- scripts/common.sh@365 -- # decimal 2 00:15:24.188 02:26:48 -- scripts/common.sh@352 -- # local d=2 00:15:24.188 02:26:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:24.188 02:26:48 -- scripts/common.sh@354 -- # echo 2 00:15:24.188 02:26:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:24.188 02:26:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:24.188 02:26:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:24.188 02:26:48 -- scripts/common.sh@367 -- # return 0 00:15:24.188 02:26:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:24.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.188 --rc genhtml_branch_coverage=1 00:15:24.188 --rc genhtml_function_coverage=1 00:15:24.188 --rc genhtml_legend=1 00:15:24.188 --rc geninfo_all_blocks=1 00:15:24.188 --rc geninfo_unexecuted_blocks=1 00:15:24.188 00:15:24.188 ' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:24.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.188 --rc genhtml_branch_coverage=1 00:15:24.188 --rc genhtml_function_coverage=1 00:15:24.188 --rc genhtml_legend=1 00:15:24.188 --rc geninfo_all_blocks=1 00:15:24.188 --rc geninfo_unexecuted_blocks=1 00:15:24.188 00:15:24.188 ' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:24.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.188 --rc genhtml_branch_coverage=1 00:15:24.188 --rc genhtml_function_coverage=1 00:15:24.188 --rc genhtml_legend=1 00:15:24.188 --rc geninfo_all_blocks=1 00:15:24.188 --rc geninfo_unexecuted_blocks=1 00:15:24.188 00:15:24.188 ' 00:15:24.188 02:26:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:24.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.188 --rc genhtml_branch_coverage=1 00:15:24.188 --rc genhtml_function_coverage=1 00:15:24.188 --rc genhtml_legend=1 00:15:24.188 --rc geninfo_all_blocks=1 00:15:24.188 --rc geninfo_unexecuted_blocks=1 00:15:24.188 00:15:24.188 ' 00:15:24.188 02:26:48 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:24.188 02:26:48 -- nvmf/common.sh@7 -- # uname -s 00:15:24.188 02:26:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:24.188 02:26:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:24.188 02:26:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:24.188 02:26:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:24.188 02:26:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:24.188 02:26:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:24.188 02:26:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:24.188 02:26:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:24.188 02:26:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:24.188 02:26:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:24.188 02:26:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.188 02:26:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.188 02:26:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:24.188 02:26:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:24.188 02:26:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:24.188 02:26:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:24.188 02:26:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:24.188 02:26:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:24.188 02:26:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:24.188 02:26:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.188 02:26:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.188 02:26:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.188 02:26:48 -- paths/export.sh@5 -- # export PATH 00:15:24.188 02:26:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.188 02:26:48 -- nvmf/common.sh@46 -- # : 0 00:15:24.188 02:26:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:24.188 02:26:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:24.188 02:26:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:24.188 02:26:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:24.188 02:26:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:24.189 02:26:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:24.189 02:26:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:24.189 02:26:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2042468 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2042468' 00:15:24.189 Process pid: 2042468 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:24.189 02:26:48 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2042468 00:15:24.189 02:26:48 -- common/autotest_common.sh@829 -- # '[' -z 2042468 ']' 00:15:24.189 02:26:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.189 02:26:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:24.189 02:26:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.189 02:26:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:24.189 02:26:48 -- common/autotest_common.sh@10 -- # set +x 00:15:24.189 [2024-11-27 02:26:48.807052] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:24.189 [2024-11-27 02:26:48.807128] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.447 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.447 [2024-11-27 02:26:48.872636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:24.447 [2024-11-27 02:26:48.960320] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:24.447 [2024-11-27 02:26:48.960485] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:24.447 [2024-11-27 02:26:48.960501] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:24.447 [2024-11-27 02:26:48.960514] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:24.447 [2024-11-27 02:26:48.960634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:24.447 [2024-11-27 02:26:48.960649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:24.447 [2024-11-27 02:26:48.960727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:24.447 [2024-11-27 02:26:48.960730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:25.381 02:26:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:25.381 02:26:49 -- common/autotest_common.sh@862 -- # return 0 00:15:25.381 02:26:49 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:26.314 02:26:50 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:26.573 02:26:51 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:26.573 02:26:51 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:26.573 02:26:51 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:26.573 02:26:51 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:26.573 02:26:51 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:26.831 Malloc1 00:15:26.831 02:26:51 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:27.088 02:26:51 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:27.346 02:26:51 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:27.603 02:26:52 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:27.603 02:26:52 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:27.603 02:26:52 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:27.862 Malloc2 00:15:27.862 02:26:52 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:28.120 02:26:52 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:28.379 02:26:52 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:28.638 02:26:53 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:28.638 [2024-11-27 02:26:53.175245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:28.638 [2024-11-27 02:26:53.175288] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2043031 ] 00:15:28.638 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.638 [2024-11-27 02:26:53.209849] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:28.638 [2024-11-27 02:26:53.212274] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:28.638 [2024-11-27 02:26:53.212302] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7efd41cac000 00:15:28.638 [2024-11-27 02:26:53.213269] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.214261] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.215266] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.216275] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.217279] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.218284] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.219286] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.220295] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:28.638 [2024-11-27 02:26:53.221307] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:28.638 [2024-11-27 02:26:53.221327] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7efd409a6000 00:15:28.638 [2024-11-27 02:26:53.222495] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:28.638 [2024-11-27 02:26:53.237348] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:28.638 [2024-11-27 02:26:53.237390] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:28.638 [2024-11-27 02:26:53.246474] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:28.638 [2024-11-27 02:26:53.246562] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:28.638 [2024-11-27 02:26:53.246672] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:28.639 [2024-11-27 02:26:53.246710] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:28.639 [2024-11-27 02:26:53.246721] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:28.639 [2024-11-27 02:26:53.247461] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:28.639 [2024-11-27 02:26:53.247480] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:28.639 [2024-11-27 02:26:53.247492] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:28.639 [2024-11-27 02:26:53.248465] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:28.639 [2024-11-27 02:26:53.248482] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:28.639 [2024-11-27 02:26:53.248496] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.249471] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:28.639 [2024-11-27 02:26:53.249488] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.250475] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:28.639 [2024-11-27 02:26:53.250495] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:28.639 [2024-11-27 02:26:53.250518] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.250537] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.250648] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:28.639 [2024-11-27 02:26:53.250661] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.250671] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:28.639 [2024-11-27 02:26:53.251484] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:28.639 [2024-11-27 02:26:53.252487] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:28.639 [2024-11-27 02:26:53.253502] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:28.639 [2024-11-27 02:26:53.254562] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:28.639 [2024-11-27 02:26:53.255503] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:28.639 [2024-11-27 02:26:53.255542] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:28.639 [2024-11-27 02:26:53.255557] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255583] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:28.639 [2024-11-27 02:26:53.255596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255622] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:28.639 [2024-11-27 02:26:53.255632] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:28.639 [2024-11-27 02:26:53.255656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.255733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.255752] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:28.639 [2024-11-27 02:26:53.255761] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:28.639 [2024-11-27 02:26:53.255768] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:28.639 [2024-11-27 02:26:53.255776] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:28.639 [2024-11-27 02:26:53.255785] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:28.639 [2024-11-27 02:26:53.255792] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:28.639 [2024-11-27 02:26:53.255800] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255832] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255849] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.255864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.255886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:28.639 [2024-11-27 02:26:53.255899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:28.639 [2024-11-27 02:26:53.255911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:28.639 [2024-11-27 02:26:53.255922] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:28.639 [2024-11-27 02:26:53.255930] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255945] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.255959] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.255971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.255988] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:28.639 [2024-11-27 02:26:53.255997] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256008] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256022] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256035] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.256047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.256108] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256122] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256135] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:28.639 [2024-11-27 02:26:53.256143] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:28.639 [2024-11-27 02:26:53.256152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.256170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.256193] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:28.639 [2024-11-27 02:26:53.256209] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256223] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256234] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:28.639 [2024-11-27 02:26:53.256242] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:28.639 [2024-11-27 02:26:53.256251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.256277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.256301] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256315] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256326] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:28.639 [2024-11-27 02:26:53.256334] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:28.639 [2024-11-27 02:26:53.256343] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:28.639 [2024-11-27 02:26:53.256359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:28.639 [2024-11-27 02:26:53.256373] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256388] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256403] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256414] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:28.639 [2024-11-27 02:26:53.256422] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:28.640 [2024-11-27 02:26:53.256431] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:28.640 [2024-11-27 02:26:53.256439] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:28.640 [2024-11-27 02:26:53.256447] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:28.640 [2024-11-27 02:26:53.256473] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256532] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256564] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256591] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256622] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:28.640 [2024-11-27 02:26:53.256631] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:28.640 [2024-11-27 02:26:53.256637] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:28.640 [2024-11-27 02:26:53.256642] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:28.640 [2024-11-27 02:26:53.256652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:28.640 [2024-11-27 02:26:53.256663] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:28.640 [2024-11-27 02:26:53.256670] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:28.640 [2024-11-27 02:26:53.256679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256690] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:28.640 [2024-11-27 02:26:53.256698] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:28.640 [2024-11-27 02:26:53.256706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256722] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:28.640 [2024-11-27 02:26:53.256731] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:28.640 [2024-11-27 02:26:53.256740] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:28.640 [2024-11-27 02:26:53.256751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:28.640 [2024-11-27 02:26:53.256801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:28.640 ===================================================== 00:15:28.640 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:28.640 ===================================================== 00:15:28.640 Controller Capabilities/Features 00:15:28.640 ================================ 00:15:28.640 Vendor ID: 4e58 00:15:28.640 Subsystem Vendor ID: 4e58 00:15:28.640 Serial Number: SPDK1 00:15:28.640 Model Number: SPDK bdev Controller 00:15:28.640 Firmware Version: 24.01.1 00:15:28.640 Recommended Arb Burst: 6 00:15:28.640 IEEE OUI Identifier: 8d 6b 50 00:15:28.640 Multi-path I/O 00:15:28.640 May have multiple subsystem ports: Yes 00:15:28.640 May have multiple controllers: Yes 00:15:28.640 Associated with SR-IOV VF: No 00:15:28.640 Max Data Transfer Size: 131072 00:15:28.640 Max Number of Namespaces: 32 00:15:28.640 Max Number of I/O Queues: 127 00:15:28.640 NVMe Specification Version (VS): 1.3 00:15:28.640 NVMe Specification Version (Identify): 1.3 00:15:28.640 Maximum Queue Entries: 256 00:15:28.640 Contiguous Queues Required: Yes 00:15:28.640 Arbitration Mechanisms Supported 00:15:28.640 Weighted Round Robin: Not Supported 00:15:28.640 Vendor Specific: Not Supported 00:15:28.640 Reset Timeout: 15000 ms 00:15:28.640 Doorbell Stride: 4 bytes 00:15:28.640 NVM Subsystem Reset: Not Supported 00:15:28.640 Command Sets Supported 00:15:28.640 NVM Command Set: Supported 00:15:28.640 Boot Partition: Not Supported 00:15:28.640 Memory Page Size Minimum: 4096 bytes 00:15:28.640 Memory Page Size Maximum: 4096 bytes 00:15:28.640 Persistent Memory Region: Not Supported 00:15:28.640 Optional Asynchronous Events Supported 00:15:28.640 Namespace Attribute Notices: Supported 00:15:28.640 Firmware Activation Notices: Not Supported 00:15:28.640 ANA Change Notices: Not Supported 00:15:28.640 PLE Aggregate Log Change Notices: Not Supported 00:15:28.640 LBA Status Info Alert Notices: Not Supported 00:15:28.640 EGE Aggregate Log Change Notices: Not Supported 00:15:28.640 Normal NVM Subsystem Shutdown event: Not Supported 00:15:28.640 Zone Descriptor Change Notices: Not Supported 00:15:28.640 Discovery Log Change Notices: Not Supported 00:15:28.640 Controller Attributes 00:15:28.640 128-bit Host Identifier: Supported 00:15:28.640 Non-Operational Permissive Mode: Not Supported 00:15:28.640 NVM Sets: Not Supported 00:15:28.640 Read Recovery Levels: Not Supported 00:15:28.640 Endurance Groups: Not Supported 00:15:28.640 Predictable Latency Mode: Not Supported 00:15:28.640 Traffic Based Keep ALive: Not Supported 00:15:28.640 Namespace Granularity: Not Supported 00:15:28.640 SQ Associations: Not Supported 00:15:28.640 UUID List: Not Supported 00:15:28.640 Multi-Domain Subsystem: Not Supported 00:15:28.640 Fixed Capacity Management: Not Supported 00:15:28.640 Variable Capacity Management: Not Supported 00:15:28.640 Delete Endurance Group: Not Supported 00:15:28.640 Delete NVM Set: Not Supported 00:15:28.640 Extended LBA Formats Supported: Not Supported 00:15:28.640 Flexible Data Placement Supported: Not Supported 00:15:28.640 00:15:28.640 Controller Memory Buffer Support 00:15:28.640 ================================ 00:15:28.640 Supported: No 00:15:28.640 00:15:28.640 Persistent Memory Region Support 00:15:28.640 ================================ 00:15:28.640 Supported: No 00:15:28.640 00:15:28.640 Admin Command Set Attributes 00:15:28.640 ============================ 00:15:28.640 Security Send/Receive: Not Supported 00:15:28.640 Format NVM: Not Supported 00:15:28.640 Firmware Activate/Download: Not Supported 00:15:28.640 Namespace Management: Not Supported 00:15:28.640 Device Self-Test: Not Supported 00:15:28.640 Directives: Not Supported 00:15:28.640 NVMe-MI: Not Supported 00:15:28.640 Virtualization Management: Not Supported 00:15:28.640 Doorbell Buffer Config: Not Supported 00:15:28.640 Get LBA Status Capability: Not Supported 00:15:28.640 Command & Feature Lockdown Capability: Not Supported 00:15:28.640 Abort Command Limit: 4 00:15:28.640 Async Event Request Limit: 4 00:15:28.640 Number of Firmware Slots: N/A 00:15:28.640 Firmware Slot 1 Read-Only: N/A 00:15:28.640 Firmware Activation Without Reset: N/A 00:15:28.640 Multiple Update Detection Support: N/A 00:15:28.640 Firmware Update Granularity: No Information Provided 00:15:28.640 Per-Namespace SMART Log: No 00:15:28.640 Asymmetric Namespace Access Log Page: Not Supported 00:15:28.640 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:28.640 Command Effects Log Page: Supported 00:15:28.640 Get Log Page Extended Data: Supported 00:15:28.640 Telemetry Log Pages: Not Supported 00:15:28.640 Persistent Event Log Pages: Not Supported 00:15:28.640 Supported Log Pages Log Page: May Support 00:15:28.640 Commands Supported & Effects Log Page: Not Supported 00:15:28.640 Feature Identifiers & Effects Log Page:May Support 00:15:28.640 NVMe-MI Commands & Effects Log Page: May Support 00:15:28.640 Data Area 4 for Telemetry Log: Not Supported 00:15:28.640 Error Log Page Entries Supported: 128 00:15:28.640 Keep Alive: Supported 00:15:28.640 Keep Alive Granularity: 10000 ms 00:15:28.640 00:15:28.640 NVM Command Set Attributes 00:15:28.640 ========================== 00:15:28.640 Submission Queue Entry Size 00:15:28.640 Max: 64 00:15:28.640 Min: 64 00:15:28.640 Completion Queue Entry Size 00:15:28.640 Max: 16 00:15:28.640 Min: 16 00:15:28.640 Number of Namespaces: 32 00:15:28.640 Compare Command: Supported 00:15:28.640 Write Uncorrectable Command: Not Supported 00:15:28.640 Dataset Management Command: Supported 00:15:28.640 Write Zeroes Command: Supported 00:15:28.640 Set Features Save Field: Not Supported 00:15:28.640 Reservations: Not Supported 00:15:28.640 Timestamp: Not Supported 00:15:28.640 Copy: Supported 00:15:28.640 Volatile Write Cache: Present 00:15:28.640 Atomic Write Unit (Normal): 1 00:15:28.640 Atomic Write Unit (PFail): 1 00:15:28.640 Atomic Compare & Write Unit: 1 00:15:28.640 Fused Compare & Write: Supported 00:15:28.641 Scatter-Gather List 00:15:28.641 SGL Command Set: Supported (Dword aligned) 00:15:28.641 SGL Keyed: Not Supported 00:15:28.641 SGL Bit Bucket Descriptor: Not Supported 00:15:28.641 SGL Metadata Pointer: Not Supported 00:15:28.641 Oversized SGL: Not Supported 00:15:28.641 SGL Metadata Address: Not Supported 00:15:28.641 SGL Offset: Not Supported 00:15:28.641 Transport SGL Data Block: Not Supported 00:15:28.641 Replay Protected Memory Block: Not Supported 00:15:28.641 00:15:28.641 Firmware Slot Information 00:15:28.641 ========================= 00:15:28.641 Active slot: 1 00:15:28.641 Slot 1 Firmware Revision: 24.01.1 00:15:28.641 00:15:28.641 00:15:28.641 Commands Supported and Effects 00:15:28.641 ============================== 00:15:28.641 Admin Commands 00:15:28.641 -------------- 00:15:28.641 Get Log Page (02h): Supported 00:15:28.641 Identify (06h): Supported 00:15:28.641 Abort (08h): Supported 00:15:28.641 Set Features (09h): Supported 00:15:28.641 Get Features (0Ah): Supported 00:15:28.641 Asynchronous Event Request (0Ch): Supported 00:15:28.641 Keep Alive (18h): Supported 00:15:28.641 I/O Commands 00:15:28.641 ------------ 00:15:28.641 Flush (00h): Supported LBA-Change 00:15:28.641 Write (01h): Supported LBA-Change 00:15:28.641 Read (02h): Supported 00:15:28.641 Compare (05h): Supported 00:15:28.641 Write Zeroes (08h): Supported LBA-Change 00:15:28.641 Dataset Management (09h): Supported LBA-Change 00:15:28.641 Copy (19h): Supported LBA-Change 00:15:28.641 Unknown (79h): Supported LBA-Change 00:15:28.641 Unknown (7Ah): Supported 00:15:28.641 00:15:28.641 Error Log 00:15:28.641 ========= 00:15:28.641 00:15:28.641 Arbitration 00:15:28.641 =========== 00:15:28.641 Arbitration Burst: 1 00:15:28.641 00:15:28.641 Power Management 00:15:28.641 ================ 00:15:28.641 Number of Power States: 1 00:15:28.641 Current Power State: Power State #0 00:15:28.641 Power State #0: 00:15:28.641 Max Power: 0.00 W 00:15:28.641 Non-Operational State: Operational 00:15:28.641 Entry Latency: Not Reported 00:15:28.641 Exit Latency: Not Reported 00:15:28.641 Relative Read Throughput: 0 00:15:28.641 Relative Read Latency: 0 00:15:28.641 Relative Write Throughput: 0 00:15:28.641 Relative Write Latency: 0 00:15:28.641 Idle Power: Not Reported 00:15:28.641 Active Power: Not Reported 00:15:28.641 Non-Operational Permissive Mode: Not Supported 00:15:28.641 00:15:28.641 Health Information 00:15:28.641 ================== 00:15:28.641 Critical Warnings: 00:15:28.641 Available Spare Space: OK 00:15:28.641 Temperature: OK 00:15:28.641 Device Reliability: OK 00:15:28.641 Read Only: No 00:15:28.641 Volatile Memory Backup: OK 00:15:28.641 Current Temperature: 0 Kelvin[2024-11-27 02:26:53.256939] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:28.641 [2024-11-27 02:26:53.256955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:28.641 [2024-11-27 02:26:53.256993] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:28.641 [2024-11-27 02:26:53.257011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:28.641 [2024-11-27 02:26:53.257022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:28.641 [2024-11-27 02:26:53.257031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:28.641 [2024-11-27 02:26:53.257040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:28.641 [2024-11-27 02:26:53.257545] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:28.641 [2024-11-27 02:26:53.257567] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:28.641 [2024-11-27 02:26:53.258593] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:28.641 [2024-11-27 02:26:53.258609] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:28.641 [2024-11-27 02:26:53.259553] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:28.641 [2024-11-27 02:26:53.259577] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:28.641 [2024-11-27 02:26:53.259636] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:28.641 [2024-11-27 02:26:53.262537] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:28.899 (-273 Celsius) 00:15:28.899 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:28.899 Available Spare: 0% 00:15:28.899 Available Spare Threshold: 0% 00:15:28.899 Life Percentage Used: 0% 00:15:28.899 Data Units Read: 0 00:15:28.899 Data Units Written: 0 00:15:28.899 Host Read Commands: 0 00:15:28.899 Host Write Commands: 0 00:15:28.899 Controller Busy Time: 0 minutes 00:15:28.899 Power Cycles: 0 00:15:28.899 Power On Hours: 0 hours 00:15:28.899 Unsafe Shutdowns: 0 00:15:28.899 Unrecoverable Media Errors: 0 00:15:28.899 Lifetime Error Log Entries: 0 00:15:28.899 Warning Temperature Time: 0 minutes 00:15:28.899 Critical Temperature Time: 0 minutes 00:15:28.899 00:15:28.899 Number of Queues 00:15:28.899 ================ 00:15:28.899 Number of I/O Submission Queues: 127 00:15:28.899 Number of I/O Completion Queues: 127 00:15:28.899 00:15:28.899 Active Namespaces 00:15:28.899 ================= 00:15:28.899 Namespace ID:1 00:15:28.899 Error Recovery Timeout: Unlimited 00:15:28.900 Command Set Identifier: NVM (00h) 00:15:28.900 Deallocate: Supported 00:15:28.900 Deallocated/Unwritten Error: Not Supported 00:15:28.900 Deallocated Read Value: Unknown 00:15:28.900 Deallocate in Write Zeroes: Not Supported 00:15:28.900 Deallocated Guard Field: 0xFFFF 00:15:28.900 Flush: Supported 00:15:28.900 Reservation: Supported 00:15:28.900 Namespace Sharing Capabilities: Multiple Controllers 00:15:28.900 Size (in LBAs): 131072 (0GiB) 00:15:28.900 Capacity (in LBAs): 131072 (0GiB) 00:15:28.900 Utilization (in LBAs): 131072 (0GiB) 00:15:28.900 NGUID: 5EE674D079904EAF911256CD58939560 00:15:28.900 UUID: 5ee674d0-7990-4eaf-9112-56cd58939560 00:15:28.900 Thin Provisioning: Not Supported 00:15:28.900 Per-NS Atomic Units: Yes 00:15:28.900 Atomic Boundary Size (Normal): 0 00:15:28.900 Atomic Boundary Size (PFail): 0 00:15:28.900 Atomic Boundary Offset: 0 00:15:28.900 Maximum Single Source Range Length: 65535 00:15:28.900 Maximum Copy Length: 65535 00:15:28.900 Maximum Source Range Count: 1 00:15:28.900 NGUID/EUI64 Never Reused: No 00:15:28.900 Namespace Write Protected: No 00:15:28.900 Number of LBA Formats: 1 00:15:28.900 Current LBA Format: LBA Format #00 00:15:28.900 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:28.900 00:15:28.900 02:26:53 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:28.900 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.163 Initializing NVMe Controllers 00:15:34.163 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:34.163 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:34.163 Initialization complete. Launching workers. 00:15:34.163 ======================================================== 00:15:34.163 Latency(us) 00:15:34.163 Device Information : IOPS MiB/s Average min max 00:15:34.163 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37889.64 148.01 3377.50 1134.52 7613.96 00:15:34.163 ======================================================== 00:15:34.163 Total : 37889.64 148.01 3377.50 1134.52 7613.96 00:15:34.163 00:15:34.164 02:26:58 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:34.164 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.422 Initializing NVMe Controllers 00:15:39.422 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:39.422 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:39.422 Initialization complete. Launching workers. 00:15:39.422 ======================================================== 00:15:39.422 Latency(us) 00:15:39.422 Device Information : IOPS MiB/s Average min max 00:15:39.422 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16051.17 62.70 7982.81 4941.17 15976.24 00:15:39.422 ======================================================== 00:15:39.422 Total : 16051.17 62.70 7982.81 4941.17 15976.24 00:15:39.422 00:15:39.422 02:27:03 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:39.422 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.682 Initializing NVMe Controllers 00:15:44.682 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:44.682 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:44.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:44.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:44.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:44.682 Initialization complete. Launching workers. 00:15:44.682 Starting thread on core 2 00:15:44.682 Starting thread on core 3 00:15:44.682 Starting thread on core 1 00:15:44.682 02:27:09 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:44.682 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.022 Initializing NVMe Controllers 00:15:48.022 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:48.022 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:48.022 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:48.022 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:48.022 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:48.022 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:48.022 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:48.022 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:48.022 Initialization complete. Launching workers. 00:15:48.022 Starting thread on core 1 with urgent priority queue 00:15:48.022 Starting thread on core 2 with urgent priority queue 00:15:48.022 Starting thread on core 3 with urgent priority queue 00:15:48.022 Starting thread on core 0 with urgent priority queue 00:15:48.022 SPDK bdev Controller (SPDK1 ) core 0: 3839.67 IO/s 26.04 secs/100000 ios 00:15:48.022 SPDK bdev Controller (SPDK1 ) core 1: 3852.00 IO/s 25.96 secs/100000 ios 00:15:48.022 SPDK bdev Controller (SPDK1 ) core 2: 4618.67 IO/s 21.65 secs/100000 ios 00:15:48.022 SPDK bdev Controller (SPDK1 ) core 3: 3799.33 IO/s 26.32 secs/100000 ios 00:15:48.022 ======================================================== 00:15:48.022 00:15:48.022 02:27:12 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:48.022 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.326 Initializing NVMe Controllers 00:15:48.326 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:48.326 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:48.326 Namespace ID: 1 size: 0GB 00:15:48.326 Initialization complete. 00:15:48.326 INFO: using host memory buffer for IO 00:15:48.326 Hello world! 00:15:48.326 02:27:12 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:48.326 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.708 Initializing NVMe Controllers 00:15:49.708 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.708 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.708 Initialization complete. Launching workers. 00:15:49.708 submit (in ns) avg, min, max = 7570.3, 3503.3, 5996228.9 00:15:49.708 complete (in ns) avg, min, max = 23419.2, 2052.2, 5996170.0 00:15:49.708 00:15:49.708 Submit histogram 00:15:49.708 ================ 00:15:49.708 Range in us Cumulative Count 00:15:49.708 3.484 - 3.508: 0.0072% ( 1) 00:15:49.708 3.508 - 3.532: 0.3902% ( 53) 00:15:49.708 3.532 - 3.556: 1.3658% ( 135) 00:15:49.708 3.556 - 3.579: 4.3503% ( 413) 00:15:49.708 3.579 - 3.603: 9.3944% ( 698) 00:15:49.708 3.603 - 3.627: 18.6154% ( 1276) 00:15:49.708 3.627 - 3.650: 28.1544% ( 1320) 00:15:49.708 3.650 - 3.674: 35.0629% ( 956) 00:15:49.708 3.674 - 3.698: 41.4005% ( 877) 00:15:49.708 3.698 - 3.721: 48.4897% ( 981) 00:15:49.708 3.721 - 3.745: 54.5816% ( 843) 00:15:49.708 3.745 - 3.769: 59.1126% ( 627) 00:15:49.708 3.769 - 3.793: 62.2127% ( 429) 00:15:49.708 3.793 - 3.816: 65.3707% ( 437) 00:15:49.708 3.816 - 3.840: 68.8394% ( 480) 00:15:49.708 3.840 - 3.864: 73.5583% ( 653) 00:15:49.708 3.864 - 3.887: 77.6991% ( 573) 00:15:49.708 3.887 - 3.911: 81.2328% ( 489) 00:15:49.708 3.911 - 3.935: 84.4197% ( 441) 00:15:49.708 3.935 - 3.959: 86.6166% ( 304) 00:15:49.708 3.959 - 3.982: 88.3871% ( 245) 00:15:49.708 3.982 - 4.006: 89.8757% ( 206) 00:15:49.708 4.006 - 4.030: 91.0103% ( 157) 00:15:49.708 4.030 - 4.053: 91.9208% ( 126) 00:15:49.708 4.053 - 4.077: 92.7663% ( 117) 00:15:49.708 4.077 - 4.101: 93.7780% ( 140) 00:15:49.708 4.101 - 4.124: 94.6018% ( 114) 00:15:49.708 4.124 - 4.148: 95.1655% ( 78) 00:15:49.708 4.148 - 4.172: 95.6497% ( 67) 00:15:49.708 4.172 - 4.196: 96.0543% ( 56) 00:15:49.708 4.196 - 4.219: 96.3723% ( 44) 00:15:49.708 4.219 - 4.243: 96.6252% ( 35) 00:15:49.708 4.243 - 4.267: 96.8348% ( 29) 00:15:49.708 4.267 - 4.290: 96.9432% ( 15) 00:15:49.708 4.290 - 4.314: 97.0516% ( 15) 00:15:49.708 4.314 - 4.338: 97.1311% ( 11) 00:15:49.708 4.338 - 4.361: 97.2034% ( 10) 00:15:49.708 4.361 - 4.385: 97.2756% ( 10) 00:15:49.708 4.385 - 4.409: 97.3190% ( 6) 00:15:49.708 4.409 - 4.433: 97.3407% ( 3) 00:15:49.708 4.433 - 4.456: 97.3912% ( 7) 00:15:49.708 4.456 - 4.480: 97.4491% ( 8) 00:15:49.708 4.480 - 4.504: 97.4635% ( 2) 00:15:49.708 4.504 - 4.527: 97.4924% ( 4) 00:15:49.708 4.527 - 4.551: 97.5141% ( 3) 00:15:49.708 4.575 - 4.599: 97.5575% ( 6) 00:15:49.708 4.599 - 4.622: 97.5864% ( 4) 00:15:49.708 4.622 - 4.646: 97.6586% ( 10) 00:15:49.708 4.646 - 4.670: 97.6875% ( 4) 00:15:49.708 4.670 - 4.693: 97.7237% ( 5) 00:15:49.708 4.693 - 4.717: 97.7670% ( 6) 00:15:49.708 4.717 - 4.741: 97.7959% ( 4) 00:15:49.708 4.741 - 4.764: 97.8321% ( 5) 00:15:49.708 4.764 - 4.788: 97.9043% ( 10) 00:15:49.708 4.788 - 4.812: 97.9549% ( 7) 00:15:49.708 4.812 - 4.836: 97.9910% ( 5) 00:15:49.708 4.836 - 4.859: 98.0272% ( 5) 00:15:49.708 4.859 - 4.883: 98.0489% ( 3) 00:15:49.708 4.883 - 4.907: 98.0994% ( 7) 00:15:49.708 4.907 - 4.930: 98.1500% ( 7) 00:15:49.708 4.930 - 4.954: 98.2006% ( 7) 00:15:49.708 4.954 - 4.978: 98.2367% ( 5) 00:15:49.708 5.001 - 5.025: 98.2656% ( 4) 00:15:49.708 5.025 - 5.049: 98.2801% ( 2) 00:15:49.708 5.049 - 5.073: 98.2873% ( 1) 00:15:49.708 5.073 - 5.096: 98.2946% ( 1) 00:15:49.708 5.096 - 5.120: 98.3018% ( 1) 00:15:49.708 5.120 - 5.144: 98.3090% ( 1) 00:15:49.708 5.167 - 5.191: 98.3162% ( 1) 00:15:49.708 5.262 - 5.286: 98.3235% ( 1) 00:15:49.708 5.310 - 5.333: 98.3379% ( 2) 00:15:49.708 5.476 - 5.499: 98.3451% ( 1) 00:15:49.708 5.594 - 5.618: 98.3524% ( 1) 00:15:49.708 5.641 - 5.665: 98.3596% ( 1) 00:15:49.708 6.068 - 6.116: 98.3668% ( 1) 00:15:49.708 6.116 - 6.163: 98.3740% ( 1) 00:15:49.708 6.495 - 6.542: 98.3813% ( 1) 00:15:49.708 6.684 - 6.732: 98.3885% ( 1) 00:15:49.708 7.111 - 7.159: 98.4029% ( 2) 00:15:49.708 7.253 - 7.301: 98.4102% ( 1) 00:15:49.708 7.348 - 7.396: 98.4174% ( 1) 00:15:49.708 7.538 - 7.585: 98.4246% ( 1) 00:15:49.708 7.633 - 7.680: 98.4319% ( 1) 00:15:49.708 7.727 - 7.775: 98.4391% ( 1) 00:15:49.708 7.775 - 7.822: 98.4463% ( 1) 00:15:49.708 7.964 - 8.012: 98.4535% ( 1) 00:15:49.708 8.012 - 8.059: 98.4608% ( 1) 00:15:49.708 8.059 - 8.107: 98.4680% ( 1) 00:15:49.708 8.154 - 8.201: 98.4752% ( 1) 00:15:49.708 8.201 - 8.249: 98.4897% ( 2) 00:15:49.708 8.249 - 8.296: 98.4969% ( 1) 00:15:49.708 8.296 - 8.344: 98.5041% ( 1) 00:15:49.708 8.391 - 8.439: 98.5186% ( 2) 00:15:49.709 8.439 - 8.486: 98.5258% ( 1) 00:15:49.709 8.533 - 8.581: 98.5330% ( 1) 00:15:49.709 8.628 - 8.676: 98.5475% ( 2) 00:15:49.709 8.676 - 8.723: 98.5547% ( 1) 00:15:49.709 8.770 - 8.818: 98.5619% ( 1) 00:15:49.709 8.818 - 8.865: 98.5692% ( 1) 00:15:49.709 8.865 - 8.913: 98.5764% ( 1) 00:15:49.709 8.960 - 9.007: 98.5836% ( 1) 00:15:49.709 9.007 - 9.055: 98.5908% ( 1) 00:15:49.709 9.102 - 9.150: 98.5981% ( 1) 00:15:49.709 9.150 - 9.197: 98.6053% ( 1) 00:15:49.709 9.197 - 9.244: 98.6125% ( 1) 00:15:49.709 9.576 - 9.624: 98.6342% ( 3) 00:15:49.709 9.719 - 9.766: 98.6414% ( 1) 00:15:49.709 9.766 - 9.813: 98.6486% ( 1) 00:15:49.709 9.813 - 9.861: 98.6559% ( 1) 00:15:49.709 10.050 - 10.098: 98.6848% ( 4) 00:15:49.709 10.098 - 10.145: 98.6920% ( 1) 00:15:49.709 10.145 - 10.193: 98.6992% ( 1) 00:15:49.709 10.240 - 10.287: 98.7065% ( 1) 00:15:49.709 10.382 - 10.430: 98.7137% ( 1) 00:15:49.709 10.524 - 10.572: 98.7281% ( 2) 00:15:49.709 10.619 - 10.667: 98.7354% ( 1) 00:15:49.709 10.761 - 10.809: 98.7426% ( 1) 00:15:49.709 10.951 - 10.999: 98.7498% ( 1) 00:15:49.709 10.999 - 11.046: 98.7570% ( 1) 00:15:49.709 11.093 - 11.141: 98.7643% ( 1) 00:15:49.709 11.188 - 11.236: 98.7715% ( 1) 00:15:49.709 11.425 - 11.473: 98.7787% ( 1) 00:15:49.709 11.804 - 11.852: 98.7860% ( 1) 00:15:49.709 12.800 - 12.895: 98.7932% ( 1) 00:15:49.709 13.084 - 13.179: 98.8004% ( 1) 00:15:49.709 13.179 - 13.274: 98.8076% ( 1) 00:15:49.709 13.274 - 13.369: 98.8149% ( 1) 00:15:49.709 13.748 - 13.843: 98.8221% ( 1) 00:15:49.709 14.222 - 14.317: 98.8293% ( 1) 00:15:49.709 14.412 - 14.507: 98.8365% ( 1) 00:15:49.709 14.696 - 14.791: 98.8438% ( 1) 00:15:49.709 14.886 - 14.981: 98.8510% ( 1) 00:15:49.709 16.972 - 17.067: 98.8582% ( 1) 00:15:49.709 17.067 - 17.161: 98.8654% ( 1) 00:15:49.709 17.161 - 17.256: 98.8727% ( 1) 00:15:49.709 17.256 - 17.351: 98.8871% ( 2) 00:15:49.709 17.351 - 17.446: 98.9088% ( 3) 00:15:49.709 17.446 - 17.541: 98.9449% ( 5) 00:15:49.709 17.541 - 17.636: 98.9666% ( 3) 00:15:49.709 17.636 - 17.730: 99.0172% ( 7) 00:15:49.709 17.730 - 17.825: 99.0822% ( 9) 00:15:49.709 17.825 - 17.920: 99.1328% ( 7) 00:15:49.709 17.920 - 18.015: 99.1762% ( 6) 00:15:49.709 18.015 - 18.110: 99.2268% ( 7) 00:15:49.709 18.110 - 18.204: 99.3207% ( 13) 00:15:49.709 18.204 - 18.299: 99.4291% ( 15) 00:15:49.709 18.299 - 18.394: 99.4725% ( 6) 00:15:49.709 18.394 - 18.489: 99.5592% ( 12) 00:15:49.709 18.489 - 18.584: 99.6170% ( 8) 00:15:49.709 18.584 - 18.679: 99.6604% ( 6) 00:15:49.709 18.679 - 18.773: 99.7109% ( 7) 00:15:49.709 18.773 - 18.868: 99.7543% ( 6) 00:15:49.709 18.868 - 18.963: 99.7615% ( 1) 00:15:49.709 18.963 - 19.058: 99.7977% ( 5) 00:15:49.709 19.058 - 19.153: 99.8193% ( 3) 00:15:49.709 19.247 - 19.342: 99.8410% ( 3) 00:15:49.709 19.342 - 19.437: 99.8482% ( 1) 00:15:49.709 19.437 - 19.532: 99.8555% ( 1) 00:15:49.709 19.532 - 19.627: 99.8627% ( 1) 00:15:49.709 19.721 - 19.816: 99.8699% ( 1) 00:15:49.709 20.006 - 20.101: 99.8771% ( 1) 00:15:49.709 20.764 - 20.859: 99.8844% ( 1) 00:15:49.709 22.092 - 22.187: 99.8916% ( 1) 00:15:49.709 23.135 - 23.230: 99.8988% ( 1) 00:15:49.709 23.514 - 23.609: 99.9061% ( 1) 00:15:49.709 25.031 - 25.221: 99.9133% ( 1) 00:15:49.709 3980.705 - 4004.978: 99.9783% ( 9) 00:15:49.709 4004.978 - 4029.250: 99.9928% ( 2) 00:15:49.709 5995.330 - 6019.603: 100.0000% ( 1) 00:15:49.709 00:15:49.709 Complete histogram 00:15:49.709 ================== 00:15:49.709 Range in us Cumulative Count 00:15:49.709 2.050 - 2.062: 0.6793% ( 94) 00:15:49.709 2.062 - 2.074: 3.5121% ( 392) 00:15:49.709 2.074 - 2.086: 5.4560% ( 269) 00:15:49.709 2.086 - 2.098: 27.0776% ( 2992) 00:15:49.709 2.098 - 2.110: 54.1335% ( 3744) 00:15:49.709 2.110 - 2.121: 59.7557% ( 778) 00:15:49.709 2.121 - 2.133: 61.4251% ( 231) 00:15:49.709 2.133 - 2.145: 62.3139% ( 123) 00:15:49.709 2.145 - 2.157: 63.7448% ( 198) 00:15:49.709 2.157 - 2.169: 74.1220% ( 1436) 00:15:49.709 2.169 - 2.181: 80.5319% ( 887) 00:15:49.709 2.181 - 2.193: 81.9483% ( 196) 00:15:49.709 2.193 - 2.204: 82.5914% ( 89) 00:15:49.709 2.204 - 2.216: 83.2635% ( 93) 00:15:49.709 2.216 - 2.228: 84.7088% ( 200) 00:15:49.709 2.228 - 2.240: 89.3988% ( 649) 00:15:49.709 2.240 - 2.252: 93.3805% ( 551) 00:15:49.709 2.252 - 2.264: 94.1899% ( 112) 00:15:49.709 2.264 - 2.276: 94.4284% ( 33) 00:15:49.709 2.276 - 2.287: 94.6380% ( 29) 00:15:49.709 2.287 - 2.299: 95.0137% ( 52) 00:15:49.709 2.299 - 2.311: 95.4401% ( 59) 00:15:49.709 2.311 - 2.323: 95.8159% ( 52) 00:15:49.709 2.323 - 2.335: 95.9387% ( 17) 00:15:49.709 2.335 - 2.347: 95.9821% ( 6) 00:15:49.709 2.347 - 2.359: 96.0327% ( 7) 00:15:49.709 2.359 - 2.370: 96.0977% ( 9) 00:15:49.709 2.370 - 2.382: 96.3289% ( 32) 00:15:49.709 2.382 - 2.394: 96.5602% ( 32) 00:15:49.709 2.394 - 2.406: 96.7987% ( 33) 00:15:49.709 2.406 - 2.418: 96.9866% ( 26) 00:15:49.709 2.418 - 2.430: 97.1094% ( 17) 00:15:49.709 2.430 - 2.441: 97.2901% ( 25) 00:15:49.709 2.441 - 2.453: 97.4924% ( 28) 00:15:49.709 2.453 - 2.465: 97.6658% ( 24) 00:15:49.709 2.465 - 2.477: 97.8248% ( 22) 00:15:49.709 2.477 - 2.489: 97.9260% ( 14) 00:15:49.709 2.489 - 2.501: 98.0633% ( 19) 00:15:49.709 2.501 - 2.513: 98.1645% ( 14) 00:15:49.709 2.513 - 2.524: 98.2729% ( 15) 00:15:49.709 2.524 - 2.536: 98.3018% ( 4) 00:15:49.709 2.536 - 2.548: 98.3451% ( 6) 00:15:49.709 2.548 - 2.560: 98.3524% ( 1) 00:15:49.709 2.560 - 2.572: 98.3740% ( 3) 00:15:49.709 2.572 - 2.584: 98.3813% ( 1) 00:15:49.709 2.596 - 2.607: 98.4029% ( 3) 00:15:49.709 2.607 - 2.619: 98.4102% ( 1) 00:15:49.709 2.643 - 2.655: 98.4174% ( 1) 00:15:49.709 2.702 - 2.714: 98.4246% ( 1) 00:15:49.709 2.750 - 2.761: 98.4319% ( 1) 00:15:49.709 2.761 - 2.773: 98.4391% ( 1) 00:15:49.709 2.880 - 2.892: 98.4463% ( 1) 00:15:49.709 3.058 - 3.081: 98.4535% ( 1) 00:15:49.709 3.271 - 3.295: 98.4608% ( 1) 00:15:49.709 3.295 - 3.319: 98.4680% ( 1) 00:15:49.709 3.319 - 3.342: 98.4752% ( 1) 00:15:49.709 3.342 - 3.366: 98.4897% ( 2) 00:15:49.709 3.366 - 3.390: 98.5186% ( 4) 00:15:49.709 3.390 - 3.413: 98.5258% ( 1) 00:15:49.709 3.413 - 3.437: 98.5330% ( 1) 00:15:49.709 3.437 - 3.461: 98.5403% ( 1) 00:15:49.709 3.484 - 3.508: 98.5475% ( 1) 00:15:49.709 3.556 - 3.579: 98.5547% ( 1) 00:15:49.709 3.579 - 3.603: 98.5836% ( 4) 00:15:49.709 3.627 - 3.650: 98.5981% ( 2) 00:15:49.709 3.650 - 3.674: 98.6197% ( 3) 00:15:49.709 3.674 - 3.698: 98.6270% ( 1) 00:15:49.709 3.698 - 3.721: 98.6342% ( 1) 00:15:49.709 3.745 - 3.769: 98.6414% ( 1) 00:15:49.709 3.769 - 3.793: 98.6486% ( 1) 00:15:49.709 3.935 - 3.959: 98.6559% ( 1) 00:15:49.709 3.959 - 3.982: 98.6631% ( 1) 00:15:49.709 4.243 - 4.267: 98.6703% ( 1) 00:15:49.709 5.689 - 5.713: 98.6776% ( 1) 00:15:49.709 5.997 - 6.021: 98.6848% ( 1) 00:15:49.709 6.447 - 6.495: 98.6920% ( 1) 00:15:49.709 6.495 - 6.542: 98.6992% ( 1) 00:15:49.709 6.590 - 6.637: 98.7065% ( 1) 00:15:49.709 6.637 - 6.684: 98.7137% ( 1) 00:15:49.709 6.779 - 6.827: 98.7354% ( 3) 00:15:49.709 6.921 - 6.969: 98.7498% ( 2) 00:15:49.709 7.064 - 7.111: 98.7643% ( 2) 00:15:49.709 7.206 - 7.253: 98.7715% ( 1) 00:15:49.709 7.253 - 7.301: 98.7787% ( 1) 00:15:49.709 7.396 - 7.443: 98.7860% ( 1) 00:15:49.709 7.443 - 7.490: 98.7932% ( 1) 00:15:49.709 7.585 - 7.633: 98.8004% ( 1) 00:15:49.709 7.633 - 7.680: 98.8149% ( 2) 00:15:49.709 8.201 - 8.249: 98.8221% ( 1) 00:15:49.709 8.486 - 8.533: 98.8293% ( 1) 00:15:49.709 8.581 - 8.628: 98.8365% ( 1) 00:15:49.709 9.339 - 9.387: 98.8438% ( 1) 00:15:49.709 9.671 - 9.719: 98.8510% ( 1) 00:15:49.709 11.804 - 11.852: 98.8582% ( 1) 00:15:49.709 15.455 - 15.550: 98.8654% ( 1) 00:15:49.709 15.550 - 15.644: 98.8727% ( 1) 00:15:49.709 15.644 - 15.739: 98.8943% ( 3) 00:15:49.709 15.739 - 15.834: 98.9088% ( 2) 00:15:49.709 15.834 - 15.929: 98.9160% ( 1) 00:15:49.709 15.929 - 16.024: 98.9377% ( 3) 00:15:49.709 16.024 - 16.119: 98.9666% ( 4) 00:15:49.709 16.119 - 16.213: 99.0100% ( 6) 00:15:49.709 16.213 - 16.308: 99.0389% ( 4) 00:15:49.709 16.308 - 16.403: 99.0750% ( 5) 00:15:49.709 16.403 - 16.498: 99.1111% ( 5) 00:15:49.709 16.498 - 16.593: 99.1545% ( 6) 00:15:49.709 16.593 - 16.687: 99.1979% ( 6) 00:15:49.709 16.687 - 16.782: 99.2195% ( 3) 00:15:49.709 16.782 - 16.877: 99.3063% ( 12) 00:15:49.710 16.877 - 16.972: 99.3135% ( 1) 00:15:49.710 16.972 - 17.067: 99.3279% ( 2) 00:15:49.710 17.161 - 17.256: 99.3496% ( 3) 00:15:49.710 17.256 - 17.351: 99.3857% ( 5) 00:15:49.710 17.446 - 17.541: 99.3930% ( 1) 00:15:49.710 17.541 - 17.636: 99.4074% ( 2) 00:15:49.710 17.636 - 17.730: 99.4219% ( 2) 00:15:49.710 17.825 - 17.920: 99.4363% ( 2) 00:15:49.710 17.920 - 18.015: 99.4436% ( 1) 00:15:49.710 18.110 - 18.204: 99.4580% ( 2) 00:15:49.710 18.299 - 18.394: 99.4652% ( 1) 00:15:49.710 1007.313 - 1013.381: 99.4725% ( 1) 00:15:49.710 2014.625 - 2026.761: 99.4797% ( 1) 00:15:49.710 3980.705 - 4004.978: 99.8988% ( 58) 00:15:49.710 4004.978 - 4029.250: 99.9928% ( 13) 00:15:49.710 5995.330 - 6019.603: 100.0000% ( 1) 00:15:49.710 00:15:49.710 02:27:14 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:49.710 02:27:14 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:49.710 02:27:14 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:49.710 02:27:14 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:49.710 02:27:14 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:49.968 [2024-11-27 02:27:14.406337] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:49.968 [ 00:15:49.968 { 00:15:49.968 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:49.968 "subtype": "Discovery", 00:15:49.968 "listen_addresses": [], 00:15:49.968 "allow_any_host": true, 00:15:49.968 "hosts": [] 00:15:49.968 }, 00:15:49.968 { 00:15:49.968 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:49.968 "subtype": "NVMe", 00:15:49.968 "listen_addresses": [ 00:15:49.968 { 00:15:49.968 "transport": "VFIOUSER", 00:15:49.968 "trtype": "VFIOUSER", 00:15:49.968 "adrfam": "IPv4", 00:15:49.968 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:49.968 "trsvcid": "0" 00:15:49.968 } 00:15:49.968 ], 00:15:49.968 "allow_any_host": true, 00:15:49.968 "hosts": [], 00:15:49.968 "serial_number": "SPDK1", 00:15:49.968 "model_number": "SPDK bdev Controller", 00:15:49.968 "max_namespaces": 32, 00:15:49.968 "min_cntlid": 1, 00:15:49.968 "max_cntlid": 65519, 00:15:49.968 "namespaces": [ 00:15:49.968 { 00:15:49.968 "nsid": 1, 00:15:49.968 "bdev_name": "Malloc1", 00:15:49.968 "name": "Malloc1", 00:15:49.968 "nguid": "5EE674D079904EAF911256CD58939560", 00:15:49.968 "uuid": "5ee674d0-7990-4eaf-9112-56cd58939560" 00:15:49.968 } 00:15:49.968 ] 00:15:49.968 }, 00:15:49.968 { 00:15:49.968 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:49.968 "subtype": "NVMe", 00:15:49.968 "listen_addresses": [ 00:15:49.968 { 00:15:49.968 "transport": "VFIOUSER", 00:15:49.968 "trtype": "VFIOUSER", 00:15:49.968 "adrfam": "IPv4", 00:15:49.968 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:49.968 "trsvcid": "0" 00:15:49.968 } 00:15:49.968 ], 00:15:49.968 "allow_any_host": true, 00:15:49.968 "hosts": [], 00:15:49.968 "serial_number": "SPDK2", 00:15:49.968 "model_number": "SPDK bdev Controller", 00:15:49.968 "max_namespaces": 32, 00:15:49.968 "min_cntlid": 1, 00:15:49.968 "max_cntlid": 65519, 00:15:49.968 "namespaces": [ 00:15:49.968 { 00:15:49.968 "nsid": 1, 00:15:49.968 "bdev_name": "Malloc2", 00:15:49.968 "name": "Malloc2", 00:15:49.968 "nguid": "D30694A606414844B535C93EA7FD6186", 00:15:49.968 "uuid": "d30694a6-0641-4844-b535-c93ea7fd6186" 00:15:49.968 } 00:15:49.968 ] 00:15:49.968 } 00:15:49.968 ] 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2046244 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:49.968 02:27:14 -- common/autotest_common.sh@1254 -- # local i=0 00:15:49.968 02:27:14 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:49.968 02:27:14 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:49.968 02:27:14 -- common/autotest_common.sh@1265 -- # return 0 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:49.968 02:27:14 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:49.968 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.227 Malloc3 00:15:50.227 02:27:14 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:50.485 02:27:14 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:50.485 Asynchronous Event Request test 00:15:50.485 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:50.485 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:50.485 Registering asynchronous event callbacks... 00:15:50.485 Starting namespace attribute notice tests for all controllers... 00:15:50.485 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:50.485 aer_cb - Changed Namespace 00:15:50.485 Cleaning up... 00:15:50.744 [ 00:15:50.744 { 00:15:50.744 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:50.744 "subtype": "Discovery", 00:15:50.744 "listen_addresses": [], 00:15:50.744 "allow_any_host": true, 00:15:50.744 "hosts": [] 00:15:50.744 }, 00:15:50.744 { 00:15:50.744 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:50.744 "subtype": "NVMe", 00:15:50.744 "listen_addresses": [ 00:15:50.744 { 00:15:50.744 "transport": "VFIOUSER", 00:15:50.744 "trtype": "VFIOUSER", 00:15:50.744 "adrfam": "IPv4", 00:15:50.744 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:50.744 "trsvcid": "0" 00:15:50.744 } 00:15:50.744 ], 00:15:50.744 "allow_any_host": true, 00:15:50.744 "hosts": [], 00:15:50.744 "serial_number": "SPDK1", 00:15:50.744 "model_number": "SPDK bdev Controller", 00:15:50.744 "max_namespaces": 32, 00:15:50.744 "min_cntlid": 1, 00:15:50.744 "max_cntlid": 65519, 00:15:50.744 "namespaces": [ 00:15:50.744 { 00:15:50.744 "nsid": 1, 00:15:50.744 "bdev_name": "Malloc1", 00:15:50.744 "name": "Malloc1", 00:15:50.744 "nguid": "5EE674D079904EAF911256CD58939560", 00:15:50.744 "uuid": "5ee674d0-7990-4eaf-9112-56cd58939560" 00:15:50.744 }, 00:15:50.745 { 00:15:50.745 "nsid": 2, 00:15:50.745 "bdev_name": "Malloc3", 00:15:50.745 "name": "Malloc3", 00:15:50.745 "nguid": "FD58B8C1824846B79D4190CBE64A08C7", 00:15:50.745 "uuid": "fd58b8c1-8248-46b7-9d41-90cbe64a08c7" 00:15:50.745 } 00:15:50.745 ] 00:15:50.745 }, 00:15:50.745 { 00:15:50.745 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:50.745 "subtype": "NVMe", 00:15:50.745 "listen_addresses": [ 00:15:50.745 { 00:15:50.745 "transport": "VFIOUSER", 00:15:50.745 "trtype": "VFIOUSER", 00:15:50.745 "adrfam": "IPv4", 00:15:50.745 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:50.745 "trsvcid": "0" 00:15:50.745 } 00:15:50.745 ], 00:15:50.745 "allow_any_host": true, 00:15:50.745 "hosts": [], 00:15:50.745 "serial_number": "SPDK2", 00:15:50.745 "model_number": "SPDK bdev Controller", 00:15:50.745 "max_namespaces": 32, 00:15:50.745 "min_cntlid": 1, 00:15:50.745 "max_cntlid": 65519, 00:15:50.745 "namespaces": [ 00:15:50.745 { 00:15:50.745 "nsid": 1, 00:15:50.745 "bdev_name": "Malloc2", 00:15:50.745 "name": "Malloc2", 00:15:50.745 "nguid": "D30694A606414844B535C93EA7FD6186", 00:15:50.745 "uuid": "d30694a6-0641-4844-b535-c93ea7fd6186" 00:15:50.745 } 00:15:50.745 ] 00:15:50.745 } 00:15:50.745 ] 00:15:50.745 02:27:15 -- target/nvmf_vfio_user.sh@44 -- # wait 2046244 00:15:50.745 02:27:15 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:50.745 02:27:15 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:50.745 02:27:15 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:50.745 02:27:15 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:50.745 [2024-11-27 02:27:15.263192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:50.745 [2024-11-27 02:27:15.263227] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2046387 ] 00:15:50.745 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.745 [2024-11-27 02:27:15.294494] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:50.745 [2024-11-27 02:27:15.303823] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:50.745 [2024-11-27 02:27:15.303855] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f089f671000 00:15:50.745 [2024-11-27 02:27:15.304817] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.305821] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.306851] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.307857] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.308861] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.309866] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.310876] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.311867] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:50.745 [2024-11-27 02:27:15.312882] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:50.745 [2024-11-27 02:27:15.312906] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f089e36b000 00:15:50.745 [2024-11-27 02:27:15.314047] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:50.745 [2024-11-27 02:27:15.329246] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:50.745 [2024-11-27 02:27:15.329278] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:50.745 [2024-11-27 02:27:15.334404] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:50.745 [2024-11-27 02:27:15.334453] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:50.745 [2024-11-27 02:27:15.334561] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:50.745 [2024-11-27 02:27:15.334590] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:50.745 [2024-11-27 02:27:15.334601] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:50.745 [2024-11-27 02:27:15.335415] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:50.745 [2024-11-27 02:27:15.335436] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:50.745 [2024-11-27 02:27:15.335447] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:50.745 [2024-11-27 02:27:15.336425] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:50.745 [2024-11-27 02:27:15.336444] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:50.745 [2024-11-27 02:27:15.336458] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.337434] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:50.745 [2024-11-27 02:27:15.337459] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.338441] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:50.745 [2024-11-27 02:27:15.338460] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:50.745 [2024-11-27 02:27:15.338469] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.338480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.338590] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:50.745 [2024-11-27 02:27:15.338600] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.338608] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:50.745 [2024-11-27 02:27:15.339448] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:50.745 [2024-11-27 02:27:15.340453] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:50.745 [2024-11-27 02:27:15.341468] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:50.745 [2024-11-27 02:27:15.342500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:50.745 [2024-11-27 02:27:15.343478] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:50.745 [2024-11-27 02:27:15.343497] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:50.745 [2024-11-27 02:27:15.343521] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:50.745 [2024-11-27 02:27:15.343554] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:50.745 [2024-11-27 02:27:15.343572] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:50.745 [2024-11-27 02:27:15.343591] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:50.745 [2024-11-27 02:27:15.343601] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:50.745 [2024-11-27 02:27:15.343619] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:50.745 [2024-11-27 02:27:15.351542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:50.745 [2024-11-27 02:27:15.351565] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:50.745 [2024-11-27 02:27:15.351575] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:50.745 [2024-11-27 02:27:15.351582] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:50.745 [2024-11-27 02:27:15.351589] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:50.745 [2024-11-27 02:27:15.351601] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:50.745 [2024-11-27 02:27:15.351609] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:50.745 [2024-11-27 02:27:15.351617] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:50.745 [2024-11-27 02:27:15.351634] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.351651] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:50.746 [2024-11-27 02:27:15.359537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:50.746 [2024-11-27 02:27:15.359566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:50.746 [2024-11-27 02:27:15.359580] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:50.746 [2024-11-27 02:27:15.359592] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:50.746 [2024-11-27 02:27:15.359604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:50.746 [2024-11-27 02:27:15.359613] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.359627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.359642] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:50.746 [2024-11-27 02:27:15.367550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:50.746 [2024-11-27 02:27:15.367569] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:50.746 [2024-11-27 02:27:15.367578] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.367589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.367603] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.367618] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:50.746 [2024-11-27 02:27:15.375537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:50.746 [2024-11-27 02:27:15.375610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.375625] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:50.746 [2024-11-27 02:27:15.375638] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:50.746 [2024-11-27 02:27:15.375647] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:50.746 [2024-11-27 02:27:15.375657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.383538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.383567] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:51.006 [2024-11-27 02:27:15.383582] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.383596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.383608] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:51.006 [2024-11-27 02:27:15.383616] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.006 [2024-11-27 02:27:15.383626] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.391538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.391566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.391582] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.391595] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:51.006 [2024-11-27 02:27:15.391603] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.006 [2024-11-27 02:27:15.391612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.399534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.399556] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399568] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399583] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399594] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399610] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:51.006 [2024-11-27 02:27:15.399618] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:51.006 [2024-11-27 02:27:15.399626] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:51.006 [2024-11-27 02:27:15.399649] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.407534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.407561] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.415536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.415561] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.423536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.423562] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.431536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.431562] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:51.006 [2024-11-27 02:27:15.431572] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:51.006 [2024-11-27 02:27:15.431578] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:51.006 [2024-11-27 02:27:15.431584] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:51.006 [2024-11-27 02:27:15.431594] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:51.006 [2024-11-27 02:27:15.431605] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:51.006 [2024-11-27 02:27:15.431613] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:51.006 [2024-11-27 02:27:15.431622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.431632] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:51.006 [2024-11-27 02:27:15.431640] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.006 [2024-11-27 02:27:15.431649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.431660] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:51.006 [2024-11-27 02:27:15.431668] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:51.006 [2024-11-27 02:27:15.431676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:51.006 [2024-11-27 02:27:15.439548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.439577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.439593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:51.006 [2024-11-27 02:27:15.439605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:51.006 ===================================================== 00:15:51.006 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:51.006 ===================================================== 00:15:51.006 Controller Capabilities/Features 00:15:51.006 ================================ 00:15:51.006 Vendor ID: 4e58 00:15:51.006 Subsystem Vendor ID: 4e58 00:15:51.006 Serial Number: SPDK2 00:15:51.006 Model Number: SPDK bdev Controller 00:15:51.006 Firmware Version: 24.01.1 00:15:51.006 Recommended Arb Burst: 6 00:15:51.006 IEEE OUI Identifier: 8d 6b 50 00:15:51.006 Multi-path I/O 00:15:51.006 May have multiple subsystem ports: Yes 00:15:51.006 May have multiple controllers: Yes 00:15:51.006 Associated with SR-IOV VF: No 00:15:51.006 Max Data Transfer Size: 131072 00:15:51.006 Max Number of Namespaces: 32 00:15:51.006 Max Number of I/O Queues: 127 00:15:51.006 NVMe Specification Version (VS): 1.3 00:15:51.006 NVMe Specification Version (Identify): 1.3 00:15:51.006 Maximum Queue Entries: 256 00:15:51.006 Contiguous Queues Required: Yes 00:15:51.006 Arbitration Mechanisms Supported 00:15:51.006 Weighted Round Robin: Not Supported 00:15:51.006 Vendor Specific: Not Supported 00:15:51.006 Reset Timeout: 15000 ms 00:15:51.006 Doorbell Stride: 4 bytes 00:15:51.006 NVM Subsystem Reset: Not Supported 00:15:51.006 Command Sets Supported 00:15:51.006 NVM Command Set: Supported 00:15:51.006 Boot Partition: Not Supported 00:15:51.006 Memory Page Size Minimum: 4096 bytes 00:15:51.006 Memory Page Size Maximum: 4096 bytes 00:15:51.006 Persistent Memory Region: Not Supported 00:15:51.006 Optional Asynchronous Events Supported 00:15:51.006 Namespace Attribute Notices: Supported 00:15:51.006 Firmware Activation Notices: Not Supported 00:15:51.006 ANA Change Notices: Not Supported 00:15:51.006 PLE Aggregate Log Change Notices: Not Supported 00:15:51.006 LBA Status Info Alert Notices: Not Supported 00:15:51.006 EGE Aggregate Log Change Notices: Not Supported 00:15:51.006 Normal NVM Subsystem Shutdown event: Not Supported 00:15:51.006 Zone Descriptor Change Notices: Not Supported 00:15:51.006 Discovery Log Change Notices: Not Supported 00:15:51.006 Controller Attributes 00:15:51.006 128-bit Host Identifier: Supported 00:15:51.006 Non-Operational Permissive Mode: Not Supported 00:15:51.006 NVM Sets: Not Supported 00:15:51.006 Read Recovery Levels: Not Supported 00:15:51.006 Endurance Groups: Not Supported 00:15:51.006 Predictable Latency Mode: Not Supported 00:15:51.006 Traffic Based Keep ALive: Not Supported 00:15:51.006 Namespace Granularity: Not Supported 00:15:51.006 SQ Associations: Not Supported 00:15:51.006 UUID List: Not Supported 00:15:51.007 Multi-Domain Subsystem: Not Supported 00:15:51.007 Fixed Capacity Management: Not Supported 00:15:51.007 Variable Capacity Management: Not Supported 00:15:51.007 Delete Endurance Group: Not Supported 00:15:51.007 Delete NVM Set: Not Supported 00:15:51.007 Extended LBA Formats Supported: Not Supported 00:15:51.007 Flexible Data Placement Supported: Not Supported 00:15:51.007 00:15:51.007 Controller Memory Buffer Support 00:15:51.007 ================================ 00:15:51.007 Supported: No 00:15:51.007 00:15:51.007 Persistent Memory Region Support 00:15:51.007 ================================ 00:15:51.007 Supported: No 00:15:51.007 00:15:51.007 Admin Command Set Attributes 00:15:51.007 ============================ 00:15:51.007 Security Send/Receive: Not Supported 00:15:51.007 Format NVM: Not Supported 00:15:51.007 Firmware Activate/Download: Not Supported 00:15:51.007 Namespace Management: Not Supported 00:15:51.007 Device Self-Test: Not Supported 00:15:51.007 Directives: Not Supported 00:15:51.007 NVMe-MI: Not Supported 00:15:51.007 Virtualization Management: Not Supported 00:15:51.007 Doorbell Buffer Config: Not Supported 00:15:51.007 Get LBA Status Capability: Not Supported 00:15:51.007 Command & Feature Lockdown Capability: Not Supported 00:15:51.007 Abort Command Limit: 4 00:15:51.007 Async Event Request Limit: 4 00:15:51.007 Number of Firmware Slots: N/A 00:15:51.007 Firmware Slot 1 Read-Only: N/A 00:15:51.007 Firmware Activation Without Reset: N/A 00:15:51.007 Multiple Update Detection Support: N/A 00:15:51.007 Firmware Update Granularity: No Information Provided 00:15:51.007 Per-Namespace SMART Log: No 00:15:51.007 Asymmetric Namespace Access Log Page: Not Supported 00:15:51.007 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:51.007 Command Effects Log Page: Supported 00:15:51.007 Get Log Page Extended Data: Supported 00:15:51.007 Telemetry Log Pages: Not Supported 00:15:51.007 Persistent Event Log Pages: Not Supported 00:15:51.007 Supported Log Pages Log Page: May Support 00:15:51.007 Commands Supported & Effects Log Page: Not Supported 00:15:51.007 Feature Identifiers & Effects Log Page:May Support 00:15:51.007 NVMe-MI Commands & Effects Log Page: May Support 00:15:51.007 Data Area 4 for Telemetry Log: Not Supported 00:15:51.007 Error Log Page Entries Supported: 128 00:15:51.007 Keep Alive: Supported 00:15:51.007 Keep Alive Granularity: 10000 ms 00:15:51.007 00:15:51.007 NVM Command Set Attributes 00:15:51.007 ========================== 00:15:51.007 Submission Queue Entry Size 00:15:51.007 Max: 64 00:15:51.007 Min: 64 00:15:51.007 Completion Queue Entry Size 00:15:51.007 Max: 16 00:15:51.007 Min: 16 00:15:51.007 Number of Namespaces: 32 00:15:51.007 Compare Command: Supported 00:15:51.007 Write Uncorrectable Command: Not Supported 00:15:51.007 Dataset Management Command: Supported 00:15:51.007 Write Zeroes Command: Supported 00:15:51.007 Set Features Save Field: Not Supported 00:15:51.007 Reservations: Not Supported 00:15:51.007 Timestamp: Not Supported 00:15:51.007 Copy: Supported 00:15:51.007 Volatile Write Cache: Present 00:15:51.007 Atomic Write Unit (Normal): 1 00:15:51.007 Atomic Write Unit (PFail): 1 00:15:51.007 Atomic Compare & Write Unit: 1 00:15:51.007 Fused Compare & Write: Supported 00:15:51.007 Scatter-Gather List 00:15:51.007 SGL Command Set: Supported (Dword aligned) 00:15:51.007 SGL Keyed: Not Supported 00:15:51.007 SGL Bit Bucket Descriptor: Not Supported 00:15:51.007 SGL Metadata Pointer: Not Supported 00:15:51.007 Oversized SGL: Not Supported 00:15:51.007 SGL Metadata Address: Not Supported 00:15:51.007 SGL Offset: Not Supported 00:15:51.007 Transport SGL Data Block: Not Supported 00:15:51.007 Replay Protected Memory Block: Not Supported 00:15:51.007 00:15:51.007 Firmware Slot Information 00:15:51.007 ========================= 00:15:51.007 Active slot: 1 00:15:51.007 Slot 1 Firmware Revision: 24.01.1 00:15:51.007 00:15:51.007 00:15:51.007 Commands Supported and Effects 00:15:51.007 ============================== 00:15:51.007 Admin Commands 00:15:51.007 -------------- 00:15:51.007 Get Log Page (02h): Supported 00:15:51.007 Identify (06h): Supported 00:15:51.007 Abort (08h): Supported 00:15:51.007 Set Features (09h): Supported 00:15:51.007 Get Features (0Ah): Supported 00:15:51.007 Asynchronous Event Request (0Ch): Supported 00:15:51.007 Keep Alive (18h): Supported 00:15:51.007 I/O Commands 00:15:51.007 ------------ 00:15:51.007 Flush (00h): Supported LBA-Change 00:15:51.007 Write (01h): Supported LBA-Change 00:15:51.007 Read (02h): Supported 00:15:51.007 Compare (05h): Supported 00:15:51.007 Write Zeroes (08h): Supported LBA-Change 00:15:51.007 Dataset Management (09h): Supported LBA-Change 00:15:51.007 Copy (19h): Supported LBA-Change 00:15:51.007 Unknown (79h): Supported LBA-Change 00:15:51.007 Unknown (7Ah): Supported 00:15:51.007 00:15:51.007 Error Log 00:15:51.007 ========= 00:15:51.007 00:15:51.007 Arbitration 00:15:51.007 =========== 00:15:51.007 Arbitration Burst: 1 00:15:51.007 00:15:51.007 Power Management 00:15:51.007 ================ 00:15:51.007 Number of Power States: 1 00:15:51.007 Current Power State: Power State #0 00:15:51.007 Power State #0: 00:15:51.007 Max Power: 0.00 W 00:15:51.007 Non-Operational State: Operational 00:15:51.007 Entry Latency: Not Reported 00:15:51.007 Exit Latency: Not Reported 00:15:51.007 Relative Read Throughput: 0 00:15:51.007 Relative Read Latency: 0 00:15:51.007 Relative Write Throughput: 0 00:15:51.007 Relative Write Latency: 0 00:15:51.007 Idle Power: Not Reported 00:15:51.007 Active Power: Not Reported 00:15:51.007 Non-Operational Permissive Mode: Not Supported 00:15:51.007 00:15:51.007 Health Information 00:15:51.007 ================== 00:15:51.007 Critical Warnings: 00:15:51.007 Available Spare Space: OK 00:15:51.007 Temperature: OK 00:15:51.007 Device Reliability: OK 00:15:51.007 Read Only: No 00:15:51.007 Volatile Memory Backup: OK 00:15:51.007 Current Temperature: 0 Kelvin[2024-11-27 02:27:15.439723] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:51.007 [2024-11-27 02:27:15.447538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:51.007 [2024-11-27 02:27:15.447580] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:51.007 [2024-11-27 02:27:15.447598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.007 [2024-11-27 02:27:15.447609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.007 [2024-11-27 02:27:15.447623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.007 [2024-11-27 02:27:15.447633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.007 [2024-11-27 02:27:15.447714] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:51.007 [2024-11-27 02:27:15.447735] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:51.007 [2024-11-27 02:27:15.448749] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:51.007 [2024-11-27 02:27:15.448765] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:51.007 [2024-11-27 02:27:15.449718] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:51.007 [2024-11-27 02:27:15.449742] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:51.007 [2024-11-27 02:27:15.449795] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:51.007 [2024-11-27 02:27:15.451035] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:51.007 (-273 Celsius) 00:15:51.007 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:51.007 Available Spare: 0% 00:15:51.007 Available Spare Threshold: 0% 00:15:51.007 Life Percentage Used: 0% 00:15:51.007 Data Units Read: 0 00:15:51.007 Data Units Written: 0 00:15:51.007 Host Read Commands: 0 00:15:51.007 Host Write Commands: 0 00:15:51.007 Controller Busy Time: 0 minutes 00:15:51.007 Power Cycles: 0 00:15:51.007 Power On Hours: 0 hours 00:15:51.007 Unsafe Shutdowns: 0 00:15:51.007 Unrecoverable Media Errors: 0 00:15:51.007 Lifetime Error Log Entries: 0 00:15:51.007 Warning Temperature Time: 0 minutes 00:15:51.007 Critical Temperature Time: 0 minutes 00:15:51.007 00:15:51.007 Number of Queues 00:15:51.007 ================ 00:15:51.007 Number of I/O Submission Queues: 127 00:15:51.007 Number of I/O Completion Queues: 127 00:15:51.007 00:15:51.007 Active Namespaces 00:15:51.007 ================= 00:15:51.007 Namespace ID:1 00:15:51.007 Error Recovery Timeout: Unlimited 00:15:51.007 Command Set Identifier: NVM (00h) 00:15:51.007 Deallocate: Supported 00:15:51.008 Deallocated/Unwritten Error: Not Supported 00:15:51.008 Deallocated Read Value: Unknown 00:15:51.008 Deallocate in Write Zeroes: Not Supported 00:15:51.008 Deallocated Guard Field: 0xFFFF 00:15:51.008 Flush: Supported 00:15:51.008 Reservation: Supported 00:15:51.008 Namespace Sharing Capabilities: Multiple Controllers 00:15:51.008 Size (in LBAs): 131072 (0GiB) 00:15:51.008 Capacity (in LBAs): 131072 (0GiB) 00:15:51.008 Utilization (in LBAs): 131072 (0GiB) 00:15:51.008 NGUID: D30694A606414844B535C93EA7FD6186 00:15:51.008 UUID: d30694a6-0641-4844-b535-c93ea7fd6186 00:15:51.008 Thin Provisioning: Not Supported 00:15:51.008 Per-NS Atomic Units: Yes 00:15:51.008 Atomic Boundary Size (Normal): 0 00:15:51.008 Atomic Boundary Size (PFail): 0 00:15:51.008 Atomic Boundary Offset: 0 00:15:51.008 Maximum Single Source Range Length: 65535 00:15:51.008 Maximum Copy Length: 65535 00:15:51.008 Maximum Source Range Count: 1 00:15:51.008 NGUID/EUI64 Never Reused: No 00:15:51.008 Namespace Write Protected: No 00:15:51.008 Number of LBA Formats: 1 00:15:51.008 Current LBA Format: LBA Format #00 00:15:51.008 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:51.008 00:15:51.008 02:27:15 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:51.008 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.286 Initializing NVMe Controllers 00:15:56.286 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:56.286 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:56.286 Initialization complete. Launching workers. 00:15:56.286 ======================================================== 00:15:56.286 Latency(us) 00:15:56.286 Device Information : IOPS MiB/s Average min max 00:15:56.286 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38055.22 148.65 3362.94 1149.24 7515.81 00:15:56.286 ======================================================== 00:15:56.286 Total : 38055.22 148.65 3362.94 1149.24 7515.81 00:15:56.286 00:15:56.286 02:27:20 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:56.286 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.561 Initializing NVMe Controllers 00:16:01.561 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:01.561 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:01.561 Initialization complete. Launching workers. 00:16:01.561 ======================================================== 00:16:01.561 Latency(us) 00:16:01.561 Device Information : IOPS MiB/s Average min max 00:16:01.561 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36383.99 142.12 3517.48 1151.10 7657.86 00:16:01.561 ======================================================== 00:16:01.561 Total : 36383.99 142.12 3517.48 1151.10 7657.86 00:16:01.561 00:16:01.561 02:27:26 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:01.561 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.834 Initializing NVMe Controllers 00:16:06.834 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:06.834 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:06.834 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:06.834 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:06.834 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:06.834 Initialization complete. Launching workers. 00:16:06.834 Starting thread on core 2 00:16:06.834 Starting thread on core 3 00:16:06.834 Starting thread on core 1 00:16:06.834 02:27:31 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:07.092 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.388 Initializing NVMe Controllers 00:16:10.388 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:10.388 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:10.388 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:10.388 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:10.388 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:10.388 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:10.388 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:10.388 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:10.388 Initialization complete. Launching workers. 00:16:10.388 Starting thread on core 1 with urgent priority queue 00:16:10.388 Starting thread on core 2 with urgent priority queue 00:16:10.388 Starting thread on core 3 with urgent priority queue 00:16:10.388 Starting thread on core 0 with urgent priority queue 00:16:10.388 SPDK bdev Controller (SPDK2 ) core 0: 6127.67 IO/s 16.32 secs/100000 ios 00:16:10.388 SPDK bdev Controller (SPDK2 ) core 1: 5980.33 IO/s 16.72 secs/100000 ios 00:16:10.388 SPDK bdev Controller (SPDK2 ) core 2: 6198.67 IO/s 16.13 secs/100000 ios 00:16:10.388 SPDK bdev Controller (SPDK2 ) core 3: 5620.67 IO/s 17.79 secs/100000 ios 00:16:10.388 ======================================================== 00:16:10.388 00:16:10.388 02:27:34 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:10.388 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.648 Initializing NVMe Controllers 00:16:10.648 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:10.648 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:10.648 Namespace ID: 1 size: 0GB 00:16:10.648 Initialization complete. 00:16:10.648 INFO: using host memory buffer for IO 00:16:10.648 Hello world! 00:16:10.648 02:27:35 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:10.648 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.027 Initializing NVMe Controllers 00:16:12.027 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.027 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.027 Initialization complete. Launching workers. 00:16:12.027 submit (in ns) avg, min, max = 10045.4, 3450.0, 5000832.2 00:16:12.027 complete (in ns) avg, min, max = 23079.4, 2060.0, 4018226.7 00:16:12.027 00:16:12.027 Submit histogram 00:16:12.027 ================ 00:16:12.027 Range in us Cumulative Count 00:16:12.027 3.437 - 3.461: 0.1453% ( 20) 00:16:12.027 3.461 - 3.484: 0.7410% ( 82) 00:16:12.027 3.484 - 3.508: 2.2882% ( 213) 00:16:12.027 3.508 - 3.532: 5.3538% ( 422) 00:16:12.027 3.532 - 3.556: 11.5139% ( 848) 00:16:12.027 3.556 - 3.579: 20.4853% ( 1235) 00:16:12.027 3.579 - 3.603: 29.6600% ( 1263) 00:16:12.027 3.603 - 3.627: 39.0019% ( 1286) 00:16:12.027 3.627 - 3.650: 46.3533% ( 1012) 00:16:12.027 3.650 - 3.674: 53.4505% ( 977) 00:16:12.027 3.674 - 3.698: 58.8624% ( 745) 00:16:12.027 3.698 - 3.721: 64.0418% ( 713) 00:16:12.027 3.721 - 3.745: 67.0638% ( 416) 00:16:12.027 3.745 - 3.769: 70.5797% ( 484) 00:16:12.027 3.769 - 3.793: 73.9430% ( 463) 00:16:12.027 3.793 - 3.816: 77.5025% ( 490) 00:16:12.027 3.816 - 3.840: 81.0620% ( 490) 00:16:12.027 3.840 - 3.864: 84.1276% ( 422) 00:16:12.027 3.864 - 3.887: 86.7645% ( 363) 00:16:12.027 3.887 - 3.911: 88.6387% ( 258) 00:16:12.027 3.911 - 3.935: 90.2223% ( 218) 00:16:12.027 3.935 - 3.959: 91.6098% ( 191) 00:16:12.027 3.959 - 3.982: 92.5614% ( 131) 00:16:12.027 3.982 - 4.006: 93.3750% ( 112) 00:16:12.027 4.006 - 4.030: 94.0142% ( 88) 00:16:12.027 4.030 - 4.053: 94.6099% ( 82) 00:16:12.027 4.053 - 4.077: 94.9804% ( 51) 00:16:12.027 4.077 - 4.101: 95.3872% ( 56) 00:16:12.027 4.101 - 4.124: 95.6196% ( 32) 00:16:12.027 4.124 - 4.148: 95.7722% ( 21) 00:16:12.027 4.148 - 4.172: 95.9756% ( 28) 00:16:12.027 4.172 - 4.196: 96.0773% ( 14) 00:16:12.027 4.196 - 4.219: 96.2589% ( 25) 00:16:12.027 4.219 - 4.243: 96.3679% ( 15) 00:16:12.027 4.243 - 4.267: 96.5277% ( 22) 00:16:12.027 4.267 - 4.290: 96.6730% ( 20) 00:16:12.027 4.290 - 4.314: 96.7383% ( 9) 00:16:12.027 4.314 - 4.338: 96.8255% ( 12) 00:16:12.027 4.338 - 4.361: 96.9054% ( 11) 00:16:12.027 4.361 - 4.385: 96.9853% ( 11) 00:16:12.027 4.385 - 4.409: 97.0507% ( 9) 00:16:12.027 4.409 - 4.433: 97.1161% ( 9) 00:16:12.027 4.433 - 4.456: 97.1887% ( 10) 00:16:12.027 4.456 - 4.480: 97.2105% ( 3) 00:16:12.027 4.480 - 4.504: 97.2541% ( 6) 00:16:12.027 4.504 - 4.527: 97.2686% ( 2) 00:16:12.027 4.527 - 4.551: 97.2832% ( 2) 00:16:12.027 4.551 - 4.575: 97.3050% ( 3) 00:16:12.027 4.575 - 4.599: 97.3267% ( 3) 00:16:12.027 4.599 - 4.622: 97.3485% ( 3) 00:16:12.027 4.622 - 4.646: 97.3558% ( 1) 00:16:12.027 4.646 - 4.670: 97.3776% ( 3) 00:16:12.027 4.693 - 4.717: 97.3994% ( 3) 00:16:12.027 4.717 - 4.741: 97.4212% ( 3) 00:16:12.027 4.741 - 4.764: 97.4284% ( 1) 00:16:12.027 4.764 - 4.788: 97.4357% ( 1) 00:16:12.027 4.788 - 4.812: 97.4502% ( 2) 00:16:12.027 4.812 - 4.836: 97.4648% ( 2) 00:16:12.027 4.836 - 4.859: 97.4793% ( 2) 00:16:12.027 4.859 - 4.883: 97.5011% ( 3) 00:16:12.027 4.883 - 4.907: 97.5374% ( 5) 00:16:12.027 4.907 - 4.930: 97.5592% ( 3) 00:16:12.027 4.930 - 4.954: 97.6173% ( 8) 00:16:12.027 4.954 - 4.978: 97.6609% ( 6) 00:16:12.027 4.978 - 5.001: 97.6827% ( 3) 00:16:12.027 5.001 - 5.025: 97.7263% ( 6) 00:16:12.027 5.025 - 5.049: 97.7553% ( 4) 00:16:12.027 5.049 - 5.073: 97.7917% ( 5) 00:16:12.027 5.073 - 5.096: 97.8425% ( 7) 00:16:12.027 5.096 - 5.120: 97.8861% ( 6) 00:16:12.027 5.120 - 5.144: 97.9297% ( 6) 00:16:12.027 5.144 - 5.167: 97.9878% ( 8) 00:16:12.027 5.167 - 5.191: 98.0314% ( 6) 00:16:12.027 5.191 - 5.215: 98.0750% ( 6) 00:16:12.027 5.215 - 5.239: 98.1040% ( 4) 00:16:12.027 5.239 - 5.262: 98.1258% ( 3) 00:16:12.027 5.262 - 5.286: 98.1403% ( 2) 00:16:12.027 5.286 - 5.310: 98.1912% ( 7) 00:16:12.027 5.310 - 5.333: 98.2275% ( 5) 00:16:12.027 5.333 - 5.357: 98.2420% ( 2) 00:16:12.027 5.357 - 5.381: 98.2566% ( 2) 00:16:12.027 5.404 - 5.428: 98.2784% ( 3) 00:16:12.027 5.452 - 5.476: 98.2929% ( 2) 00:16:12.027 5.476 - 5.499: 98.3074% ( 2) 00:16:12.027 5.499 - 5.523: 98.3220% ( 2) 00:16:12.027 5.547 - 5.570: 98.3292% ( 1) 00:16:12.027 5.570 - 5.594: 98.3365% ( 1) 00:16:12.027 5.641 - 5.665: 98.3510% ( 2) 00:16:12.027 5.665 - 5.689: 98.3583% ( 1) 00:16:12.027 5.689 - 5.713: 98.3728% ( 2) 00:16:12.027 5.736 - 5.760: 98.3873% ( 2) 00:16:12.027 5.784 - 5.807: 98.3946% ( 1) 00:16:12.027 5.902 - 5.926: 98.4091% ( 2) 00:16:12.027 5.997 - 6.021: 98.4164% ( 1) 00:16:12.027 6.021 - 6.044: 98.4237% ( 1) 00:16:12.027 6.044 - 6.068: 98.4309% ( 1) 00:16:12.027 6.116 - 6.163: 98.4382% ( 1) 00:16:12.027 6.163 - 6.210: 98.4527% ( 2) 00:16:12.027 6.305 - 6.353: 98.4600% ( 1) 00:16:12.027 6.400 - 6.447: 98.4672% ( 1) 00:16:12.027 6.495 - 6.542: 98.4745% ( 1) 00:16:12.027 6.590 - 6.637: 98.4890% ( 2) 00:16:12.027 6.684 - 6.732: 98.4963% ( 1) 00:16:12.027 7.159 - 7.206: 98.5036% ( 1) 00:16:12.027 7.348 - 7.396: 98.5108% ( 1) 00:16:12.027 7.443 - 7.490: 98.5254% ( 2) 00:16:12.027 7.490 - 7.538: 98.5399% ( 2) 00:16:12.027 7.538 - 7.585: 98.5471% ( 1) 00:16:12.027 7.775 - 7.822: 98.5544% ( 1) 00:16:12.027 7.870 - 7.917: 98.5617% ( 1) 00:16:12.027 8.012 - 8.059: 98.5689% ( 1) 00:16:12.027 8.059 - 8.107: 98.5762% ( 1) 00:16:12.027 8.107 - 8.154: 98.5835% ( 1) 00:16:12.027 8.154 - 8.201: 98.5907% ( 1) 00:16:12.027 8.249 - 8.296: 98.5980% ( 1) 00:16:12.027 8.296 - 8.344: 98.6053% ( 1) 00:16:12.027 8.344 - 8.391: 98.6125% ( 1) 00:16:12.027 8.439 - 8.486: 98.6198% ( 1) 00:16:12.027 8.486 - 8.533: 98.6343% ( 2) 00:16:12.027 8.581 - 8.628: 98.6416% ( 1) 00:16:12.027 8.676 - 8.723: 98.6488% ( 1) 00:16:12.027 8.723 - 8.770: 98.6706% ( 3) 00:16:12.027 8.818 - 8.865: 98.6852% ( 2) 00:16:12.027 8.865 - 8.913: 98.6924% ( 1) 00:16:12.027 9.007 - 9.055: 98.6997% ( 1) 00:16:12.027 9.150 - 9.197: 98.7070% ( 1) 00:16:12.027 9.292 - 9.339: 98.7142% ( 1) 00:16:12.027 9.387 - 9.434: 98.7215% ( 1) 00:16:12.027 9.434 - 9.481: 98.7288% ( 1) 00:16:12.027 9.481 - 9.529: 98.7360% ( 1) 00:16:12.027 9.576 - 9.624: 98.7433% ( 1) 00:16:12.027 9.671 - 9.719: 98.7505% ( 1) 00:16:12.027 9.719 - 9.766: 98.7578% ( 1) 00:16:12.027 9.766 - 9.813: 98.7723% ( 2) 00:16:12.027 9.861 - 9.908: 98.7796% ( 1) 00:16:12.027 9.908 - 9.956: 98.7869% ( 1) 00:16:12.027 9.956 - 10.003: 98.8087% ( 3) 00:16:12.027 10.003 - 10.050: 98.8232% ( 2) 00:16:12.027 10.145 - 10.193: 98.8305% ( 1) 00:16:12.027 10.193 - 10.240: 98.8377% ( 1) 00:16:12.027 10.287 - 10.335: 98.8522% ( 2) 00:16:12.027 10.335 - 10.382: 98.8595% ( 1) 00:16:12.027 10.524 - 10.572: 98.8668% ( 1) 00:16:12.027 10.619 - 10.667: 98.8740% ( 1) 00:16:12.027 10.856 - 10.904: 98.8813% ( 1) 00:16:12.027 10.904 - 10.951: 98.8886% ( 1) 00:16:12.027 11.093 - 11.141: 98.8958% ( 1) 00:16:12.027 11.188 - 11.236: 98.9031% ( 1) 00:16:12.027 11.236 - 11.283: 98.9176% ( 2) 00:16:12.027 11.330 - 11.378: 98.9249% ( 1) 00:16:12.027 11.378 - 11.425: 98.9322% ( 1) 00:16:12.027 11.425 - 11.473: 98.9394% ( 1) 00:16:12.027 11.852 - 11.899: 98.9467% ( 1) 00:16:12.028 12.041 - 12.089: 98.9539% ( 1) 00:16:12.028 12.326 - 12.421: 98.9612% ( 1) 00:16:12.028 12.421 - 12.516: 98.9685% ( 1) 00:16:12.028 12.610 - 12.705: 98.9757% ( 1) 00:16:12.028 12.990 - 13.084: 98.9903% ( 2) 00:16:12.028 13.084 - 13.179: 98.9975% ( 1) 00:16:12.028 13.179 - 13.274: 99.0048% ( 1) 00:16:12.028 13.274 - 13.369: 99.0121% ( 1) 00:16:12.028 13.369 - 13.464: 99.0193% ( 1) 00:16:12.028 13.559 - 13.653: 99.0266% ( 1) 00:16:12.028 13.748 - 13.843: 99.0339% ( 1) 00:16:12.028 13.938 - 14.033: 99.0411% ( 1) 00:16:12.028 15.170 - 15.265: 99.0484% ( 1) 00:16:12.028 17.161 - 17.256: 99.0774% ( 4) 00:16:12.028 17.256 - 17.351: 99.0920% ( 2) 00:16:12.028 17.351 - 17.446: 99.1283% ( 5) 00:16:12.028 17.446 - 17.541: 99.1573% ( 4) 00:16:12.028 17.541 - 17.636: 99.1937% ( 5) 00:16:12.028 17.636 - 17.730: 99.2227% ( 4) 00:16:12.028 17.730 - 17.825: 99.2373% ( 2) 00:16:12.028 17.825 - 17.920: 99.3026% ( 9) 00:16:12.028 17.920 - 18.015: 99.3317% ( 4) 00:16:12.028 18.015 - 18.110: 99.3825% ( 7) 00:16:12.028 18.110 - 18.204: 99.4552% ( 10) 00:16:12.028 18.204 - 18.299: 99.5133% ( 8) 00:16:12.028 18.299 - 18.394: 99.5787% ( 9) 00:16:12.028 18.394 - 18.489: 99.6223% ( 6) 00:16:12.028 18.489 - 18.584: 99.6513% ( 4) 00:16:12.028 18.584 - 18.679: 99.6586% ( 1) 00:16:12.028 18.679 - 18.773: 99.7022% ( 6) 00:16:12.028 18.773 - 18.868: 99.7385% ( 5) 00:16:12.028 18.868 - 18.963: 99.7530% ( 2) 00:16:12.028 18.963 - 19.058: 99.7603% ( 1) 00:16:12.028 19.058 - 19.153: 99.7675% ( 1) 00:16:12.028 19.153 - 19.247: 99.7893% ( 3) 00:16:12.028 19.247 - 19.342: 99.7966% ( 1) 00:16:12.028 19.627 - 19.721: 99.8039% ( 1) 00:16:12.028 19.911 - 20.006: 99.8111% ( 1) 00:16:12.028 20.764 - 20.859: 99.8184% ( 1) 00:16:12.028 21.902 - 21.997: 99.8257% ( 1) 00:16:12.028 24.178 - 24.273: 99.8329% ( 1) 00:16:12.028 25.031 - 25.221: 99.8402% ( 1) 00:16:12.028 25.221 - 25.410: 99.8475% ( 1) 00:16:12.028 3980.705 - 4004.978: 99.9637% ( 16) 00:16:12.028 4004.978 - 4029.250: 99.9927% ( 4) 00:16:12.028 5000.154 - 5024.427: 100.0000% ( 1) 00:16:12.028 00:16:12.028 Complete histogram 00:16:12.028 ================== 00:16:12.028 Range in us Cumulative Count 00:16:12.028 2.050 - 2.062: 0.0073% ( 1) 00:16:12.028 2.062 - 2.074: 3.8137% ( 524) 00:16:12.028 2.074 - 2.086: 15.2986% ( 1581) 00:16:12.028 2.086 - 2.098: 17.2163% ( 264) 00:16:12.028 2.098 - 2.110: 36.5756% ( 2665) 00:16:12.028 2.110 - 2.121: 58.1433% ( 2969) 00:16:12.028 2.121 - 2.133: 61.3759% ( 445) 00:16:12.028 2.133 - 2.145: 64.8046% ( 472) 00:16:12.028 2.145 - 2.157: 68.0227% ( 443) 00:16:12.028 2.157 - 2.169: 69.4029% ( 190) 00:16:12.028 2.169 - 2.181: 80.0741% ( 1469) 00:16:12.028 2.181 - 2.193: 87.0914% ( 966) 00:16:12.028 2.193 - 2.204: 88.6387% ( 213) 00:16:12.028 2.204 - 2.216: 90.1932% ( 214) 00:16:12.028 2.216 - 2.228: 91.2683% ( 148) 00:16:12.028 2.228 - 2.240: 92.0238% ( 104) 00:16:12.028 2.240 - 2.252: 93.6583% ( 225) 00:16:12.028 2.252 - 2.264: 94.7407% ( 149) 00:16:12.028 2.264 - 2.276: 94.9659% ( 31) 00:16:12.028 2.276 - 2.287: 95.2564% ( 40) 00:16:12.028 2.287 - 2.299: 95.4671% ( 29) 00:16:12.028 2.299 - 2.311: 95.6414% ( 24) 00:16:12.028 2.311 - 2.323: 95.7940% ( 21) 00:16:12.028 2.323 - 2.335: 95.8521% ( 8) 00:16:12.028 2.335 - 2.347: 95.9029% ( 7) 00:16:12.028 2.347 - 2.359: 95.9538% ( 7) 00:16:12.028 2.359 - 2.370: 96.0846% ( 18) 00:16:12.028 2.370 - 2.382: 96.2008% ( 16) 00:16:12.028 2.382 - 2.394: 96.3751% ( 24) 00:16:12.028 2.394 - 2.406: 96.5204% ( 20) 00:16:12.028 2.406 - 2.418: 96.7165% ( 27) 00:16:12.028 2.418 - 2.430: 96.8546% ( 19) 00:16:12.028 2.430 - 2.441: 96.9999% ( 20) 00:16:12.028 2.441 - 2.453: 97.1016% ( 14) 00:16:12.028 2.453 - 2.465: 97.2033% ( 14) 00:16:12.028 2.465 - 2.477: 97.3195% ( 16) 00:16:12.028 2.477 - 2.489: 97.3849% ( 9) 00:16:12.028 2.489 - 2.501: 97.4720% ( 12) 00:16:12.028 2.501 - 2.513: 97.5592% ( 12) 00:16:12.028 2.513 - 2.524: 97.6246% ( 9) 00:16:12.028 2.524 - 2.536: 97.6754% ( 7) 00:16:12.028 2.536 - 2.548: 97.7335% ( 8) 00:16:12.028 2.548 - 2.560: 97.7917% ( 8) 00:16:12.028 2.560 - 2.572: 97.8352% ( 6) 00:16:12.028 2.572 - 2.584: 97.8788% ( 6) 00:16:12.028 2.584 - 2.596: 97.9006% ( 3) 00:16:12.028 2.596 - 2.607: 97.9515% ( 7) 00:16:12.028 2.607 - 2.619: 98.0169% ( 9) 00:16:12.028 2.619 - 2.631: 98.0677% ( 7) 00:16:12.028 2.631 - 2.643: 98.1113% ( 6) 00:16:12.028 2.643 - 2.655: 98.1549% ( 6) 00:16:12.028 2.655 - 2.667: 98.1985% ( 6) 00:16:12.028 2.667 - 2.679: 98.2420% ( 6) 00:16:12.028 2.679 - 2.690: 98.2566% ( 2) 00:16:12.028 2.690 - 2.702: 98.2638% ( 1) 00:16:12.028 2.702 - 2.714: 98.2711% ( 1) 00:16:12.028 2.714 - 2.726: 98.2784% ( 1) 00:16:12.028 2.726 - 2.738: 98.3002% ( 3) 00:16:12.028 2.738 - 2.750: 98.3074% ( 1) 00:16:12.028 2.750 - 2.761: 98.3220% ( 2) 00:16:12.028 2.761 - 2.773: 98.3510% ( 4) 00:16:12.028 2.773 - 2.785: 98.3583% ( 1) 00:16:12.028 2.797 - 2.809: 98.3728% ( 2) 00:16:12.028 2.821 - 2.833: 98.3801% ( 1) 00:16:12.028 2.833 - 2.844: 98.3873% ( 1) 00:16:12.028 2.856 - 2.868: 98.3946% ( 1) 00:16:12.028 2.951 - 2.963: 98.4019% ( 1) 00:16:12.028 2.963 - 2.975: 98.4091% ( 1) 00:16:12.028 2.975 - 2.987: 98.4164% ( 1) 00:16:12.028 2.987 - 2.999: 98.4237% ( 1) 00:16:12.028 3.010 - 3.022: 98.4309% ( 1) 00:16:12.028 3.022 - 3.034: 98.4382% ( 1) 00:16:12.028 3.034 - 3.058: 98.4600% ( 3) 00:16:12.028 3.058 - 3.081: 98.4745% ( 2) 00:16:12.028 3.081 - 3.105: 98.4890% ( 2) 00:16:12.028 3.105 - 3.129: 98.4963% ( 1) 00:16:12.028 3.129 - 3.153: 98.5036% ( 1) 00:16:12.028 3.176 - 3.200: 98.5108% ( 1) 00:16:12.028 3.200 - 3.224: 98.5181% ( 1) 00:16:12.028 3.224 - 3.247: 98.5254% ( 1) 00:16:12.028 3.247 - 3.271: 98.5399% ( 2) 00:16:12.028 3.271 - 3.295: 98.5471% ( 1) 00:16:12.028 3.295 - 3.319: 98.5544% ( 1) 00:16:12.028 3.366 - 3.390: 98.5689% ( 2) 00:16:12.028 3.484 - 3.508: 98.5762% ( 1) 00:16:12.028 3.508 - 3.532: 98.5907% ( 2) 00:16:12.028 3.532 - 3.556: 98.5980% ( 1) 00:16:12.028 3.556 - 3.579: 98.6198% ( 3) 00:16:12.028 3.579 - 3.603: 98.6271% ( 1) 00:16:12.028 3.603 - 3.627: 98.6561% ( 4) 00:16:12.028 3.627 - 3.650: 98.6634% ( 1) 00:16:12.028 3.650 - 3.674: 98.6706% ( 1) 00:16:12.028 3.674 - 3.698: 98.6852% ( 2) 00:16:12.028 3.698 - 3.721: 98.7070% ( 3) 00:16:12.028 3.769 - 3.793: 98.7142% ( 1) 00:16:12.028 3.816 - 3.840: 98.7288% ( 2) 00:16:12.028 3.840 - 3.864: 98.7433% ( 2) 00:16:12.028 3.864 - 3.887: 98.7505% ( 1) 00:16:12.028 3.911 - 3.935: 98.7578% ( 1) 00:16:12.028 3.935 - 3.959: 98.7723% ( 2) 00:16:12.028 3.982 - 4.006: 98.7796% ( 1) 00:16:12.028 4.006 - 4.030: 98.7869% ( 1) 00:16:12.028 4.219 - 4.243: 98.7941% ( 1) 00:16:12.028 4.243 - 4.267: 98.8014% ( 1) 00:16:12.028 4.267 - 4.290: 98.8087% ( 1) 00:16:12.028 4.314 - 4.338: 98.8232% ( 2) 00:16:12.028 4.385 - 4.409: 98.8305% ( 1) 00:16:12.028 4.409 - 4.433: 98.8377% ( 1) 00:16:12.028 4.575 - 4.599: 98.8450% ( 1) 00:16:12.028 4.954 - 4.978: 98.8522% ( 1) 00:16:12.028 5.096 - 5.120: 98.8595% ( 1) 00:16:12.028 5.547 - 5.570: 98.8668% ( 1) 00:16:12.028 5.594 - 5.618: 98.8740% ( 1) 00:16:12.028 5.879 - 5.902: 98.8813% ( 1) 00:16:12.028 6.447 - 6.495: 98.8886% ( 1) 00:16:12.028 6.684 - 6.732: 98.8958% ( 1) 00:16:12.028 7.396 - 7.443: 98.9031% ( 1) 00:16:12.028 7.490 - 7.538: 98.9104% ( 1) 00:16:12.028 7.585 - 7.633: 98.9176% ( 1) 00:16:12.028 7.822 - 7.870: 98.9249% ( 1) 00:16:12.028 8.059 - 8.107: 98.9322% ( 1) 00:16:12.028 8.154 - 8.201: 98.9394% ( 1) 00:16:12.028 8.391 - 8.439: 98.9467% ( 1) 00:16:12.028 8.486 - 8.533: 98.9539% ( 1) 00:16:12.028 8.533 - 8.581: 98.9612% ( 1) 00:16:12.028 8.770 - 8.818: 98.9685% ( 1) 00:16:12.028 8.818 - 8.865: 98.9757% ( 1) 00:16:12.028 9.055 - 9.102: 98.9830% ( 1) 00:16:12.028 9.102 - 9.150: 98.9903% ( 1) 00:16:12.028 9.292 - 9.339: 98.9975% ( 1) 00:16:12.028 9.339 - 9.387: 99.0048% ( 1) 00:16:12.028 10.382 - 10.430: 99.0121% ( 1) 00:16:12.028 15.644 - 15.739: 99.0339% ( 3) 00:16:12.028 15.834 - 15.929: 99.0484% ( 2) 00:16:12.028 15.929 - 16.024: 99.0847% ( 5) 00:16:12.028 16.024 - 16.119: 99.1210% ( 5) 00:16:12.028 16.119 - 16.213: 99.1356% ( 2) 00:16:12.028 16.213 - 16.308: 99.1573% ( 3) 00:16:12.028 16.308 - 16.403: 99.1646% ( 1) 00:16:12.028 16.403 - 16.498: 99.2155% ( 7) 00:16:12.028 16.498 - 16.593: 99.2445% ( 4) 00:16:12.028 16.593 - 16.687: 99.2663% ( 3) 00:16:12.028 16.687 - 16.782: 99.2736% ( 1) 00:16:12.028 16.782 - 16.877: 99.3244% ( 7) 00:16:12.028 16.877 - 16.972: 99.3680% ( 6) 00:16:12.028 16.972 - 17.067: 99.3898% ( 3) 00:16:12.028 17.067 - 17.161: 99.4043% ( 2) 00:16:12.028 17.161 - 17.256: 99.4116% ( 1) 00:16:12.028 17.256 - 17.351: 99.4407% ( 4) 00:16:12.028 17.446 - 17.541: 99.4479% ( 1) 00:16:12.028 17.636 - 17.730: 99.4552% ( 1) 00:16:12.028 17.730 - 17.825: 99.4624% ( 1) 00:16:12.028 18.110 - 18.204: 99.4697% ( 1) 00:16:12.028 19.816 - 19.911: 99.4770% ( 1) 00:16:12.028 3021.938 - 3034.074: 99.4842% ( 1) 00:16:12.028 3980.705 - 4004.978: 99.9128% ( 59) 00:16:12.028 4004.978 - 4029.250: 100.0000% ( 12) 00:16:12.028 00:16:12.028 02:27:36 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:12.028 02:27:36 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:12.028 02:27:36 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:12.028 02:27:36 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:12.028 02:27:36 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:12.287 [ 00:16:12.287 { 00:16:12.287 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:12.287 "subtype": "Discovery", 00:16:12.287 "listen_addresses": [], 00:16:12.287 "allow_any_host": true, 00:16:12.287 "hosts": [] 00:16:12.287 }, 00:16:12.287 { 00:16:12.287 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:12.287 "subtype": "NVMe", 00:16:12.287 "listen_addresses": [ 00:16:12.287 { 00:16:12.287 "transport": "VFIOUSER", 00:16:12.287 "trtype": "VFIOUSER", 00:16:12.287 "adrfam": "IPv4", 00:16:12.287 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:12.287 "trsvcid": "0" 00:16:12.287 } 00:16:12.287 ], 00:16:12.287 "allow_any_host": true, 00:16:12.287 "hosts": [], 00:16:12.287 "serial_number": "SPDK1", 00:16:12.287 "model_number": "SPDK bdev Controller", 00:16:12.287 "max_namespaces": 32, 00:16:12.287 "min_cntlid": 1, 00:16:12.287 "max_cntlid": 65519, 00:16:12.287 "namespaces": [ 00:16:12.287 { 00:16:12.287 "nsid": 1, 00:16:12.287 "bdev_name": "Malloc1", 00:16:12.287 "name": "Malloc1", 00:16:12.287 "nguid": "5EE674D079904EAF911256CD58939560", 00:16:12.287 "uuid": "5ee674d0-7990-4eaf-9112-56cd58939560" 00:16:12.287 }, 00:16:12.287 { 00:16:12.287 "nsid": 2, 00:16:12.287 "bdev_name": "Malloc3", 00:16:12.287 "name": "Malloc3", 00:16:12.287 "nguid": "FD58B8C1824846B79D4190CBE64A08C7", 00:16:12.287 "uuid": "fd58b8c1-8248-46b7-9d41-90cbe64a08c7" 00:16:12.287 } 00:16:12.287 ] 00:16:12.287 }, 00:16:12.287 { 00:16:12.287 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:12.287 "subtype": "NVMe", 00:16:12.287 "listen_addresses": [ 00:16:12.287 { 00:16:12.287 "transport": "VFIOUSER", 00:16:12.287 "trtype": "VFIOUSER", 00:16:12.287 "adrfam": "IPv4", 00:16:12.287 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:12.287 "trsvcid": "0" 00:16:12.287 } 00:16:12.287 ], 00:16:12.287 "allow_any_host": true, 00:16:12.287 "hosts": [], 00:16:12.287 "serial_number": "SPDK2", 00:16:12.287 "model_number": "SPDK bdev Controller", 00:16:12.287 "max_namespaces": 32, 00:16:12.287 "min_cntlid": 1, 00:16:12.287 "max_cntlid": 65519, 00:16:12.287 "namespaces": [ 00:16:12.287 { 00:16:12.287 "nsid": 1, 00:16:12.287 "bdev_name": "Malloc2", 00:16:12.287 "name": "Malloc2", 00:16:12.287 "nguid": "D30694A606414844B535C93EA7FD6186", 00:16:12.287 "uuid": "d30694a6-0641-4844-b535-c93ea7fd6186" 00:16:12.287 } 00:16:12.287 ] 00:16:12.287 } 00:16:12.287 ] 00:16:12.287 02:27:36 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:12.288 02:27:36 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2048981 00:16:12.288 02:27:36 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:12.288 02:27:36 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:12.288 02:27:36 -- common/autotest_common.sh@1254 -- # local i=0 00:16:12.288 02:27:36 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:12.288 02:27:36 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:12.288 02:27:36 -- common/autotest_common.sh@1265 -- # return 0 00:16:12.288 02:27:36 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:12.288 02:27:36 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:12.288 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.546 Malloc4 00:16:12.546 02:27:37 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:12.805 02:27:37 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:12.805 Asynchronous Event Request test 00:16:12.805 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.805 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.805 Registering asynchronous event callbacks... 00:16:12.805 Starting namespace attribute notice tests for all controllers... 00:16:12.805 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:12.805 aer_cb - Changed Namespace 00:16:12.805 Cleaning up... 00:16:13.065 [ 00:16:13.065 { 00:16:13.065 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:13.065 "subtype": "Discovery", 00:16:13.065 "listen_addresses": [], 00:16:13.065 "allow_any_host": true, 00:16:13.065 "hosts": [] 00:16:13.065 }, 00:16:13.065 { 00:16:13.065 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:13.065 "subtype": "NVMe", 00:16:13.065 "listen_addresses": [ 00:16:13.065 { 00:16:13.065 "transport": "VFIOUSER", 00:16:13.065 "trtype": "VFIOUSER", 00:16:13.065 "adrfam": "IPv4", 00:16:13.065 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:13.065 "trsvcid": "0" 00:16:13.065 } 00:16:13.065 ], 00:16:13.065 "allow_any_host": true, 00:16:13.065 "hosts": [], 00:16:13.065 "serial_number": "SPDK1", 00:16:13.065 "model_number": "SPDK bdev Controller", 00:16:13.065 "max_namespaces": 32, 00:16:13.065 "min_cntlid": 1, 00:16:13.065 "max_cntlid": 65519, 00:16:13.065 "namespaces": [ 00:16:13.065 { 00:16:13.065 "nsid": 1, 00:16:13.065 "bdev_name": "Malloc1", 00:16:13.065 "name": "Malloc1", 00:16:13.065 "nguid": "5EE674D079904EAF911256CD58939560", 00:16:13.065 "uuid": "5ee674d0-7990-4eaf-9112-56cd58939560" 00:16:13.065 }, 00:16:13.065 { 00:16:13.065 "nsid": 2, 00:16:13.065 "bdev_name": "Malloc3", 00:16:13.065 "name": "Malloc3", 00:16:13.065 "nguid": "FD58B8C1824846B79D4190CBE64A08C7", 00:16:13.066 "uuid": "fd58b8c1-8248-46b7-9d41-90cbe64a08c7" 00:16:13.066 } 00:16:13.066 ] 00:16:13.066 }, 00:16:13.066 { 00:16:13.066 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:13.066 "subtype": "NVMe", 00:16:13.066 "listen_addresses": [ 00:16:13.066 { 00:16:13.066 "transport": "VFIOUSER", 00:16:13.066 "trtype": "VFIOUSER", 00:16:13.066 "adrfam": "IPv4", 00:16:13.066 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:13.066 "trsvcid": "0" 00:16:13.066 } 00:16:13.066 ], 00:16:13.066 "allow_any_host": true, 00:16:13.066 "hosts": [], 00:16:13.066 "serial_number": "SPDK2", 00:16:13.066 "model_number": "SPDK bdev Controller", 00:16:13.066 "max_namespaces": 32, 00:16:13.066 "min_cntlid": 1, 00:16:13.066 "max_cntlid": 65519, 00:16:13.066 "namespaces": [ 00:16:13.066 { 00:16:13.066 "nsid": 1, 00:16:13.066 "bdev_name": "Malloc2", 00:16:13.066 "name": "Malloc2", 00:16:13.066 "nguid": "D30694A606414844B535C93EA7FD6186", 00:16:13.066 "uuid": "d30694a6-0641-4844-b535-c93ea7fd6186" 00:16:13.066 }, 00:16:13.066 { 00:16:13.066 "nsid": 2, 00:16:13.066 "bdev_name": "Malloc4", 00:16:13.066 "name": "Malloc4", 00:16:13.066 "nguid": "DF223A3ED9DD4B7089D80A145586189D", 00:16:13.066 "uuid": "df223a3e-d9dd-4b70-89d8-0a145586189d" 00:16:13.066 } 00:16:13.066 ] 00:16:13.066 } 00:16:13.066 ] 00:16:13.066 02:27:37 -- target/nvmf_vfio_user.sh@44 -- # wait 2048981 00:16:13.066 02:27:37 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:13.066 02:27:37 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2042468 00:16:13.066 02:27:37 -- common/autotest_common.sh@936 -- # '[' -z 2042468 ']' 00:16:13.066 02:27:37 -- common/autotest_common.sh@940 -- # kill -0 2042468 00:16:13.066 02:27:37 -- common/autotest_common.sh@941 -- # uname 00:16:13.066 02:27:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:13.066 02:27:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2042468 00:16:13.066 02:27:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:13.066 02:27:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:13.066 02:27:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2042468' 00:16:13.066 killing process with pid 2042468 00:16:13.066 02:27:37 -- common/autotest_common.sh@955 -- # kill 2042468 00:16:13.066 [2024-11-27 02:27:37.643956] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:13.066 02:27:37 -- common/autotest_common.sh@960 -- # wait 2042468 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2049123 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2049123' 00:16:13.652 Process pid: 2049123 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:13.652 02:27:37 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2049123 00:16:13.652 02:27:37 -- common/autotest_common.sh@829 -- # '[' -z 2049123 ']' 00:16:13.652 02:27:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:13.652 02:27:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:13.652 02:27:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:13.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:13.652 02:27:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:13.652 02:27:37 -- common/autotest_common.sh@10 -- # set +x 00:16:13.652 [2024-11-27 02:27:38.032380] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:13.652 [2024-11-27 02:27:38.033470] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:13.652 [2024-11-27 02:27:38.033555] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:13.652 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.652 [2024-11-27 02:27:38.095829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:13.652 [2024-11-27 02:27:38.184893] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:13.652 [2024-11-27 02:27:38.185060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:13.652 [2024-11-27 02:27:38.185080] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:13.652 [2024-11-27 02:27:38.185095] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:13.652 [2024-11-27 02:27:38.185150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:13.652 [2024-11-27 02:27:38.185204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:13.652 [2024-11-27 02:27:38.185252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:13.652 [2024-11-27 02:27:38.185255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:13.652 [2024-11-27 02:27:38.282856] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:13.652 [2024-11-27 02:27:38.283119] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:13.652 [2024-11-27 02:27:38.283399] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:13.652 [2024-11-27 02:27:38.284190] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:13.652 [2024-11-27 02:27:38.284324] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:14.588 02:27:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:14.588 02:27:39 -- common/autotest_common.sh@862 -- # return 0 00:16:14.588 02:27:39 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:15.525 02:27:40 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:15.785 02:27:40 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:15.785 02:27:40 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:15.785 02:27:40 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:15.785 02:27:40 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:15.785 02:27:40 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:16.045 Malloc1 00:16:16.045 02:27:40 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:16.305 02:27:40 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:16.564 02:27:41 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:16.822 02:27:41 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:16.822 02:27:41 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:16.822 02:27:41 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:17.081 Malloc2 00:16:17.081 02:27:41 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:17.340 02:27:41 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:17.598 02:27:42 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:17.857 02:27:42 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:17.857 02:27:42 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2049123 00:16:17.857 02:27:42 -- common/autotest_common.sh@936 -- # '[' -z 2049123 ']' 00:16:17.857 02:27:42 -- common/autotest_common.sh@940 -- # kill -0 2049123 00:16:17.857 02:27:42 -- common/autotest_common.sh@941 -- # uname 00:16:17.857 02:27:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:17.857 02:27:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2049123 00:16:17.858 02:27:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:17.858 02:27:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:17.858 02:27:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2049123' 00:16:17.858 killing process with pid 2049123 00:16:17.858 02:27:42 -- common/autotest_common.sh@955 -- # kill 2049123 00:16:17.858 02:27:42 -- common/autotest_common.sh@960 -- # wait 2049123 00:16:18.116 02:27:42 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:18.116 02:27:42 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:18.116 00:16:18.116 real 0m54.134s 00:16:18.116 user 3m33.927s 00:16:18.116 sys 0m4.570s 00:16:18.116 02:27:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:18.116 02:27:42 -- common/autotest_common.sh@10 -- # set +x 00:16:18.116 ************************************ 00:16:18.116 END TEST nvmf_vfio_user 00:16:18.116 ************************************ 00:16:18.116 02:27:42 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:18.116 02:27:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:18.116 02:27:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:18.116 02:27:42 -- common/autotest_common.sh@10 -- # set +x 00:16:18.116 ************************************ 00:16:18.116 START TEST nvmf_vfio_user_nvme_compliance 00:16:18.116 ************************************ 00:16:18.116 02:27:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:18.375 * Looking for test storage... 00:16:18.375 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:18.375 02:27:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:18.375 02:27:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:18.375 02:27:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:18.375 02:27:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:18.375 02:27:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:18.375 02:27:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:18.375 02:27:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:18.375 02:27:42 -- scripts/common.sh@335 -- # IFS=.-: 00:16:18.375 02:27:42 -- scripts/common.sh@335 -- # read -ra ver1 00:16:18.375 02:27:42 -- scripts/common.sh@336 -- # IFS=.-: 00:16:18.375 02:27:42 -- scripts/common.sh@336 -- # read -ra ver2 00:16:18.375 02:27:42 -- scripts/common.sh@337 -- # local 'op=<' 00:16:18.375 02:27:42 -- scripts/common.sh@339 -- # ver1_l=2 00:16:18.375 02:27:42 -- scripts/common.sh@340 -- # ver2_l=1 00:16:18.375 02:27:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:18.375 02:27:42 -- scripts/common.sh@343 -- # case "$op" in 00:16:18.375 02:27:42 -- scripts/common.sh@344 -- # : 1 00:16:18.375 02:27:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:18.375 02:27:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:18.375 02:27:42 -- scripts/common.sh@364 -- # decimal 1 00:16:18.375 02:27:42 -- scripts/common.sh@352 -- # local d=1 00:16:18.375 02:27:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:18.375 02:27:42 -- scripts/common.sh@354 -- # echo 1 00:16:18.375 02:27:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:18.375 02:27:42 -- scripts/common.sh@365 -- # decimal 2 00:16:18.375 02:27:42 -- scripts/common.sh@352 -- # local d=2 00:16:18.375 02:27:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:18.375 02:27:42 -- scripts/common.sh@354 -- # echo 2 00:16:18.375 02:27:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:18.375 02:27:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:18.375 02:27:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:18.375 02:27:42 -- scripts/common.sh@367 -- # return 0 00:16:18.375 02:27:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:18.375 02:27:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:18.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.375 --rc genhtml_branch_coverage=1 00:16:18.375 --rc genhtml_function_coverage=1 00:16:18.375 --rc genhtml_legend=1 00:16:18.376 --rc geninfo_all_blocks=1 00:16:18.376 --rc geninfo_unexecuted_blocks=1 00:16:18.376 00:16:18.376 ' 00:16:18.376 02:27:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:18.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.376 --rc genhtml_branch_coverage=1 00:16:18.376 --rc genhtml_function_coverage=1 00:16:18.376 --rc genhtml_legend=1 00:16:18.376 --rc geninfo_all_blocks=1 00:16:18.376 --rc geninfo_unexecuted_blocks=1 00:16:18.376 00:16:18.376 ' 00:16:18.376 02:27:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:18.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.376 --rc genhtml_branch_coverage=1 00:16:18.376 --rc genhtml_function_coverage=1 00:16:18.376 --rc genhtml_legend=1 00:16:18.376 --rc geninfo_all_blocks=1 00:16:18.376 --rc geninfo_unexecuted_blocks=1 00:16:18.376 00:16:18.376 ' 00:16:18.376 02:27:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:18.376 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.376 --rc genhtml_branch_coverage=1 00:16:18.376 --rc genhtml_function_coverage=1 00:16:18.376 --rc genhtml_legend=1 00:16:18.376 --rc geninfo_all_blocks=1 00:16:18.376 --rc geninfo_unexecuted_blocks=1 00:16:18.376 00:16:18.376 ' 00:16:18.376 02:27:42 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:18.376 02:27:42 -- nvmf/common.sh@7 -- # uname -s 00:16:18.376 02:27:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:18.376 02:27:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:18.376 02:27:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:18.376 02:27:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:18.376 02:27:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:18.376 02:27:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:18.376 02:27:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:18.376 02:27:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:18.376 02:27:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:18.376 02:27:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:18.376 02:27:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.376 02:27:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.376 02:27:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:18.376 02:27:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:18.376 02:27:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:18.376 02:27:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:18.376 02:27:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:18.376 02:27:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:18.376 02:27:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:18.376 02:27:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.376 02:27:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.376 02:27:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.376 02:27:42 -- paths/export.sh@5 -- # export PATH 00:16:18.376 02:27:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.376 02:27:42 -- nvmf/common.sh@46 -- # : 0 00:16:18.376 02:27:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:18.376 02:27:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:18.376 02:27:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:18.376 02:27:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:18.376 02:27:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:18.376 02:27:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:18.376 02:27:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:18.376 02:27:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:18.376 02:27:42 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:18.376 02:27:42 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:18.376 02:27:42 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:18.376 02:27:42 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:18.376 02:27:42 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:18.376 02:27:42 -- compliance/compliance.sh@20 -- # nvmfpid=2049755 00:16:18.376 02:27:42 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:18.376 02:27:42 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2049755' 00:16:18.376 Process pid: 2049755 00:16:18.376 02:27:42 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:18.376 02:27:42 -- compliance/compliance.sh@24 -- # waitforlisten 2049755 00:16:18.376 02:27:42 -- common/autotest_common.sh@829 -- # '[' -z 2049755 ']' 00:16:18.376 02:27:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:18.376 02:27:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:18.376 02:27:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:18.376 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:18.376 02:27:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:18.376 02:27:42 -- common/autotest_common.sh@10 -- # set +x 00:16:18.376 [2024-11-27 02:27:42.926624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:18.376 [2024-11-27 02:27:42.926709] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:18.376 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.376 [2024-11-27 02:27:43.000165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:18.635 [2024-11-27 02:27:43.097982] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:18.635 [2024-11-27 02:27:43.098170] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:18.635 [2024-11-27 02:27:43.098201] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:18.635 [2024-11-27 02:27:43.098225] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:18.635 [2024-11-27 02:27:43.098290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:18.635 [2024-11-27 02:27:43.098352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:18.635 [2024-11-27 02:27:43.098360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:18.896 02:27:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:18.896 02:27:43 -- common/autotest_common.sh@862 -- # return 0 00:16:18.896 02:27:43 -- compliance/compliance.sh@26 -- # sleep 1 00:16:19.835 02:27:44 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:19.835 02:27:44 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:19.835 02:27:44 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:19.835 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.835 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:16:19.835 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.835 02:27:44 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:19.835 02:27:44 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:19.835 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.835 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:16:19.835 malloc0 00:16:19.835 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.835 02:27:44 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:19.835 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.835 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:16:19.835 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.835 02:27:44 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:19.835 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.835 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:16:19.835 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.835 02:27:44 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:19.835 02:27:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.835 02:27:44 -- common/autotest_common.sh@10 -- # set +x 00:16:19.835 02:27:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.835 02:27:44 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:19.835 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.835 00:16:19.835 00:16:19.835 CUnit - A unit testing framework for C - Version 2.1-3 00:16:19.836 http://cunit.sourceforge.net/ 00:16:19.836 00:16:19.836 00:16:19.836 Suite: nvme_compliance 00:16:20.117 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-27 02:27:44.508671] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:20.117 [2024-11-27 02:27:44.508745] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:20.117 [2024-11-27 02:27:44.508759] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:20.117 passed 00:16:20.117 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:20.392 Test: admin_identify_ns ...[2024-11-27 02:27:44.747546] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:20.392 [2024-11-27 02:27:44.755540] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:20.392 passed 00:16:20.392 Test: admin_get_features_mandatory_features ...passed 00:16:20.392 Test: admin_get_features_optional_features ...passed 00:16:20.652 Test: admin_set_features_number_of_queues ...passed 00:16:20.652 Test: admin_get_log_page_mandatory_logs ...passed 00:16:20.910 Test: admin_get_log_page_with_lpo ...[2024-11-27 02:27:45.371547] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:20.910 passed 00:16:20.910 Test: fabric_property_get ...passed 00:16:21.168 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-27 02:27:45.558656] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:21.168 passed 00:16:21.169 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-27 02:27:45.726550] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:21.169 [2024-11-27 02:27:45.742536] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:21.169 passed 00:16:21.428 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-27 02:27:45.832187] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:21.428 passed 00:16:21.428 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-27 02:27:45.993546] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:21.428 [2024-11-27 02:27:46.017542] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:21.428 passed 00:16:21.688 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-27 02:27:46.107086] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:21.688 [2024-11-27 02:27:46.107126] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:21.688 passed 00:16:21.688 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-27 02:27:46.281551] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:21.688 [2024-11-27 02:27:46.289552] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:21.689 [2024-11-27 02:27:46.297541] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:21.689 [2024-11-27 02:27:46.305538] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:21.949 passed 00:16:21.949 Test: admin_create_io_sq_verify_pc ...[2024-11-27 02:27:46.436547] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:21.949 passed 00:16:23.330 Test: admin_create_io_qp_max_qps ...[2024-11-27 02:27:47.627559] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:23.590 passed 00:16:23.590 Test: admin_create_io_sq_shared_cq ...[2024-11-27 02:27:48.224537] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:23.849 passed 00:16:23.849 00:16:23.849 Run Summary: Type Total Ran Passed Failed Inactive 00:16:23.849 suites 1 1 n/a 0 0 00:16:23.849 tests 18 18 18 0 0 00:16:23.849 asserts 360 360 360 0 n/a 00:16:23.849 00:16:23.849 Elapsed time = 1.556 seconds 00:16:23.849 02:27:48 -- compliance/compliance.sh@42 -- # killprocess 2049755 00:16:23.849 02:27:48 -- common/autotest_common.sh@936 -- # '[' -z 2049755 ']' 00:16:23.849 02:27:48 -- common/autotest_common.sh@940 -- # kill -0 2049755 00:16:23.849 02:27:48 -- common/autotest_common.sh@941 -- # uname 00:16:23.849 02:27:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:23.849 02:27:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2049755 00:16:23.849 02:27:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:23.849 02:27:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:23.849 02:27:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2049755' 00:16:23.849 killing process with pid 2049755 00:16:23.849 02:27:48 -- common/autotest_common.sh@955 -- # kill 2049755 00:16:23.849 02:27:48 -- common/autotest_common.sh@960 -- # wait 2049755 00:16:24.108 02:27:48 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:24.108 02:27:48 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:24.108 00:16:24.108 real 0m5.845s 00:16:24.108 user 0m16.399s 00:16:24.108 sys 0m0.597s 00:16:24.108 02:27:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:24.109 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:24.109 ************************************ 00:16:24.109 END TEST nvmf_vfio_user_nvme_compliance 00:16:24.109 ************************************ 00:16:24.109 02:27:48 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:24.109 02:27:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:24.109 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:24.109 ************************************ 00:16:24.109 START TEST nvmf_vfio_user_fuzz 00:16:24.109 ************************************ 00:16:24.109 02:27:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:24.109 * Looking for test storage... 00:16:24.109 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:24.109 02:27:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:24.109 02:27:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:24.109 02:27:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:24.109 02:27:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:24.109 02:27:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:24.109 02:27:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:24.109 02:27:48 -- scripts/common.sh@335 -- # IFS=.-: 00:16:24.109 02:27:48 -- scripts/common.sh@335 -- # read -ra ver1 00:16:24.109 02:27:48 -- scripts/common.sh@336 -- # IFS=.-: 00:16:24.109 02:27:48 -- scripts/common.sh@336 -- # read -ra ver2 00:16:24.109 02:27:48 -- scripts/common.sh@337 -- # local 'op=<' 00:16:24.109 02:27:48 -- scripts/common.sh@339 -- # ver1_l=2 00:16:24.109 02:27:48 -- scripts/common.sh@340 -- # ver2_l=1 00:16:24.109 02:27:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:24.109 02:27:48 -- scripts/common.sh@343 -- # case "$op" in 00:16:24.109 02:27:48 -- scripts/common.sh@344 -- # : 1 00:16:24.109 02:27:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:24.109 02:27:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:24.109 02:27:48 -- scripts/common.sh@364 -- # decimal 1 00:16:24.109 02:27:48 -- scripts/common.sh@352 -- # local d=1 00:16:24.109 02:27:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:24.109 02:27:48 -- scripts/common.sh@354 -- # echo 1 00:16:24.109 02:27:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:24.109 02:27:48 -- scripts/common.sh@365 -- # decimal 2 00:16:24.109 02:27:48 -- scripts/common.sh@352 -- # local d=2 00:16:24.109 02:27:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:24.109 02:27:48 -- scripts/common.sh@354 -- # echo 2 00:16:24.109 02:27:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:24.109 02:27:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:24.109 02:27:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:24.109 02:27:48 -- scripts/common.sh@367 -- # return 0 00:16:24.109 02:27:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:24.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.109 --rc genhtml_branch_coverage=1 00:16:24.109 --rc genhtml_function_coverage=1 00:16:24.109 --rc genhtml_legend=1 00:16:24.109 --rc geninfo_all_blocks=1 00:16:24.109 --rc geninfo_unexecuted_blocks=1 00:16:24.109 00:16:24.109 ' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:24.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.109 --rc genhtml_branch_coverage=1 00:16:24.109 --rc genhtml_function_coverage=1 00:16:24.109 --rc genhtml_legend=1 00:16:24.109 --rc geninfo_all_blocks=1 00:16:24.109 --rc geninfo_unexecuted_blocks=1 00:16:24.109 00:16:24.109 ' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:24.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.109 --rc genhtml_branch_coverage=1 00:16:24.109 --rc genhtml_function_coverage=1 00:16:24.109 --rc genhtml_legend=1 00:16:24.109 --rc geninfo_all_blocks=1 00:16:24.109 --rc geninfo_unexecuted_blocks=1 00:16:24.109 00:16:24.109 ' 00:16:24.109 02:27:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:24.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.109 --rc genhtml_branch_coverage=1 00:16:24.109 --rc genhtml_function_coverage=1 00:16:24.109 --rc genhtml_legend=1 00:16:24.109 --rc geninfo_all_blocks=1 00:16:24.109 --rc geninfo_unexecuted_blocks=1 00:16:24.109 00:16:24.109 ' 00:16:24.109 02:27:48 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:24.109 02:27:48 -- nvmf/common.sh@7 -- # uname -s 00:16:24.109 02:27:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:24.109 02:27:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:24.109 02:27:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:24.109 02:27:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:24.109 02:27:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:24.109 02:27:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:24.109 02:27:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:24.109 02:27:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:24.109 02:27:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:24.109 02:27:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:24.368 02:27:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:24.368 02:27:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:24.368 02:27:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:24.368 02:27:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:24.368 02:27:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:24.368 02:27:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:24.368 02:27:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:24.368 02:27:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:24.368 02:27:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:24.368 02:27:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.368 02:27:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.368 02:27:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.368 02:27:48 -- paths/export.sh@5 -- # export PATH 00:16:24.368 02:27:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.368 02:27:48 -- nvmf/common.sh@46 -- # : 0 00:16:24.368 02:27:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:24.368 02:27:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:24.368 02:27:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:24.368 02:27:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:24.368 02:27:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:24.368 02:27:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:24.368 02:27:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:24.368 02:27:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2050580 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2050580' 00:16:24.368 Process pid: 2050580 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:24.368 02:27:48 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2050580 00:16:24.368 02:27:48 -- common/autotest_common.sh@829 -- # '[' -z 2050580 ']' 00:16:24.368 02:27:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:24.368 02:27:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:24.368 02:27:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:24.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:24.368 02:27:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:24.368 02:27:48 -- common/autotest_common.sh@10 -- # set +x 00:16:25.303 02:27:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:25.303 02:27:49 -- common/autotest_common.sh@862 -- # return 0 00:16:25.303 02:27:49 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:26.242 02:27:50 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:26.242 02:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.242 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:26.242 02:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.242 02:27:50 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:26.242 02:27:50 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:26.242 02:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.242 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:26.242 malloc0 00:16:26.242 02:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.243 02:27:50 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:26.243 02:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.243 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:26.243 02:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.243 02:27:50 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:26.243 02:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.243 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:26.243 02:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.243 02:27:50 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:26.243 02:27:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.243 02:27:50 -- common/autotest_common.sh@10 -- # set +x 00:16:26.502 02:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.502 02:27:50 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:26.502 02:27:50 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:58.571 Fuzzing completed. Shutting down the fuzz application 00:16:58.571 00:16:58.571 Dumping successful admin opcodes: 00:16:58.571 8, 9, 10, 24, 00:16:58.571 Dumping successful io opcodes: 00:16:58.571 0, 00:16:58.571 NS: 0x200003a1ef00 I/O qp, Total commands completed: 575652, total successful commands: 2215, random_seed: 1774740288 00:16:58.571 NS: 0x200003a1ef00 admin qp, Total commands completed: 143070, total successful commands: 1162, random_seed: 1433439360 00:16:58.571 02:28:21 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:58.571 02:28:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.571 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:16:58.571 02:28:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.571 02:28:21 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2050580 00:16:58.571 02:28:21 -- common/autotest_common.sh@936 -- # '[' -z 2050580 ']' 00:16:58.571 02:28:21 -- common/autotest_common.sh@940 -- # kill -0 2050580 00:16:58.571 02:28:21 -- common/autotest_common.sh@941 -- # uname 00:16:58.571 02:28:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:58.571 02:28:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2050580 00:16:58.571 02:28:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:58.571 02:28:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:58.571 02:28:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2050580' 00:16:58.571 killing process with pid 2050580 00:16:58.571 02:28:21 -- common/autotest_common.sh@955 -- # kill 2050580 00:16:58.571 02:28:21 -- common/autotest_common.sh@960 -- # wait 2050580 00:16:58.571 02:28:21 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:58.571 02:28:21 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:58.571 00:16:58.571 real 0m33.104s 00:16:58.571 user 0m34.131s 00:16:58.571 sys 0m25.628s 00:16:58.571 02:28:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:58.571 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:16:58.571 ************************************ 00:16:58.571 END TEST nvmf_vfio_user_fuzz 00:16:58.571 ************************************ 00:16:58.571 02:28:21 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:58.571 02:28:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:58.571 02:28:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:58.571 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:16:58.571 ************************************ 00:16:58.571 START TEST nvmf_host_management 00:16:58.571 ************************************ 00:16:58.572 02:28:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:58.572 * Looking for test storage... 00:16:58.572 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:58.572 02:28:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:58.572 02:28:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:58.572 02:28:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:58.572 02:28:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:58.572 02:28:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:58.572 02:28:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:58.572 02:28:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:58.572 02:28:21 -- scripts/common.sh@335 -- # IFS=.-: 00:16:58.572 02:28:21 -- scripts/common.sh@335 -- # read -ra ver1 00:16:58.572 02:28:21 -- scripts/common.sh@336 -- # IFS=.-: 00:16:58.572 02:28:21 -- scripts/common.sh@336 -- # read -ra ver2 00:16:58.572 02:28:21 -- scripts/common.sh@337 -- # local 'op=<' 00:16:58.572 02:28:21 -- scripts/common.sh@339 -- # ver1_l=2 00:16:58.572 02:28:21 -- scripts/common.sh@340 -- # ver2_l=1 00:16:58.572 02:28:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:58.572 02:28:21 -- scripts/common.sh@343 -- # case "$op" in 00:16:58.572 02:28:21 -- scripts/common.sh@344 -- # : 1 00:16:58.572 02:28:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:58.572 02:28:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:58.572 02:28:21 -- scripts/common.sh@364 -- # decimal 1 00:16:58.572 02:28:21 -- scripts/common.sh@352 -- # local d=1 00:16:58.572 02:28:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:58.572 02:28:21 -- scripts/common.sh@354 -- # echo 1 00:16:58.572 02:28:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:58.572 02:28:21 -- scripts/common.sh@365 -- # decimal 2 00:16:58.572 02:28:21 -- scripts/common.sh@352 -- # local d=2 00:16:58.572 02:28:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:58.572 02:28:21 -- scripts/common.sh@354 -- # echo 2 00:16:58.572 02:28:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:58.572 02:28:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:58.572 02:28:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:58.572 02:28:21 -- scripts/common.sh@367 -- # return 0 00:16:58.572 02:28:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:58.572 02:28:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:58.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.572 --rc genhtml_branch_coverage=1 00:16:58.572 --rc genhtml_function_coverage=1 00:16:58.572 --rc genhtml_legend=1 00:16:58.572 --rc geninfo_all_blocks=1 00:16:58.572 --rc geninfo_unexecuted_blocks=1 00:16:58.572 00:16:58.572 ' 00:16:58.572 02:28:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:58.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.572 --rc genhtml_branch_coverage=1 00:16:58.572 --rc genhtml_function_coverage=1 00:16:58.572 --rc genhtml_legend=1 00:16:58.572 --rc geninfo_all_blocks=1 00:16:58.572 --rc geninfo_unexecuted_blocks=1 00:16:58.572 00:16:58.572 ' 00:16:58.572 02:28:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:58.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.572 --rc genhtml_branch_coverage=1 00:16:58.572 --rc genhtml_function_coverage=1 00:16:58.572 --rc genhtml_legend=1 00:16:58.572 --rc geninfo_all_blocks=1 00:16:58.572 --rc geninfo_unexecuted_blocks=1 00:16:58.572 00:16:58.572 ' 00:16:58.572 02:28:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:58.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.572 --rc genhtml_branch_coverage=1 00:16:58.572 --rc genhtml_function_coverage=1 00:16:58.572 --rc genhtml_legend=1 00:16:58.572 --rc geninfo_all_blocks=1 00:16:58.572 --rc geninfo_unexecuted_blocks=1 00:16:58.572 00:16:58.572 ' 00:16:58.572 02:28:21 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:58.572 02:28:21 -- nvmf/common.sh@7 -- # uname -s 00:16:58.572 02:28:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:58.572 02:28:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:58.572 02:28:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:58.572 02:28:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:58.572 02:28:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:58.572 02:28:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:58.572 02:28:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:58.572 02:28:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:58.572 02:28:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:58.572 02:28:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:58.572 02:28:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:58.572 02:28:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:58.572 02:28:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:58.572 02:28:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:58.572 02:28:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:58.572 02:28:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:58.572 02:28:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:58.572 02:28:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:58.572 02:28:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:58.572 02:28:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.572 02:28:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.572 02:28:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.572 02:28:21 -- paths/export.sh@5 -- # export PATH 00:16:58.572 02:28:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.572 02:28:21 -- nvmf/common.sh@46 -- # : 0 00:16:58.572 02:28:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:58.572 02:28:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:58.572 02:28:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:58.572 02:28:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:58.572 02:28:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:58.572 02:28:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:58.572 02:28:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:58.572 02:28:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:58.572 02:28:21 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:58.572 02:28:21 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:58.572 02:28:21 -- target/host_management.sh@104 -- # nvmftestinit 00:16:58.572 02:28:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:58.572 02:28:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:58.572 02:28:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:58.572 02:28:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:58.572 02:28:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:58.572 02:28:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.572 02:28:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.572 02:28:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:58.572 02:28:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:58.572 02:28:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:58.572 02:28:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:58.572 02:28:21 -- common/autotest_common.sh@10 -- # set +x 00:16:59.510 02:28:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:59.510 02:28:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:59.510 02:28:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:59.510 02:28:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:59.510 02:28:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:59.510 02:28:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:59.510 02:28:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:59.510 02:28:23 -- nvmf/common.sh@294 -- # net_devs=() 00:16:59.510 02:28:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:59.510 02:28:23 -- nvmf/common.sh@295 -- # e810=() 00:16:59.510 02:28:23 -- nvmf/common.sh@295 -- # local -ga e810 00:16:59.510 02:28:23 -- nvmf/common.sh@296 -- # x722=() 00:16:59.510 02:28:23 -- nvmf/common.sh@296 -- # local -ga x722 00:16:59.510 02:28:23 -- nvmf/common.sh@297 -- # mlx=() 00:16:59.510 02:28:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:59.510 02:28:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:59.510 02:28:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:59.510 02:28:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:59.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:59.510 02:28:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:59.510 02:28:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:59.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:59.510 02:28:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:59.510 02:28:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:59.510 02:28:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:59.510 02:28:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:59.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:59.510 02:28:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:59.510 02:28:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:59.510 02:28:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:59.510 02:28:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:59.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:59.510 02:28:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:59.510 02:28:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:59.510 02:28:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:59.510 02:28:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:59.510 02:28:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:59.510 02:28:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:59.510 02:28:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:59.510 02:28:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:59.510 02:28:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:59.510 02:28:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:59.510 02:28:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:59.510 02:28:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:59.510 02:28:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:59.510 02:28:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:59.510 02:28:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:59.510 02:28:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:59.510 02:28:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:59.510 02:28:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:59.510 02:28:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:59.510 02:28:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:59.510 02:28:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:59.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:59.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:16:59.510 00:16:59.510 --- 10.0.0.2 ping statistics --- 00:16:59.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:59.510 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:16:59.510 02:28:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:59.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:59.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:16:59.510 00:16:59.510 --- 10.0.0.1 ping statistics --- 00:16:59.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:59.510 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:16:59.510 02:28:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:59.510 02:28:23 -- nvmf/common.sh@410 -- # return 0 00:16:59.510 02:28:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:59.510 02:28:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:59.510 02:28:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:59.510 02:28:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:59.510 02:28:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:59.510 02:28:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:59.510 02:28:24 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:59.510 02:28:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:59.510 02:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:59.510 02:28:24 -- common/autotest_common.sh@10 -- # set +x 00:16:59.510 ************************************ 00:16:59.510 START TEST nvmf_host_management 00:16:59.510 ************************************ 00:16:59.510 02:28:24 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:59.510 02:28:24 -- target/host_management.sh@69 -- # starttarget 00:16:59.510 02:28:24 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:59.510 02:28:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:59.510 02:28:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:59.510 02:28:24 -- common/autotest_common.sh@10 -- # set +x 00:16:59.510 02:28:24 -- nvmf/common.sh@469 -- # nvmfpid=2056233 00:16:59.510 02:28:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:59.510 02:28:24 -- nvmf/common.sh@470 -- # waitforlisten 2056233 00:16:59.510 02:28:24 -- common/autotest_common.sh@829 -- # '[' -z 2056233 ']' 00:16:59.510 02:28:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:59.510 02:28:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:59.510 02:28:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:59.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:59.510 02:28:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:59.510 02:28:24 -- common/autotest_common.sh@10 -- # set +x 00:16:59.510 [2024-11-27 02:28:24.051952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:59.510 [2024-11-27 02:28:24.052035] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:59.510 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.510 [2024-11-27 02:28:24.117627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:59.770 [2024-11-27 02:28:24.204653] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:59.770 [2024-11-27 02:28:24.204798] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:59.770 [2024-11-27 02:28:24.204814] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:59.770 [2024-11-27 02:28:24.204829] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:59.770 [2024-11-27 02:28:24.204881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:59.770 [2024-11-27 02:28:24.204945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:59.770 [2024-11-27 02:28:24.205009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:59.770 [2024-11-27 02:28:24.205011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:00.708 02:28:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:00.708 02:28:25 -- common/autotest_common.sh@862 -- # return 0 00:17:00.708 02:28:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:00.708 02:28:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 02:28:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:00.708 02:28:25 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:00.708 02:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 [2024-11-27 02:28:25.043215] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:00.708 02:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.708 02:28:25 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:00.708 02:28:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 02:28:25 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:00.708 02:28:25 -- target/host_management.sh@23 -- # cat 00:17:00.708 02:28:25 -- target/host_management.sh@30 -- # rpc_cmd 00:17:00.708 02:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 Malloc0 00:17:00.708 [2024-11-27 02:28:25.104329] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:00.708 02:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.708 02:28:25 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:00.708 02:28:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 02:28:25 -- target/host_management.sh@73 -- # perfpid=2056408 00:17:00.708 02:28:25 -- target/host_management.sh@74 -- # waitforlisten 2056408 /var/tmp/bdevperf.sock 00:17:00.708 02:28:25 -- common/autotest_common.sh@829 -- # '[' -z 2056408 ']' 00:17:00.708 02:28:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:00.708 02:28:25 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:00.708 02:28:25 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:00.708 02:28:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.708 02:28:25 -- nvmf/common.sh@520 -- # config=() 00:17:00.708 02:28:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:00.708 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:00.708 02:28:25 -- nvmf/common.sh@520 -- # local subsystem config 00:17:00.708 02:28:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.708 02:28:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:00.708 02:28:25 -- common/autotest_common.sh@10 -- # set +x 00:17:00.708 02:28:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:00.708 { 00:17:00.708 "params": { 00:17:00.708 "name": "Nvme$subsystem", 00:17:00.708 "trtype": "$TEST_TRANSPORT", 00:17:00.708 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:00.708 "adrfam": "ipv4", 00:17:00.708 "trsvcid": "$NVMF_PORT", 00:17:00.708 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:00.708 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:00.708 "hdgst": ${hdgst:-false}, 00:17:00.708 "ddgst": ${ddgst:-false} 00:17:00.708 }, 00:17:00.708 "method": "bdev_nvme_attach_controller" 00:17:00.708 } 00:17:00.708 EOF 00:17:00.708 )") 00:17:00.708 02:28:25 -- nvmf/common.sh@542 -- # cat 00:17:00.708 02:28:25 -- nvmf/common.sh@544 -- # jq . 00:17:00.708 02:28:25 -- nvmf/common.sh@545 -- # IFS=, 00:17:00.708 02:28:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:00.708 "params": { 00:17:00.708 "name": "Nvme0", 00:17:00.708 "trtype": "tcp", 00:17:00.708 "traddr": "10.0.0.2", 00:17:00.708 "adrfam": "ipv4", 00:17:00.708 "trsvcid": "4420", 00:17:00.708 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:00.708 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:00.708 "hdgst": false, 00:17:00.708 "ddgst": false 00:17:00.708 }, 00:17:00.708 "method": "bdev_nvme_attach_controller" 00:17:00.708 }' 00:17:00.708 [2024-11-27 02:28:25.182423] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:00.708 [2024-11-27 02:28:25.182509] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2056408 ] 00:17:00.708 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.708 [2024-11-27 02:28:25.243471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:00.708 [2024-11-27 02:28:25.328356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:00.967 Running I/O for 10 seconds... 00:17:01.534 02:28:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:01.535 02:28:26 -- common/autotest_common.sh@862 -- # return 0 00:17:01.535 02:28:26 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:01.535 02:28:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.535 02:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.535 02:28:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.535 02:28:26 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:01.535 02:28:26 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:01.535 02:28:26 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:01.535 02:28:26 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:01.535 02:28:26 -- target/host_management.sh@52 -- # local ret=1 00:17:01.535 02:28:26 -- target/host_management.sh@53 -- # local i 00:17:01.535 02:28:26 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:01.535 02:28:26 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:01.535 02:28:26 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:01.535 02:28:26 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:01.535 02:28:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.535 02:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.535 02:28:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.797 02:28:26 -- target/host_management.sh@55 -- # read_io_count=2600 00:17:01.797 02:28:26 -- target/host_management.sh@58 -- # '[' 2600 -ge 100 ']' 00:17:01.797 02:28:26 -- target/host_management.sh@59 -- # ret=0 00:17:01.797 02:28:26 -- target/host_management.sh@60 -- # break 00:17:01.797 02:28:26 -- target/host_management.sh@64 -- # return 0 00:17:01.797 02:28:26 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:01.797 02:28:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.797 02:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.797 [2024-11-27 02:28:26.188379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.188994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.797 [2024-11-27 02:28:26.189224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.798 [2024-11-27 02:28:26.189240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x91aad0 is same with the state(5) to be set 00:17:01.798 [2024-11-27 02:28:26.190345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:93056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:93184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:93312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:93696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:93824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:94080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:88448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:94208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:94336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:94464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:88576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:88832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:89088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:94592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:94720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:94848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:89216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.190983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:94976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.190998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:95104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:95232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:95360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:95488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:89472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:89600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:89856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:90112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:90240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:90368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:95616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:95744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:95872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:96000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:96128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:96256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:96384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:96512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:96640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:91264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.798 [2024-11-27 02:28:26.191661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.798 [2024-11-27 02:28:26.191677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:96768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:96896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:97024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:97152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:91520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:97280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:97408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:91776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:91904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:97536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.191983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.191998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:97664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:92032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:97792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:97920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:98048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:98176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:98304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:98432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:98560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:98688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:98816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 02:28:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.799 [2024-11-27 02:28:26.192343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:98944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:99072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:99200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:92928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 [2024-11-27 02:28:26.192456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:99328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:01.799 02:28:26 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:01.799 [2024-11-27 02:28:26.192487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:01.799 [2024-11-27 02:28:26.192602] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb76630 was disconnected and freed. reset controller. 00:17:01.799 02:28:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.799 02:28:26 -- common/autotest_common.sh@10 -- # set +x 00:17:01.799 [2024-11-27 02:28:26.193750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:01.799 task offset: 93056 on job bdev=Nvme0n1 fails 00:17:01.799 00:17:01.799 Latency(us) 00:17:01.799 [2024-11-27T01:28:26.434Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:01.799 [2024-11-27T01:28:26.434Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:01.799 [2024-11-27T01:28:26.434Z] Job: Nvme0n1 ended in about 0.69 seconds with error 00:17:01.799 Verification LBA range: start 0x0 length 0x400 00:17:01.799 Nvme0n1 : 0.69 3979.83 248.74 92.25 0.00 15484.42 2621.44 23010.42 00:17:01.799 [2024-11-27T01:28:26.434Z] =================================================================================================================== 00:17:01.799 [2024-11-27T01:28:26.434Z] Total : 3979.83 248.74 92.25 0.00 15484.42 2621.44 23010.42 00:17:01.799 [2024-11-27 02:28:26.195719] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:01.799 [2024-11-27 02:28:26.195751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb7c1d0 (9): Bad file descriptor 00:17:01.799 02:28:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.799 02:28:26 -- target/host_management.sh@87 -- # sleep 1 00:17:01.799 [2024-11-27 02:28:26.240941] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:02.739 02:28:27 -- target/host_management.sh@91 -- # kill -9 2056408 00:17:02.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2056408) - No such process 00:17:02.739 02:28:27 -- target/host_management.sh@91 -- # true 00:17:02.739 02:28:27 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:02.739 02:28:27 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:02.739 02:28:27 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:02.739 02:28:27 -- nvmf/common.sh@520 -- # config=() 00:17:02.739 02:28:27 -- nvmf/common.sh@520 -- # local subsystem config 00:17:02.739 02:28:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:02.739 02:28:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:02.739 { 00:17:02.739 "params": { 00:17:02.739 "name": "Nvme$subsystem", 00:17:02.739 "trtype": "$TEST_TRANSPORT", 00:17:02.739 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:02.739 "adrfam": "ipv4", 00:17:02.739 "trsvcid": "$NVMF_PORT", 00:17:02.739 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:02.739 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:02.739 "hdgst": ${hdgst:-false}, 00:17:02.739 "ddgst": ${ddgst:-false} 00:17:02.739 }, 00:17:02.739 "method": "bdev_nvme_attach_controller" 00:17:02.739 } 00:17:02.739 EOF 00:17:02.739 )") 00:17:02.739 02:28:27 -- nvmf/common.sh@542 -- # cat 00:17:02.739 02:28:27 -- nvmf/common.sh@544 -- # jq . 00:17:02.739 02:28:27 -- nvmf/common.sh@545 -- # IFS=, 00:17:02.739 02:28:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:02.739 "params": { 00:17:02.739 "name": "Nvme0", 00:17:02.739 "trtype": "tcp", 00:17:02.739 "traddr": "10.0.0.2", 00:17:02.739 "adrfam": "ipv4", 00:17:02.739 "trsvcid": "4420", 00:17:02.739 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:02.739 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:02.739 "hdgst": false, 00:17:02.739 "ddgst": false 00:17:02.739 }, 00:17:02.739 "method": "bdev_nvme_attach_controller" 00:17:02.739 }' 00:17:02.739 [2024-11-27 02:28:27.246742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:02.739 [2024-11-27 02:28:27.246843] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2056696 ] 00:17:02.739 EAL: No free 2048 kB hugepages reported on node 1 00:17:02.739 [2024-11-27 02:28:27.306571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:03.009 [2024-11-27 02:28:27.394559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:03.271 Running I/O for 1 seconds... 00:17:04.204 00:17:04.204 Latency(us) 00:17:04.204 [2024-11-27T01:28:28.839Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:04.204 [2024-11-27T01:28:28.839Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:04.204 Verification LBA range: start 0x0 length 0x400 00:17:04.204 Nvme0n1 : 1.01 3915.38 244.71 0.00 0.00 16078.96 934.49 23398.78 00:17:04.204 [2024-11-27T01:28:28.839Z] =================================================================================================================== 00:17:04.204 [2024-11-27T01:28:28.839Z] Total : 3915.38 244.71 0.00 0.00 16078.96 934.49 23398.78 00:17:04.463 02:28:28 -- target/host_management.sh@101 -- # stoptarget 00:17:04.463 02:28:28 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:04.463 02:28:28 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:04.463 02:28:28 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:04.463 02:28:28 -- target/host_management.sh@40 -- # nvmftestfini 00:17:04.463 02:28:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:04.463 02:28:28 -- nvmf/common.sh@116 -- # sync 00:17:04.463 02:28:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:04.463 02:28:28 -- nvmf/common.sh@119 -- # set +e 00:17:04.463 02:28:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:04.463 02:28:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:04.463 rmmod nvme_tcp 00:17:04.463 rmmod nvme_fabrics 00:17:04.463 rmmod nvme_keyring 00:17:04.463 02:28:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:04.463 02:28:29 -- nvmf/common.sh@123 -- # set -e 00:17:04.463 02:28:29 -- nvmf/common.sh@124 -- # return 0 00:17:04.463 02:28:29 -- nvmf/common.sh@477 -- # '[' -n 2056233 ']' 00:17:04.463 02:28:29 -- nvmf/common.sh@478 -- # killprocess 2056233 00:17:04.463 02:28:29 -- common/autotest_common.sh@936 -- # '[' -z 2056233 ']' 00:17:04.463 02:28:29 -- common/autotest_common.sh@940 -- # kill -0 2056233 00:17:04.463 02:28:29 -- common/autotest_common.sh@941 -- # uname 00:17:04.463 02:28:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:04.463 02:28:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2056233 00:17:04.463 02:28:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:04.463 02:28:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:04.463 02:28:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2056233' 00:17:04.463 killing process with pid 2056233 00:17:04.463 02:28:29 -- common/autotest_common.sh@955 -- # kill 2056233 00:17:04.463 02:28:29 -- common/autotest_common.sh@960 -- # wait 2056233 00:17:04.722 [2024-11-27 02:28:29.296673] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:04.722 02:28:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:04.722 02:28:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:04.722 02:28:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:04.722 02:28:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:04.722 02:28:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:04.722 02:28:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.722 02:28:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.722 02:28:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:07.260 02:28:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:07.260 00:17:07.260 real 0m7.362s 00:17:07.260 user 0m22.977s 00:17:07.260 sys 0m1.420s 00:17:07.260 02:28:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:07.260 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:17:07.260 ************************************ 00:17:07.260 END TEST nvmf_host_management 00:17:07.260 ************************************ 00:17:07.260 02:28:31 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:07.260 00:17:07.260 real 0m9.653s 00:17:07.260 user 0m23.845s 00:17:07.260 sys 0m2.868s 00:17:07.260 02:28:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:07.260 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:17:07.260 ************************************ 00:17:07.260 END TEST nvmf_host_management 00:17:07.260 ************************************ 00:17:07.260 02:28:31 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:07.260 02:28:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:07.261 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:17:07.261 ************************************ 00:17:07.261 START TEST nvmf_lvol 00:17:07.261 ************************************ 00:17:07.261 02:28:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:07.261 * Looking for test storage... 00:17:07.261 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:07.261 02:28:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:07.261 02:28:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:07.261 02:28:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:07.261 02:28:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:07.261 02:28:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:07.261 02:28:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:07.261 02:28:31 -- scripts/common.sh@335 -- # IFS=.-: 00:17:07.261 02:28:31 -- scripts/common.sh@335 -- # read -ra ver1 00:17:07.261 02:28:31 -- scripts/common.sh@336 -- # IFS=.-: 00:17:07.261 02:28:31 -- scripts/common.sh@336 -- # read -ra ver2 00:17:07.261 02:28:31 -- scripts/common.sh@337 -- # local 'op=<' 00:17:07.261 02:28:31 -- scripts/common.sh@339 -- # ver1_l=2 00:17:07.261 02:28:31 -- scripts/common.sh@340 -- # ver2_l=1 00:17:07.261 02:28:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:07.261 02:28:31 -- scripts/common.sh@343 -- # case "$op" in 00:17:07.261 02:28:31 -- scripts/common.sh@344 -- # : 1 00:17:07.261 02:28:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:07.261 02:28:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:07.261 02:28:31 -- scripts/common.sh@364 -- # decimal 1 00:17:07.261 02:28:31 -- scripts/common.sh@352 -- # local d=1 00:17:07.261 02:28:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:07.261 02:28:31 -- scripts/common.sh@354 -- # echo 1 00:17:07.261 02:28:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:07.261 02:28:31 -- scripts/common.sh@365 -- # decimal 2 00:17:07.261 02:28:31 -- scripts/common.sh@352 -- # local d=2 00:17:07.261 02:28:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:07.261 02:28:31 -- scripts/common.sh@354 -- # echo 2 00:17:07.261 02:28:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:07.261 02:28:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:07.261 02:28:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:07.261 02:28:31 -- scripts/common.sh@367 -- # return 0 00:17:07.261 02:28:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:07.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.261 --rc genhtml_branch_coverage=1 00:17:07.261 --rc genhtml_function_coverage=1 00:17:07.261 --rc genhtml_legend=1 00:17:07.261 --rc geninfo_all_blocks=1 00:17:07.261 --rc geninfo_unexecuted_blocks=1 00:17:07.261 00:17:07.261 ' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:07.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.261 --rc genhtml_branch_coverage=1 00:17:07.261 --rc genhtml_function_coverage=1 00:17:07.261 --rc genhtml_legend=1 00:17:07.261 --rc geninfo_all_blocks=1 00:17:07.261 --rc geninfo_unexecuted_blocks=1 00:17:07.261 00:17:07.261 ' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:07.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.261 --rc genhtml_branch_coverage=1 00:17:07.261 --rc genhtml_function_coverage=1 00:17:07.261 --rc genhtml_legend=1 00:17:07.261 --rc geninfo_all_blocks=1 00:17:07.261 --rc geninfo_unexecuted_blocks=1 00:17:07.261 00:17:07.261 ' 00:17:07.261 02:28:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:07.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:07.261 --rc genhtml_branch_coverage=1 00:17:07.261 --rc genhtml_function_coverage=1 00:17:07.261 --rc genhtml_legend=1 00:17:07.261 --rc geninfo_all_blocks=1 00:17:07.261 --rc geninfo_unexecuted_blocks=1 00:17:07.261 00:17:07.261 ' 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:07.261 02:28:31 -- nvmf/common.sh@7 -- # uname -s 00:17:07.261 02:28:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:07.261 02:28:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:07.261 02:28:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:07.261 02:28:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:07.261 02:28:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:07.261 02:28:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:07.261 02:28:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:07.261 02:28:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:07.261 02:28:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:07.261 02:28:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:07.261 02:28:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:07.261 02:28:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:07.261 02:28:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:07.261 02:28:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:07.261 02:28:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:07.261 02:28:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:07.261 02:28:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:07.261 02:28:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:07.261 02:28:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:07.261 02:28:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.261 02:28:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.261 02:28:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.261 02:28:31 -- paths/export.sh@5 -- # export PATH 00:17:07.261 02:28:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:07.261 02:28:31 -- nvmf/common.sh@46 -- # : 0 00:17:07.261 02:28:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:07.261 02:28:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:07.261 02:28:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:07.261 02:28:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:07.261 02:28:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:07.261 02:28:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:07.261 02:28:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:07.261 02:28:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:07.261 02:28:31 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:07.261 02:28:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:07.261 02:28:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:07.261 02:28:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:07.261 02:28:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:07.261 02:28:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:07.261 02:28:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:07.261 02:28:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:07.261 02:28:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:07.261 02:28:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:07.261 02:28:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:07.261 02:28:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:07.261 02:28:31 -- common/autotest_common.sh@10 -- # set +x 00:17:09.168 02:28:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:09.168 02:28:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:09.168 02:28:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:09.168 02:28:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:09.168 02:28:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:09.168 02:28:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:09.168 02:28:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:09.169 02:28:33 -- nvmf/common.sh@294 -- # net_devs=() 00:17:09.169 02:28:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:09.169 02:28:33 -- nvmf/common.sh@295 -- # e810=() 00:17:09.169 02:28:33 -- nvmf/common.sh@295 -- # local -ga e810 00:17:09.169 02:28:33 -- nvmf/common.sh@296 -- # x722=() 00:17:09.169 02:28:33 -- nvmf/common.sh@296 -- # local -ga x722 00:17:09.169 02:28:33 -- nvmf/common.sh@297 -- # mlx=() 00:17:09.169 02:28:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:09.169 02:28:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:09.169 02:28:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:09.169 02:28:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:09.169 02:28:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:09.169 02:28:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:09.169 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:09.169 02:28:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:09.169 02:28:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:09.169 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:09.169 02:28:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:09.169 02:28:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.169 02:28:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.169 02:28:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:09.169 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:09.169 02:28:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.169 02:28:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:09.169 02:28:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.169 02:28:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.169 02:28:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:09.169 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:09.169 02:28:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.169 02:28:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:09.169 02:28:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:09.169 02:28:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:09.169 02:28:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:09.169 02:28:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:09.169 02:28:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:09.169 02:28:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:09.169 02:28:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:09.169 02:28:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:09.169 02:28:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:09.169 02:28:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:09.169 02:28:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:09.169 02:28:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:09.169 02:28:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:09.169 02:28:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:09.169 02:28:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:09.169 02:28:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:09.169 02:28:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:09.169 02:28:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:09.169 02:28:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:09.428 02:28:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:09.428 02:28:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:09.428 02:28:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:09.428 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:09.428 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:17:09.428 00:17:09.428 --- 10.0.0.2 ping statistics --- 00:17:09.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:09.428 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:17:09.428 02:28:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:09.428 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:09.428 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:17:09.428 00:17:09.428 --- 10.0.0.1 ping statistics --- 00:17:09.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:09.428 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:17:09.428 02:28:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:09.428 02:28:33 -- nvmf/common.sh@410 -- # return 0 00:17:09.428 02:28:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:09.428 02:28:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:09.428 02:28:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:09.428 02:28:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:09.428 02:28:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:09.428 02:28:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:09.428 02:28:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:09.428 02:28:33 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:09.428 02:28:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:09.428 02:28:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:09.428 02:28:33 -- common/autotest_common.sh@10 -- # set +x 00:17:09.428 02:28:33 -- nvmf/common.sh@469 -- # nvmfpid=2058937 00:17:09.428 02:28:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:09.428 02:28:33 -- nvmf/common.sh@470 -- # waitforlisten 2058937 00:17:09.428 02:28:33 -- common/autotest_common.sh@829 -- # '[' -z 2058937 ']' 00:17:09.428 02:28:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:09.428 02:28:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:09.428 02:28:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:09.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:09.428 02:28:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:09.428 02:28:33 -- common/autotest_common.sh@10 -- # set +x 00:17:09.428 [2024-11-27 02:28:33.978264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:09.428 [2024-11-27 02:28:33.978348] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:09.428 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.428 [2024-11-27 02:28:34.046833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:09.686 [2024-11-27 02:28:34.135130] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:09.686 [2024-11-27 02:28:34.135295] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:09.686 [2024-11-27 02:28:34.135315] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:09.686 [2024-11-27 02:28:34.135330] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:09.686 [2024-11-27 02:28:34.135412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.686 [2024-11-27 02:28:34.135482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:09.686 [2024-11-27 02:28:34.135484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:10.622 02:28:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:10.622 02:28:34 -- common/autotest_common.sh@862 -- # return 0 00:17:10.622 02:28:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:10.622 02:28:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:10.622 02:28:34 -- common/autotest_common.sh@10 -- # set +x 00:17:10.622 02:28:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:10.622 02:28:34 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:10.622 [2024-11-27 02:28:35.241149] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:10.881 02:28:35 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:11.140 02:28:35 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:11.140 02:28:35 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:11.398 02:28:35 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:11.398 02:28:35 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:11.656 02:28:36 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:11.914 02:28:36 -- target/nvmf_lvol.sh@29 -- # lvs=c3b69f69-4a26-4ff3-9696-ccf6453ff540 00:17:11.914 02:28:36 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c3b69f69-4a26-4ff3-9696-ccf6453ff540 lvol 20 00:17:12.172 02:28:36 -- target/nvmf_lvol.sh@32 -- # lvol=103a9a54-c758-44df-86f8-bcbc14c16137 00:17:12.172 02:28:36 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:12.430 02:28:36 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 103a9a54-c758-44df-86f8-bcbc14c16137 00:17:12.688 02:28:37 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:12.946 [2024-11-27 02:28:37.393837] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:12.946 02:28:37 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:13.204 02:28:37 -- target/nvmf_lvol.sh@42 -- # perf_pid=2059381 00:17:13.204 02:28:37 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:13.204 02:28:37 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:13.204 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.170 02:28:38 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 103a9a54-c758-44df-86f8-bcbc14c16137 MY_SNAPSHOT 00:17:14.452 02:28:38 -- target/nvmf_lvol.sh@47 -- # snapshot=7f36c3f4-06c8-4da0-998f-de5261c0ddcb 00:17:14.453 02:28:38 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 103a9a54-c758-44df-86f8-bcbc14c16137 30 00:17:14.711 02:28:39 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 7f36c3f4-06c8-4da0-998f-de5261c0ddcb MY_CLONE 00:17:14.968 02:28:39 -- target/nvmf_lvol.sh@49 -- # clone=ade0cd95-89af-48a2-8ec8-00087260c74d 00:17:14.968 02:28:39 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate ade0cd95-89af-48a2-8ec8-00087260c74d 00:17:15.537 02:28:40 -- target/nvmf_lvol.sh@53 -- # wait 2059381 00:17:23.666 Initializing NVMe Controllers 00:17:23.666 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:23.666 Controller IO queue size 128, less than required. 00:17:23.666 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:23.666 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:23.666 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:23.666 Initialization complete. Launching workers. 00:17:23.666 ======================================================== 00:17:23.666 Latency(us) 00:17:23.666 Device Information : IOPS MiB/s Average min max 00:17:23.666 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 11027.40 43.08 11611.69 1243.01 72039.52 00:17:23.666 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10890.00 42.54 11761.50 1946.78 74283.24 00:17:23.666 ======================================================== 00:17:23.666 Total : 21917.40 85.61 11686.13 1243.01 74283.24 00:17:23.666 00:17:23.666 02:28:48 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:23.924 02:28:48 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 103a9a54-c758-44df-86f8-bcbc14c16137 00:17:24.182 02:28:48 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c3b69f69-4a26-4ff3-9696-ccf6453ff540 00:17:24.440 02:28:48 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:24.440 02:28:48 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:24.440 02:28:48 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:24.440 02:28:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:24.440 02:28:48 -- nvmf/common.sh@116 -- # sync 00:17:24.440 02:28:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:24.440 02:28:48 -- nvmf/common.sh@119 -- # set +e 00:17:24.440 02:28:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:24.440 02:28:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:24.440 rmmod nvme_tcp 00:17:24.440 rmmod nvme_fabrics 00:17:24.440 rmmod nvme_keyring 00:17:24.440 02:28:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:24.440 02:28:48 -- nvmf/common.sh@123 -- # set -e 00:17:24.440 02:28:48 -- nvmf/common.sh@124 -- # return 0 00:17:24.440 02:28:48 -- nvmf/common.sh@477 -- # '[' -n 2058937 ']' 00:17:24.440 02:28:48 -- nvmf/common.sh@478 -- # killprocess 2058937 00:17:24.440 02:28:48 -- common/autotest_common.sh@936 -- # '[' -z 2058937 ']' 00:17:24.440 02:28:48 -- common/autotest_common.sh@940 -- # kill -0 2058937 00:17:24.440 02:28:48 -- common/autotest_common.sh@941 -- # uname 00:17:24.440 02:28:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:24.440 02:28:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2058937 00:17:24.440 02:28:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:24.440 02:28:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:24.440 02:28:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2058937' 00:17:24.440 killing process with pid 2058937 00:17:24.440 02:28:49 -- common/autotest_common.sh@955 -- # kill 2058937 00:17:24.440 02:28:49 -- common/autotest_common.sh@960 -- # wait 2058937 00:17:24.702 02:28:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:24.702 02:28:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:24.702 02:28:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:24.702 02:28:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:24.702 02:28:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:24.702 02:28:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:24.702 02:28:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:24.702 02:28:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:27.241 02:28:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:27.241 00:17:27.241 real 0m19.886s 00:17:27.241 user 1m7.688s 00:17:27.241 sys 0m5.167s 00:17:27.241 02:28:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:27.241 02:28:51 -- common/autotest_common.sh@10 -- # set +x 00:17:27.241 ************************************ 00:17:27.241 END TEST nvmf_lvol 00:17:27.241 ************************************ 00:17:27.241 02:28:51 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:27.241 02:28:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:27.241 02:28:51 -- common/autotest_common.sh@10 -- # set +x 00:17:27.241 ************************************ 00:17:27.241 START TEST nvmf_lvs_grow 00:17:27.241 ************************************ 00:17:27.241 02:28:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:27.241 * Looking for test storage... 00:17:27.241 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:27.241 02:28:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:27.241 02:28:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:27.241 02:28:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:27.241 02:28:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:27.241 02:28:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:27.241 02:28:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:27.241 02:28:51 -- scripts/common.sh@335 -- # IFS=.-: 00:17:27.241 02:28:51 -- scripts/common.sh@335 -- # read -ra ver1 00:17:27.241 02:28:51 -- scripts/common.sh@336 -- # IFS=.-: 00:17:27.241 02:28:51 -- scripts/common.sh@336 -- # read -ra ver2 00:17:27.241 02:28:51 -- scripts/common.sh@337 -- # local 'op=<' 00:17:27.241 02:28:51 -- scripts/common.sh@339 -- # ver1_l=2 00:17:27.241 02:28:51 -- scripts/common.sh@340 -- # ver2_l=1 00:17:27.241 02:28:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:27.241 02:28:51 -- scripts/common.sh@343 -- # case "$op" in 00:17:27.241 02:28:51 -- scripts/common.sh@344 -- # : 1 00:17:27.241 02:28:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:27.241 02:28:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:27.241 02:28:51 -- scripts/common.sh@364 -- # decimal 1 00:17:27.241 02:28:51 -- scripts/common.sh@352 -- # local d=1 00:17:27.241 02:28:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:27.241 02:28:51 -- scripts/common.sh@354 -- # echo 1 00:17:27.241 02:28:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:27.241 02:28:51 -- scripts/common.sh@365 -- # decimal 2 00:17:27.241 02:28:51 -- scripts/common.sh@352 -- # local d=2 00:17:27.241 02:28:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:27.241 02:28:51 -- scripts/common.sh@354 -- # echo 2 00:17:27.241 02:28:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:27.241 02:28:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:27.241 02:28:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:27.241 02:28:51 -- scripts/common.sh@367 -- # return 0 00:17:27.241 02:28:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:27.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:27.241 --rc genhtml_branch_coverage=1 00:17:27.241 --rc genhtml_function_coverage=1 00:17:27.241 --rc genhtml_legend=1 00:17:27.241 --rc geninfo_all_blocks=1 00:17:27.241 --rc geninfo_unexecuted_blocks=1 00:17:27.241 00:17:27.241 ' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:27.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:27.241 --rc genhtml_branch_coverage=1 00:17:27.241 --rc genhtml_function_coverage=1 00:17:27.241 --rc genhtml_legend=1 00:17:27.241 --rc geninfo_all_blocks=1 00:17:27.241 --rc geninfo_unexecuted_blocks=1 00:17:27.241 00:17:27.241 ' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:27.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:27.241 --rc genhtml_branch_coverage=1 00:17:27.241 --rc genhtml_function_coverage=1 00:17:27.241 --rc genhtml_legend=1 00:17:27.241 --rc geninfo_all_blocks=1 00:17:27.241 --rc geninfo_unexecuted_blocks=1 00:17:27.241 00:17:27.241 ' 00:17:27.241 02:28:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:27.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:27.241 --rc genhtml_branch_coverage=1 00:17:27.241 --rc genhtml_function_coverage=1 00:17:27.241 --rc genhtml_legend=1 00:17:27.241 --rc geninfo_all_blocks=1 00:17:27.241 --rc geninfo_unexecuted_blocks=1 00:17:27.241 00:17:27.241 ' 00:17:27.241 02:28:51 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:27.241 02:28:51 -- nvmf/common.sh@7 -- # uname -s 00:17:27.241 02:28:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:27.241 02:28:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:27.241 02:28:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:27.241 02:28:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:27.241 02:28:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:27.241 02:28:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:27.241 02:28:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:27.241 02:28:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:27.241 02:28:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:27.241 02:28:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:27.241 02:28:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:27.241 02:28:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:27.241 02:28:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:27.241 02:28:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:27.241 02:28:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:27.241 02:28:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:27.241 02:28:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:27.241 02:28:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:27.241 02:28:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:27.241 02:28:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:27.241 02:28:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:27.241 02:28:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:27.241 02:28:51 -- paths/export.sh@5 -- # export PATH 00:17:27.242 02:28:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:27.242 02:28:51 -- nvmf/common.sh@46 -- # : 0 00:17:27.242 02:28:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:27.242 02:28:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:27.242 02:28:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:27.242 02:28:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:27.242 02:28:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:27.242 02:28:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:27.242 02:28:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:27.242 02:28:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:27.242 02:28:51 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:27.242 02:28:51 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:27.242 02:28:51 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:27.242 02:28:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:27.242 02:28:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:27.242 02:28:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:27.242 02:28:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:27.242 02:28:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:27.242 02:28:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:27.242 02:28:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:27.242 02:28:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:27.242 02:28:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:27.242 02:28:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:27.242 02:28:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:27.242 02:28:51 -- common/autotest_common.sh@10 -- # set +x 00:17:29.146 02:28:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:29.146 02:28:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:29.146 02:28:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:29.146 02:28:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:29.147 02:28:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:29.147 02:28:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:29.147 02:28:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:29.147 02:28:53 -- nvmf/common.sh@294 -- # net_devs=() 00:17:29.147 02:28:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:29.147 02:28:53 -- nvmf/common.sh@295 -- # e810=() 00:17:29.147 02:28:53 -- nvmf/common.sh@295 -- # local -ga e810 00:17:29.147 02:28:53 -- nvmf/common.sh@296 -- # x722=() 00:17:29.147 02:28:53 -- nvmf/common.sh@296 -- # local -ga x722 00:17:29.147 02:28:53 -- nvmf/common.sh@297 -- # mlx=() 00:17:29.147 02:28:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:29.147 02:28:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:29.147 02:28:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:29.147 02:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:29.147 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:29.147 02:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:29.147 02:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:29.147 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:29.147 02:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:29.147 02:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:29.147 02:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:29.147 02:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:29.147 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:29.147 02:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:29.147 02:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:29.147 02:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:29.147 02:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:29.147 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:29.147 02:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:29.147 02:28:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:29.147 02:28:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:29.147 02:28:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:29.147 02:28:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:29.147 02:28:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:29.147 02:28:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:29.147 02:28:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:29.147 02:28:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:29.147 02:28:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:29.147 02:28:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:29.147 02:28:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:29.147 02:28:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:29.147 02:28:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:29.147 02:28:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:29.147 02:28:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:29.147 02:28:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:29.147 02:28:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:29.147 02:28:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:29.147 02:28:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:29.147 02:28:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:29.147 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:29.147 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:17:29.147 00:17:29.147 --- 10.0.0.2 ping statistics --- 00:17:29.147 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:29.147 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:17:29.147 02:28:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:29.147 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:29.147 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:17:29.147 00:17:29.147 --- 10.0.0.1 ping statistics --- 00:17:29.147 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:29.147 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:17:29.147 02:28:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:29.147 02:28:53 -- nvmf/common.sh@410 -- # return 0 00:17:29.147 02:28:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:29.147 02:28:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:29.147 02:28:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:29.147 02:28:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:29.147 02:28:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:29.147 02:28:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:29.147 02:28:53 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:29.147 02:28:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:29.147 02:28:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:29.147 02:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.147 02:28:53 -- nvmf/common.sh@469 -- # nvmfpid=2062700 00:17:29.148 02:28:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:29.148 02:28:53 -- nvmf/common.sh@470 -- # waitforlisten 2062700 00:17:29.148 02:28:53 -- common/autotest_common.sh@829 -- # '[' -z 2062700 ']' 00:17:29.148 02:28:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:29.148 02:28:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:29.148 02:28:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:29.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:29.148 02:28:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:29.148 02:28:53 -- common/autotest_common.sh@10 -- # set +x 00:17:29.148 [2024-11-27 02:28:53.767058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:29.148 [2024-11-27 02:28:53.767129] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:29.406 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.406 [2024-11-27 02:28:53.833050] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:29.406 [2024-11-27 02:28:53.919685] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:29.406 [2024-11-27 02:28:53.919883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:29.406 [2024-11-27 02:28:53.919922] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:29.406 [2024-11-27 02:28:53.919943] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:29.406 [2024-11-27 02:28:53.919971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:30.343 02:28:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:30.343 02:28:54 -- common/autotest_common.sh@862 -- # return 0 00:17:30.343 02:28:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:30.343 02:28:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:30.343 02:28:54 -- common/autotest_common.sh@10 -- # set +x 00:17:30.343 02:28:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:30.343 02:28:54 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:30.602 [2024-11-27 02:28:55.074794] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:30.602 02:28:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:30.602 02:28:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:30.602 02:28:55 -- common/autotest_common.sh@10 -- # set +x 00:17:30.602 ************************************ 00:17:30.602 START TEST lvs_grow_clean 00:17:30.602 ************************************ 00:17:30.602 02:28:55 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:30.602 02:28:55 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:30.861 02:28:55 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:30.861 02:28:55 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:31.121 02:28:55 -- target/nvmf_lvs_grow.sh@28 -- # lvs=87b4ec6e-9397-4c94-bd91-335591d92246 00:17:31.121 02:28:55 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:31.121 02:28:55 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:31.381 02:28:55 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:31.381 02:28:55 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:31.381 02:28:55 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 87b4ec6e-9397-4c94-bd91-335591d92246 lvol 150 00:17:31.948 02:28:56 -- target/nvmf_lvs_grow.sh@33 -- # lvol=f2c51b27-503c-4b00-acd9-5b6b4ac3236c 00:17:31.948 02:28:56 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.948 02:28:56 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:31.948 [2024-11-27 02:28:56.536168] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:31.948 [2024-11-27 02:28:56.536266] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:31.948 true 00:17:31.948 02:28:56 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:31.948 02:28:56 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:32.515 02:28:56 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:32.515 02:28:56 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:32.515 02:28:57 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 f2c51b27-503c-4b00-acd9-5b6b4ac3236c 00:17:32.773 02:28:57 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:33.039 [2024-11-27 02:28:57.627557] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:33.039 02:28:57 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:33.298 02:28:57 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2063285 00:17:33.298 02:28:57 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:33.298 02:28:57 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:33.298 02:28:57 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2063285 /var/tmp/bdevperf.sock 00:17:33.298 02:28:57 -- common/autotest_common.sh@829 -- # '[' -z 2063285 ']' 00:17:33.298 02:28:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.298 02:28:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.298 02:28:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.298 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.298 02:28:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.298 02:28:57 -- common/autotest_common.sh@10 -- # set +x 00:17:33.556 [2024-11-27 02:28:57.935004] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:33.556 [2024-11-27 02:28:57.935078] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2063285 ] 00:17:33.556 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.556 [2024-11-27 02:28:57.993846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.556 [2024-11-27 02:28:58.078735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:34.491 02:28:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.491 02:28:58 -- common/autotest_common.sh@862 -- # return 0 00:17:34.491 02:28:58 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:35.057 Nvme0n1 00:17:35.057 02:28:59 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:35.317 [ 00:17:35.317 { 00:17:35.317 "name": "Nvme0n1", 00:17:35.317 "aliases": [ 00:17:35.317 "f2c51b27-503c-4b00-acd9-5b6b4ac3236c" 00:17:35.317 ], 00:17:35.317 "product_name": "NVMe disk", 00:17:35.317 "block_size": 4096, 00:17:35.317 "num_blocks": 38912, 00:17:35.317 "uuid": "f2c51b27-503c-4b00-acd9-5b6b4ac3236c", 00:17:35.317 "assigned_rate_limits": { 00:17:35.317 "rw_ios_per_sec": 0, 00:17:35.317 "rw_mbytes_per_sec": 0, 00:17:35.317 "r_mbytes_per_sec": 0, 00:17:35.317 "w_mbytes_per_sec": 0 00:17:35.317 }, 00:17:35.317 "claimed": false, 00:17:35.317 "zoned": false, 00:17:35.317 "supported_io_types": { 00:17:35.317 "read": true, 00:17:35.317 "write": true, 00:17:35.317 "unmap": true, 00:17:35.317 "write_zeroes": true, 00:17:35.317 "flush": true, 00:17:35.317 "reset": true, 00:17:35.317 "compare": true, 00:17:35.317 "compare_and_write": true, 00:17:35.317 "abort": true, 00:17:35.317 "nvme_admin": true, 00:17:35.317 "nvme_io": true 00:17:35.317 }, 00:17:35.317 "driver_specific": { 00:17:35.317 "nvme": [ 00:17:35.317 { 00:17:35.317 "trid": { 00:17:35.317 "trtype": "TCP", 00:17:35.317 "adrfam": "IPv4", 00:17:35.317 "traddr": "10.0.0.2", 00:17:35.317 "trsvcid": "4420", 00:17:35.317 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:35.317 }, 00:17:35.317 "ctrlr_data": { 00:17:35.317 "cntlid": 1, 00:17:35.317 "vendor_id": "0x8086", 00:17:35.317 "model_number": "SPDK bdev Controller", 00:17:35.317 "serial_number": "SPDK0", 00:17:35.317 "firmware_revision": "24.01.1", 00:17:35.317 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:35.317 "oacs": { 00:17:35.317 "security": 0, 00:17:35.317 "format": 0, 00:17:35.317 "firmware": 0, 00:17:35.317 "ns_manage": 0 00:17:35.317 }, 00:17:35.317 "multi_ctrlr": true, 00:17:35.317 "ana_reporting": false 00:17:35.317 }, 00:17:35.317 "vs": { 00:17:35.317 "nvme_version": "1.3" 00:17:35.317 }, 00:17:35.317 "ns_data": { 00:17:35.317 "id": 1, 00:17:35.317 "can_share": true 00:17:35.317 } 00:17:35.317 } 00:17:35.317 ], 00:17:35.317 "mp_policy": "active_passive" 00:17:35.317 } 00:17:35.317 } 00:17:35.317 ] 00:17:35.317 02:28:59 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2063554 00:17:35.317 02:28:59 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:35.317 02:28:59 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:35.317 Running I/O for 10 seconds... 00:17:36.254 Latency(us) 00:17:36.254 [2024-11-27T01:29:00.889Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.254 [2024-11-27T01:29:00.889Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.254 Nvme0n1 : 1.00 14479.00 56.56 0.00 0.00 0.00 0.00 0.00 00:17:36.254 [2024-11-27T01:29:00.889Z] =================================================================================================================== 00:17:36.254 [2024-11-27T01:29:00.889Z] Total : 14479.00 56.56 0.00 0.00 0.00 0.00 0.00 00:17:36.254 00:17:37.190 02:29:01 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:37.448 [2024-11-27T01:29:02.083Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.448 Nvme0n1 : 2.00 14678.50 57.34 0.00 0.00 0.00 0.00 0.00 00:17:37.448 [2024-11-27T01:29:02.083Z] =================================================================================================================== 00:17:37.448 [2024-11-27T01:29:02.083Z] Total : 14678.50 57.34 0.00 0.00 0.00 0.00 0.00 00:17:37.448 00:17:37.448 true 00:17:37.448 02:29:02 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:37.448 02:29:02 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:37.706 02:29:02 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:37.706 02:29:02 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:37.707 02:29:02 -- target/nvmf_lvs_grow.sh@65 -- # wait 2063554 00:17:38.273 [2024-11-27T01:29:02.908Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.273 Nvme0n1 : 3.00 14827.67 57.92 0.00 0.00 0.00 0.00 0.00 00:17:38.273 [2024-11-27T01:29:02.908Z] =================================================================================================================== 00:17:38.273 [2024-11-27T01:29:02.908Z] Total : 14827.67 57.92 0.00 0.00 0.00 0.00 0.00 00:17:38.273 00:17:39.650 [2024-11-27T01:29:04.285Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.650 Nvme0n1 : 4.00 14915.00 58.26 0.00 0.00 0.00 0.00 0.00 00:17:39.650 [2024-11-27T01:29:04.285Z] =================================================================================================================== 00:17:39.650 [2024-11-27T01:29:04.285Z] Total : 14915.00 58.26 0.00 0.00 0.00 0.00 0.00 00:17:39.650 00:17:40.589 [2024-11-27T01:29:05.224Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.589 Nvme0n1 : 5.00 14981.00 58.52 0.00 0.00 0.00 0.00 0.00 00:17:40.589 [2024-11-27T01:29:05.224Z] =================================================================================================================== 00:17:40.589 [2024-11-27T01:29:05.224Z] Total : 14981.00 58.52 0.00 0.00 0.00 0.00 0.00 00:17:40.589 00:17:41.527 [2024-11-27T01:29:06.162Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.527 Nvme0n1 : 6.00 15024.50 58.69 0.00 0.00 0.00 0.00 0.00 00:17:41.527 [2024-11-27T01:29:06.162Z] =================================================================================================================== 00:17:41.527 [2024-11-27T01:29:06.162Z] Total : 15024.50 58.69 0.00 0.00 0.00 0.00 0.00 00:17:41.527 00:17:42.463 [2024-11-27T01:29:07.098Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.463 Nvme0n1 : 7.00 15073.43 58.88 0.00 0.00 0.00 0.00 0.00 00:17:42.463 [2024-11-27T01:29:07.098Z] =================================================================================================================== 00:17:42.463 [2024-11-27T01:29:07.098Z] Total : 15073.43 58.88 0.00 0.00 0.00 0.00 0.00 00:17:42.463 00:17:43.403 [2024-11-27T01:29:08.038Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.403 Nvme0n1 : 8.00 15110.12 59.02 0.00 0.00 0.00 0.00 0.00 00:17:43.403 [2024-11-27T01:29:08.038Z] =================================================================================================================== 00:17:43.403 [2024-11-27T01:29:08.038Z] Total : 15110.12 59.02 0.00 0.00 0.00 0.00 0.00 00:17:43.403 00:17:44.339 [2024-11-27T01:29:08.974Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.339 Nvme0n1 : 9.00 15138.67 59.14 0.00 0.00 0.00 0.00 0.00 00:17:44.339 [2024-11-27T01:29:08.974Z] =================================================================================================================== 00:17:44.339 [2024-11-27T01:29:08.974Z] Total : 15138.67 59.14 0.00 0.00 0.00 0.00 0.00 00:17:44.339 00:17:45.278 [2024-11-27T01:29:09.913Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.278 Nvme0n1 : 10.00 15174.20 59.27 0.00 0.00 0.00 0.00 0.00 00:17:45.278 [2024-11-27T01:29:09.913Z] =================================================================================================================== 00:17:45.278 [2024-11-27T01:29:09.913Z] Total : 15174.20 59.27 0.00 0.00 0.00 0.00 0.00 00:17:45.278 00:17:45.278 00:17:45.278 Latency(us) 00:17:45.278 [2024-11-27T01:29:09.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.278 [2024-11-27T01:29:09.913Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.278 Nvme0n1 : 10.01 15176.73 59.28 0.00 0.00 8429.27 4563.25 16990.81 00:17:45.278 [2024-11-27T01:29:09.913Z] =================================================================================================================== 00:17:45.278 [2024-11-27T01:29:09.913Z] Total : 15176.73 59.28 0.00 0.00 8429.27 4563.25 16990.81 00:17:45.278 0 00:17:45.278 02:29:09 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2063285 00:17:45.278 02:29:09 -- common/autotest_common.sh@936 -- # '[' -z 2063285 ']' 00:17:45.278 02:29:09 -- common/autotest_common.sh@940 -- # kill -0 2063285 00:17:45.278 02:29:09 -- common/autotest_common.sh@941 -- # uname 00:17:45.278 02:29:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:45.278 02:29:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2063285 00:17:45.537 02:29:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:45.537 02:29:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:45.537 02:29:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2063285' 00:17:45.537 killing process with pid 2063285 00:17:45.537 02:29:09 -- common/autotest_common.sh@955 -- # kill 2063285 00:17:45.537 Received shutdown signal, test time was about 10.000000 seconds 00:17:45.537 00:17:45.537 Latency(us) 00:17:45.537 [2024-11-27T01:29:10.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.537 [2024-11-27T01:29:10.172Z] =================================================================================================================== 00:17:45.537 [2024-11-27T01:29:10.172Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:45.537 02:29:09 -- common/autotest_common.sh@960 -- # wait 2063285 00:17:45.537 02:29:10 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:46.152 02:29:10 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:46.152 02:29:10 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:46.152 02:29:10 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:46.152 02:29:10 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:46.152 02:29:10 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:46.452 [2024-11-27 02:29:10.992541] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:46.452 02:29:11 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:46.452 02:29:11 -- common/autotest_common.sh@650 -- # local es=0 00:17:46.452 02:29:11 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:46.452 02:29:11 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:46.452 02:29:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:46.452 02:29:11 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:46.452 02:29:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:46.452 02:29:11 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:46.452 02:29:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:46.452 02:29:11 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:46.452 02:29:11 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:46.452 02:29:11 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:46.711 request: 00:17:46.711 { 00:17:46.711 "uuid": "87b4ec6e-9397-4c94-bd91-335591d92246", 00:17:46.711 "method": "bdev_lvol_get_lvstores", 00:17:46.711 "req_id": 1 00:17:46.711 } 00:17:46.711 Got JSON-RPC error response 00:17:46.711 response: 00:17:46.711 { 00:17:46.711 "code": -19, 00:17:46.711 "message": "No such device" 00:17:46.711 } 00:17:46.711 02:29:11 -- common/autotest_common.sh@653 -- # es=1 00:17:46.711 02:29:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:46.711 02:29:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:46.711 02:29:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:46.711 02:29:11 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:46.969 aio_bdev 00:17:46.969 02:29:11 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev f2c51b27-503c-4b00-acd9-5b6b4ac3236c 00:17:46.969 02:29:11 -- common/autotest_common.sh@897 -- # local bdev_name=f2c51b27-503c-4b00-acd9-5b6b4ac3236c 00:17:46.969 02:29:11 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:46.969 02:29:11 -- common/autotest_common.sh@899 -- # local i 00:17:46.969 02:29:11 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:46.969 02:29:11 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:46.969 02:29:11 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:47.229 02:29:11 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b f2c51b27-503c-4b00-acd9-5b6b4ac3236c -t 2000 00:17:47.489 [ 00:17:47.489 { 00:17:47.489 "name": "f2c51b27-503c-4b00-acd9-5b6b4ac3236c", 00:17:47.489 "aliases": [ 00:17:47.489 "lvs/lvol" 00:17:47.489 ], 00:17:47.489 "product_name": "Logical Volume", 00:17:47.489 "block_size": 4096, 00:17:47.489 "num_blocks": 38912, 00:17:47.489 "uuid": "f2c51b27-503c-4b00-acd9-5b6b4ac3236c", 00:17:47.489 "assigned_rate_limits": { 00:17:47.489 "rw_ios_per_sec": 0, 00:17:47.489 "rw_mbytes_per_sec": 0, 00:17:47.489 "r_mbytes_per_sec": 0, 00:17:47.489 "w_mbytes_per_sec": 0 00:17:47.489 }, 00:17:47.489 "claimed": false, 00:17:47.489 "zoned": false, 00:17:47.489 "supported_io_types": { 00:17:47.489 "read": true, 00:17:47.489 "write": true, 00:17:47.489 "unmap": true, 00:17:47.489 "write_zeroes": true, 00:17:47.489 "flush": false, 00:17:47.489 "reset": true, 00:17:47.489 "compare": false, 00:17:47.489 "compare_and_write": false, 00:17:47.489 "abort": false, 00:17:47.489 "nvme_admin": false, 00:17:47.489 "nvme_io": false 00:17:47.489 }, 00:17:47.489 "driver_specific": { 00:17:47.489 "lvol": { 00:17:47.489 "lvol_store_uuid": "87b4ec6e-9397-4c94-bd91-335591d92246", 00:17:47.489 "base_bdev": "aio_bdev", 00:17:47.489 "thin_provision": false, 00:17:47.489 "snapshot": false, 00:17:47.489 "clone": false, 00:17:47.489 "esnap_clone": false 00:17:47.489 } 00:17:47.489 } 00:17:47.489 } 00:17:47.489 ] 00:17:47.489 02:29:12 -- common/autotest_common.sh@905 -- # return 0 00:17:47.489 02:29:12 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:47.489 02:29:12 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:47.748 02:29:12 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:47.748 02:29:12 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:47.748 02:29:12 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:48.008 02:29:12 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:48.008 02:29:12 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f2c51b27-503c-4b00-acd9-5b6b4ac3236c 00:17:48.267 02:29:12 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 87b4ec6e-9397-4c94-bd91-335591d92246 00:17:48.525 02:29:13 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.783 00:17:48.783 real 0m18.272s 00:17:48.783 user 0m18.115s 00:17:48.783 sys 0m1.834s 00:17:48.783 02:29:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:48.783 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.783 ************************************ 00:17:48.783 END TEST lvs_grow_clean 00:17:48.783 ************************************ 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:48.783 02:29:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:48.783 02:29:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:48.783 02:29:13 -- common/autotest_common.sh@10 -- # set +x 00:17:48.783 ************************************ 00:17:48.783 START TEST lvs_grow_dirty 00:17:48.783 ************************************ 00:17:48.783 02:29:13 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.783 02:29:13 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.784 02:29:13 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:49.353 02:29:13 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:49.353 02:29:13 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:49.353 02:29:13 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:17:49.353 02:29:13 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:17:49.353 02:29:13 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:49.612 02:29:14 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:49.612 02:29:14 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:49.612 02:29:14 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d lvol 150 00:17:49.871 02:29:14 -- target/nvmf_lvs_grow.sh@33 -- # lvol=9f6cd081-43cd-41e1-971f-685f63b137bc 00:17:49.871 02:29:14 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:49.871 02:29:14 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:50.129 [2024-11-27 02:29:14.689875] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:50.129 [2024-11-27 02:29:14.689969] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:50.129 true 00:17:50.129 02:29:14 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:17:50.129 02:29:14 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:50.389 02:29:14 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:50.389 02:29:14 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:50.647 02:29:15 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 9f6cd081-43cd-41e1-971f-685f63b137bc 00:17:50.907 02:29:15 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:51.165 02:29:15 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:51.423 02:29:16 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2065529 00:17:51.423 02:29:16 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:51.423 02:29:16 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2065529 /var/tmp/bdevperf.sock 00:17:51.423 02:29:16 -- common/autotest_common.sh@829 -- # '[' -z 2065529 ']' 00:17:51.423 02:29:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.423 02:29:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.423 02:29:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.423 02:29:16 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:51.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.423 02:29:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.423 02:29:16 -- common/autotest_common.sh@10 -- # set +x 00:17:51.423 [2024-11-27 02:29:16.053150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:51.423 [2024-11-27 02:29:16.053236] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2065529 ] 00:17:51.683 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.683 [2024-11-27 02:29:16.112111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.683 [2024-11-27 02:29:16.195934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:52.619 02:29:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.619 02:29:17 -- common/autotest_common.sh@862 -- # return 0 00:17:52.619 02:29:17 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:52.877 Nvme0n1 00:17:52.877 02:29:17 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:53.137 [ 00:17:53.137 { 00:17:53.137 "name": "Nvme0n1", 00:17:53.137 "aliases": [ 00:17:53.137 "9f6cd081-43cd-41e1-971f-685f63b137bc" 00:17:53.137 ], 00:17:53.137 "product_name": "NVMe disk", 00:17:53.137 "block_size": 4096, 00:17:53.137 "num_blocks": 38912, 00:17:53.137 "uuid": "9f6cd081-43cd-41e1-971f-685f63b137bc", 00:17:53.137 "assigned_rate_limits": { 00:17:53.137 "rw_ios_per_sec": 0, 00:17:53.137 "rw_mbytes_per_sec": 0, 00:17:53.137 "r_mbytes_per_sec": 0, 00:17:53.137 "w_mbytes_per_sec": 0 00:17:53.137 }, 00:17:53.137 "claimed": false, 00:17:53.137 "zoned": false, 00:17:53.137 "supported_io_types": { 00:17:53.137 "read": true, 00:17:53.137 "write": true, 00:17:53.137 "unmap": true, 00:17:53.137 "write_zeroes": true, 00:17:53.137 "flush": true, 00:17:53.137 "reset": true, 00:17:53.137 "compare": true, 00:17:53.137 "compare_and_write": true, 00:17:53.137 "abort": true, 00:17:53.137 "nvme_admin": true, 00:17:53.137 "nvme_io": true 00:17:53.137 }, 00:17:53.137 "driver_specific": { 00:17:53.137 "nvme": [ 00:17:53.137 { 00:17:53.137 "trid": { 00:17:53.137 "trtype": "TCP", 00:17:53.137 "adrfam": "IPv4", 00:17:53.137 "traddr": "10.0.0.2", 00:17:53.137 "trsvcid": "4420", 00:17:53.137 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:53.137 }, 00:17:53.137 "ctrlr_data": { 00:17:53.137 "cntlid": 1, 00:17:53.137 "vendor_id": "0x8086", 00:17:53.137 "model_number": "SPDK bdev Controller", 00:17:53.137 "serial_number": "SPDK0", 00:17:53.137 "firmware_revision": "24.01.1", 00:17:53.137 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:53.137 "oacs": { 00:17:53.137 "security": 0, 00:17:53.137 "format": 0, 00:17:53.137 "firmware": 0, 00:17:53.137 "ns_manage": 0 00:17:53.137 }, 00:17:53.137 "multi_ctrlr": true, 00:17:53.137 "ana_reporting": false 00:17:53.137 }, 00:17:53.137 "vs": { 00:17:53.137 "nvme_version": "1.3" 00:17:53.137 }, 00:17:53.137 "ns_data": { 00:17:53.137 "id": 1, 00:17:53.137 "can_share": true 00:17:53.137 } 00:17:53.137 } 00:17:53.137 ], 00:17:53.137 "mp_policy": "active_passive" 00:17:53.137 } 00:17:53.137 } 00:17:53.137 ] 00:17:53.137 02:29:17 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2065677 00:17:53.137 02:29:17 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:53.137 02:29:17 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:53.137 Running I/O for 10 seconds... 00:17:54.517 Latency(us) 00:17:54.517 [2024-11-27T01:29:19.152Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.517 [2024-11-27T01:29:19.152Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:54.517 Nvme0n1 : 1.00 14928.00 58.31 0.00 0.00 0.00 0.00 0.00 00:17:54.517 [2024-11-27T01:29:19.152Z] =================================================================================================================== 00:17:54.517 [2024-11-27T01:29:19.152Z] Total : 14928.00 58.31 0.00 0.00 0.00 0.00 0.00 00:17:54.517 00:17:55.081 02:29:19 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:17:55.339 [2024-11-27T01:29:19.974Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.339 Nvme0n1 : 2.00 15020.50 58.67 0.00 0.00 0.00 0.00 0.00 00:17:55.339 [2024-11-27T01:29:19.974Z] =================================================================================================================== 00:17:55.339 [2024-11-27T01:29:19.974Z] Total : 15020.50 58.67 0.00 0.00 0.00 0.00 0.00 00:17:55.339 00:17:55.339 true 00:17:55.339 02:29:19 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:17:55.339 02:29:19 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:55.599 02:29:20 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:55.599 02:29:20 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:55.599 02:29:20 -- target/nvmf_lvs_grow.sh@65 -- # wait 2065677 00:17:56.168 [2024-11-27T01:29:20.803Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.168 Nvme0n1 : 3.00 15074.00 58.88 0.00 0.00 0.00 0.00 0.00 00:17:56.168 [2024-11-27T01:29:20.803Z] =================================================================================================================== 00:17:56.168 [2024-11-27T01:29:20.803Z] Total : 15074.00 58.88 0.00 0.00 0.00 0.00 0.00 00:17:56.168 00:17:57.108 [2024-11-27T01:29:21.743Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.108 Nvme0n1 : 4.00 15173.00 59.27 0.00 0.00 0.00 0.00 0.00 00:17:57.108 [2024-11-27T01:29:21.743Z] =================================================================================================================== 00:17:57.108 [2024-11-27T01:29:21.743Z] Total : 15173.00 59.27 0.00 0.00 0.00 0.00 0.00 00:17:57.108 00:17:58.488 [2024-11-27T01:29:23.123Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.488 Nvme0n1 : 5.00 15208.00 59.41 0.00 0.00 0.00 0.00 0.00 00:17:58.488 [2024-11-27T01:29:23.124Z] =================================================================================================================== 00:17:58.489 [2024-11-27T01:29:23.124Z] Total : 15208.00 59.41 0.00 0.00 0.00 0.00 0.00 00:17:58.489 00:17:59.426 [2024-11-27T01:29:24.061Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.426 Nvme0n1 : 6.00 15235.83 59.51 0.00 0.00 0.00 0.00 0.00 00:17:59.426 [2024-11-27T01:29:24.061Z] =================================================================================================================== 00:17:59.426 [2024-11-27T01:29:24.061Z] Total : 15235.83 59.51 0.00 0.00 0.00 0.00 0.00 00:17:59.426 00:18:00.367 [2024-11-27T01:29:25.002Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.367 Nvme0n1 : 7.00 15263.86 59.62 0.00 0.00 0.00 0.00 0.00 00:18:00.367 [2024-11-27T01:29:25.002Z] =================================================================================================================== 00:18:00.367 [2024-11-27T01:29:25.002Z] Total : 15263.86 59.62 0.00 0.00 0.00 0.00 0.00 00:18:00.367 00:18:01.303 [2024-11-27T01:29:25.938Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.303 Nvme0n1 : 8.00 15293.00 59.74 0.00 0.00 0.00 0.00 0.00 00:18:01.303 [2024-11-27T01:29:25.938Z] =================================================================================================================== 00:18:01.303 [2024-11-27T01:29:25.938Z] Total : 15293.00 59.74 0.00 0.00 0.00 0.00 0.00 00:18:01.303 00:18:02.241 [2024-11-27T01:29:26.876Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.241 Nvme0n1 : 9.00 15311.44 59.81 0.00 0.00 0.00 0.00 0.00 00:18:02.241 [2024-11-27T01:29:26.876Z] =================================================================================================================== 00:18:02.241 [2024-11-27T01:29:26.876Z] Total : 15311.44 59.81 0.00 0.00 0.00 0.00 0.00 00:18:02.241 00:18:03.184 [2024-11-27T01:29:27.819Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.184 Nvme0n1 : 10.00 15330.00 59.88 0.00 0.00 0.00 0.00 0.00 00:18:03.184 [2024-11-27T01:29:27.819Z] =================================================================================================================== 00:18:03.184 [2024-11-27T01:29:27.819Z] Total : 15330.00 59.88 0.00 0.00 0.00 0.00 0.00 00:18:03.184 00:18:03.184 00:18:03.184 Latency(us) 00:18:03.184 [2024-11-27T01:29:27.819Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:03.184 [2024-11-27T01:29:27.819Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.184 Nvme0n1 : 10.01 15334.84 59.90 0.00 0.00 8342.67 4490.43 17767.54 00:18:03.184 [2024-11-27T01:29:27.819Z] =================================================================================================================== 00:18:03.184 [2024-11-27T01:29:27.819Z] Total : 15334.84 59.90 0.00 0.00 8342.67 4490.43 17767.54 00:18:03.184 0 00:18:03.184 02:29:27 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2065529 00:18:03.184 02:29:27 -- common/autotest_common.sh@936 -- # '[' -z 2065529 ']' 00:18:03.184 02:29:27 -- common/autotest_common.sh@940 -- # kill -0 2065529 00:18:03.184 02:29:27 -- common/autotest_common.sh@941 -- # uname 00:18:03.184 02:29:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:03.184 02:29:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2065529 00:18:03.184 02:29:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:03.184 02:29:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:03.184 02:29:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2065529' 00:18:03.184 killing process with pid 2065529 00:18:03.184 02:29:27 -- common/autotest_common.sh@955 -- # kill 2065529 00:18:03.185 Received shutdown signal, test time was about 10.000000 seconds 00:18:03.185 00:18:03.185 Latency(us) 00:18:03.185 [2024-11-27T01:29:27.820Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:03.185 [2024-11-27T01:29:27.820Z] =================================================================================================================== 00:18:03.185 [2024-11-27T01:29:27.820Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:03.185 02:29:27 -- common/autotest_common.sh@960 -- # wait 2065529 00:18:03.443 02:29:28 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:03.701 02:29:28 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:03.701 02:29:28 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:03.960 02:29:28 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:03.960 02:29:28 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:03.960 02:29:28 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2062700 00:18:03.960 02:29:28 -- target/nvmf_lvs_grow.sh@74 -- # wait 2062700 00:18:04.218 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2062700 Killed "${NVMF_APP[@]}" "$@" 00:18:04.218 02:29:28 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:04.218 02:29:28 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:04.218 02:29:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:04.218 02:29:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:04.218 02:29:28 -- common/autotest_common.sh@10 -- # set +x 00:18:04.218 02:29:28 -- nvmf/common.sh@469 -- # nvmfpid=2067042 00:18:04.218 02:29:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:04.218 02:29:28 -- nvmf/common.sh@470 -- # waitforlisten 2067042 00:18:04.218 02:29:28 -- common/autotest_common.sh@829 -- # '[' -z 2067042 ']' 00:18:04.218 02:29:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:04.218 02:29:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:04.218 02:29:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:04.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:04.218 02:29:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:04.218 02:29:28 -- common/autotest_common.sh@10 -- # set +x 00:18:04.218 [2024-11-27 02:29:28.662331] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:04.218 [2024-11-27 02:29:28.662404] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:04.218 EAL: No free 2048 kB hugepages reported on node 1 00:18:04.218 [2024-11-27 02:29:28.730671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:04.218 [2024-11-27 02:29:28.817410] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:04.218 [2024-11-27 02:29:28.817589] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:04.218 [2024-11-27 02:29:28.817624] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:04.218 [2024-11-27 02:29:28.817639] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:04.218 [2024-11-27 02:29:28.817678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:05.162 02:29:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.162 02:29:29 -- common/autotest_common.sh@862 -- # return 0 00:18:05.162 02:29:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:05.162 02:29:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:05.162 02:29:29 -- common/autotest_common.sh@10 -- # set +x 00:18:05.162 02:29:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:05.162 02:29:29 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:05.421 [2024-11-27 02:29:29.897432] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:05.421 [2024-11-27 02:29:29.897608] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:05.421 [2024-11-27 02:29:29.897659] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:05.421 02:29:29 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:05.421 02:29:29 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 9f6cd081-43cd-41e1-971f-685f63b137bc 00:18:05.421 02:29:29 -- common/autotest_common.sh@897 -- # local bdev_name=9f6cd081-43cd-41e1-971f-685f63b137bc 00:18:05.421 02:29:29 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:05.421 02:29:29 -- common/autotest_common.sh@899 -- # local i 00:18:05.421 02:29:29 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:05.421 02:29:29 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:05.421 02:29:29 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:05.681 02:29:30 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 9f6cd081-43cd-41e1-971f-685f63b137bc -t 2000 00:18:05.941 [ 00:18:05.941 { 00:18:05.941 "name": "9f6cd081-43cd-41e1-971f-685f63b137bc", 00:18:05.941 "aliases": [ 00:18:05.941 "lvs/lvol" 00:18:05.941 ], 00:18:05.941 "product_name": "Logical Volume", 00:18:05.941 "block_size": 4096, 00:18:05.941 "num_blocks": 38912, 00:18:05.941 "uuid": "9f6cd081-43cd-41e1-971f-685f63b137bc", 00:18:05.941 "assigned_rate_limits": { 00:18:05.941 "rw_ios_per_sec": 0, 00:18:05.941 "rw_mbytes_per_sec": 0, 00:18:05.941 "r_mbytes_per_sec": 0, 00:18:05.941 "w_mbytes_per_sec": 0 00:18:05.941 }, 00:18:05.941 "claimed": false, 00:18:05.941 "zoned": false, 00:18:05.941 "supported_io_types": { 00:18:05.941 "read": true, 00:18:05.941 "write": true, 00:18:05.941 "unmap": true, 00:18:05.941 "write_zeroes": true, 00:18:05.941 "flush": false, 00:18:05.941 "reset": true, 00:18:05.941 "compare": false, 00:18:05.941 "compare_and_write": false, 00:18:05.941 "abort": false, 00:18:05.941 "nvme_admin": false, 00:18:05.941 "nvme_io": false 00:18:05.941 }, 00:18:05.941 "driver_specific": { 00:18:05.941 "lvol": { 00:18:05.941 "lvol_store_uuid": "e9b2b0b4-b7b3-4575-a4ac-9b80a604431d", 00:18:05.941 "base_bdev": "aio_bdev", 00:18:05.941 "thin_provision": false, 00:18:05.941 "snapshot": false, 00:18:05.941 "clone": false, 00:18:05.941 "esnap_clone": false 00:18:05.941 } 00:18:05.941 } 00:18:05.941 } 00:18:05.941 ] 00:18:05.941 02:29:30 -- common/autotest_common.sh@905 -- # return 0 00:18:05.941 02:29:30 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:05.941 02:29:30 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:06.201 02:29:30 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:06.201 02:29:30 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:06.201 02:29:30 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:06.460 02:29:31 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:06.460 02:29:31 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:06.719 [2024-11-27 02:29:31.270793] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:06.719 02:29:31 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:06.719 02:29:31 -- common/autotest_common.sh@650 -- # local es=0 00:18:06.719 02:29:31 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:06.719 02:29:31 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.719 02:29:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.719 02:29:31 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.719 02:29:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.719 02:29:31 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.719 02:29:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:06.719 02:29:31 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:06.719 02:29:31 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:06.719 02:29:31 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:06.978 request: 00:18:06.978 { 00:18:06.978 "uuid": "e9b2b0b4-b7b3-4575-a4ac-9b80a604431d", 00:18:06.978 "method": "bdev_lvol_get_lvstores", 00:18:06.978 "req_id": 1 00:18:06.978 } 00:18:06.978 Got JSON-RPC error response 00:18:06.978 response: 00:18:06.978 { 00:18:06.978 "code": -19, 00:18:06.978 "message": "No such device" 00:18:06.978 } 00:18:06.978 02:29:31 -- common/autotest_common.sh@653 -- # es=1 00:18:06.978 02:29:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:06.978 02:29:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:06.978 02:29:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:06.978 02:29:31 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:07.237 aio_bdev 00:18:07.237 02:29:31 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 9f6cd081-43cd-41e1-971f-685f63b137bc 00:18:07.237 02:29:31 -- common/autotest_common.sh@897 -- # local bdev_name=9f6cd081-43cd-41e1-971f-685f63b137bc 00:18:07.238 02:29:31 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:07.238 02:29:31 -- common/autotest_common.sh@899 -- # local i 00:18:07.238 02:29:31 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:07.238 02:29:31 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:07.238 02:29:31 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:07.497 02:29:32 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 9f6cd081-43cd-41e1-971f-685f63b137bc -t 2000 00:18:07.756 [ 00:18:07.756 { 00:18:07.756 "name": "9f6cd081-43cd-41e1-971f-685f63b137bc", 00:18:07.756 "aliases": [ 00:18:07.756 "lvs/lvol" 00:18:07.756 ], 00:18:07.756 "product_name": "Logical Volume", 00:18:07.756 "block_size": 4096, 00:18:07.756 "num_blocks": 38912, 00:18:07.756 "uuid": "9f6cd081-43cd-41e1-971f-685f63b137bc", 00:18:07.756 "assigned_rate_limits": { 00:18:07.756 "rw_ios_per_sec": 0, 00:18:07.756 "rw_mbytes_per_sec": 0, 00:18:07.756 "r_mbytes_per_sec": 0, 00:18:07.756 "w_mbytes_per_sec": 0 00:18:07.756 }, 00:18:07.756 "claimed": false, 00:18:07.756 "zoned": false, 00:18:07.756 "supported_io_types": { 00:18:07.756 "read": true, 00:18:07.756 "write": true, 00:18:07.756 "unmap": true, 00:18:07.756 "write_zeroes": true, 00:18:07.756 "flush": false, 00:18:07.756 "reset": true, 00:18:07.756 "compare": false, 00:18:07.756 "compare_and_write": false, 00:18:07.756 "abort": false, 00:18:07.756 "nvme_admin": false, 00:18:07.756 "nvme_io": false 00:18:07.756 }, 00:18:07.756 "driver_specific": { 00:18:07.756 "lvol": { 00:18:07.756 "lvol_store_uuid": "e9b2b0b4-b7b3-4575-a4ac-9b80a604431d", 00:18:07.756 "base_bdev": "aio_bdev", 00:18:07.756 "thin_provision": false, 00:18:07.756 "snapshot": false, 00:18:07.756 "clone": false, 00:18:07.756 "esnap_clone": false 00:18:07.756 } 00:18:07.756 } 00:18:07.756 } 00:18:07.756 ] 00:18:07.756 02:29:32 -- common/autotest_common.sh@905 -- # return 0 00:18:07.756 02:29:32 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:07.756 02:29:32 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:08.015 02:29:32 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:08.015 02:29:32 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:08.015 02:29:32 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:08.274 02:29:32 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:08.274 02:29:32 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9f6cd081-43cd-41e1-971f-685f63b137bc 00:18:08.532 02:29:33 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e9b2b0b4-b7b3-4575-a4ac-9b80a604431d 00:18:08.792 02:29:33 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:09.051 02:29:33 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:09.051 00:18:09.051 real 0m20.258s 00:18:09.051 user 0m51.304s 00:18:09.051 sys 0m4.626s 00:18:09.052 02:29:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:09.052 02:29:33 -- common/autotest_common.sh@10 -- # set +x 00:18:09.052 ************************************ 00:18:09.052 END TEST lvs_grow_dirty 00:18:09.052 ************************************ 00:18:09.052 02:29:33 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:09.052 02:29:33 -- common/autotest_common.sh@806 -- # type=--id 00:18:09.052 02:29:33 -- common/autotest_common.sh@807 -- # id=0 00:18:09.052 02:29:33 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:09.052 02:29:33 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:09.312 02:29:33 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:09.312 02:29:33 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:09.312 02:29:33 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:09.312 02:29:33 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:09.312 nvmf_trace.0 00:18:09.312 02:29:33 -- common/autotest_common.sh@821 -- # return 0 00:18:09.312 02:29:33 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:09.312 02:29:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:09.312 02:29:33 -- nvmf/common.sh@116 -- # sync 00:18:09.312 02:29:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:09.312 02:29:33 -- nvmf/common.sh@119 -- # set +e 00:18:09.312 02:29:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:09.312 02:29:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:09.312 rmmod nvme_tcp 00:18:09.312 rmmod nvme_fabrics 00:18:09.312 rmmod nvme_keyring 00:18:09.312 02:29:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:09.312 02:29:33 -- nvmf/common.sh@123 -- # set -e 00:18:09.312 02:29:33 -- nvmf/common.sh@124 -- # return 0 00:18:09.312 02:29:33 -- nvmf/common.sh@477 -- # '[' -n 2067042 ']' 00:18:09.312 02:29:33 -- nvmf/common.sh@478 -- # killprocess 2067042 00:18:09.312 02:29:33 -- common/autotest_common.sh@936 -- # '[' -z 2067042 ']' 00:18:09.312 02:29:33 -- common/autotest_common.sh@940 -- # kill -0 2067042 00:18:09.312 02:29:33 -- common/autotest_common.sh@941 -- # uname 00:18:09.312 02:29:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.312 02:29:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2067042 00:18:09.312 02:29:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:09.312 02:29:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:09.312 02:29:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2067042' 00:18:09.312 killing process with pid 2067042 00:18:09.312 02:29:33 -- common/autotest_common.sh@955 -- # kill 2067042 00:18:09.312 02:29:33 -- common/autotest_common.sh@960 -- # wait 2067042 00:18:09.571 02:29:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:09.571 02:29:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:09.571 02:29:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:09.571 02:29:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:09.571 02:29:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:09.571 02:29:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:09.571 02:29:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:09.571 02:29:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:11.477 02:29:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:11.477 00:18:11.477 real 0m44.768s 00:18:11.477 user 1m16.263s 00:18:11.477 sys 0m8.457s 00:18:11.477 02:29:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:11.477 02:29:36 -- common/autotest_common.sh@10 -- # set +x 00:18:11.477 ************************************ 00:18:11.477 END TEST nvmf_lvs_grow 00:18:11.477 ************************************ 00:18:11.737 02:29:36 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:11.737 02:29:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:11.737 02:29:36 -- common/autotest_common.sh@10 -- # set +x 00:18:11.737 ************************************ 00:18:11.737 START TEST nvmf_bdev_io_wait 00:18:11.737 ************************************ 00:18:11.737 02:29:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:11.737 * Looking for test storage... 00:18:11.737 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:11.737 02:29:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:11.737 02:29:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:11.737 02:29:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:11.737 02:29:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:11.737 02:29:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:11.737 02:29:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:11.737 02:29:36 -- scripts/common.sh@335 -- # IFS=.-: 00:18:11.737 02:29:36 -- scripts/common.sh@335 -- # read -ra ver1 00:18:11.737 02:29:36 -- scripts/common.sh@336 -- # IFS=.-: 00:18:11.737 02:29:36 -- scripts/common.sh@336 -- # read -ra ver2 00:18:11.737 02:29:36 -- scripts/common.sh@337 -- # local 'op=<' 00:18:11.737 02:29:36 -- scripts/common.sh@339 -- # ver1_l=2 00:18:11.737 02:29:36 -- scripts/common.sh@340 -- # ver2_l=1 00:18:11.737 02:29:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:11.737 02:29:36 -- scripts/common.sh@343 -- # case "$op" in 00:18:11.737 02:29:36 -- scripts/common.sh@344 -- # : 1 00:18:11.737 02:29:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:11.737 02:29:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:11.737 02:29:36 -- scripts/common.sh@364 -- # decimal 1 00:18:11.737 02:29:36 -- scripts/common.sh@352 -- # local d=1 00:18:11.737 02:29:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:11.737 02:29:36 -- scripts/common.sh@354 -- # echo 1 00:18:11.737 02:29:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:11.737 02:29:36 -- scripts/common.sh@365 -- # decimal 2 00:18:11.737 02:29:36 -- scripts/common.sh@352 -- # local d=2 00:18:11.737 02:29:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:11.737 02:29:36 -- scripts/common.sh@354 -- # echo 2 00:18:11.737 02:29:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:11.737 02:29:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:11.737 02:29:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:11.737 02:29:36 -- scripts/common.sh@367 -- # return 0 00:18:11.737 02:29:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:11.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.737 --rc genhtml_branch_coverage=1 00:18:11.737 --rc genhtml_function_coverage=1 00:18:11.737 --rc genhtml_legend=1 00:18:11.737 --rc geninfo_all_blocks=1 00:18:11.737 --rc geninfo_unexecuted_blocks=1 00:18:11.737 00:18:11.737 ' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:11.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.737 --rc genhtml_branch_coverage=1 00:18:11.737 --rc genhtml_function_coverage=1 00:18:11.737 --rc genhtml_legend=1 00:18:11.737 --rc geninfo_all_blocks=1 00:18:11.737 --rc geninfo_unexecuted_blocks=1 00:18:11.737 00:18:11.737 ' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:11.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.737 --rc genhtml_branch_coverage=1 00:18:11.737 --rc genhtml_function_coverage=1 00:18:11.737 --rc genhtml_legend=1 00:18:11.737 --rc geninfo_all_blocks=1 00:18:11.737 --rc geninfo_unexecuted_blocks=1 00:18:11.737 00:18:11.737 ' 00:18:11.737 02:29:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:11.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.737 --rc genhtml_branch_coverage=1 00:18:11.737 --rc genhtml_function_coverage=1 00:18:11.737 --rc genhtml_legend=1 00:18:11.737 --rc geninfo_all_blocks=1 00:18:11.737 --rc geninfo_unexecuted_blocks=1 00:18:11.737 00:18:11.737 ' 00:18:11.737 02:29:36 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:11.737 02:29:36 -- nvmf/common.sh@7 -- # uname -s 00:18:11.737 02:29:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:11.737 02:29:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:11.737 02:29:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:11.737 02:29:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:11.737 02:29:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:11.737 02:29:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:11.737 02:29:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:11.737 02:29:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:11.737 02:29:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:11.737 02:29:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:11.737 02:29:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:11.737 02:29:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:11.737 02:29:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:11.737 02:29:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:11.737 02:29:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:11.737 02:29:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:11.737 02:29:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:11.737 02:29:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:11.737 02:29:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:11.737 02:29:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.737 02:29:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.737 02:29:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.737 02:29:36 -- paths/export.sh@5 -- # export PATH 00:18:11.737 02:29:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.737 02:29:36 -- nvmf/common.sh@46 -- # : 0 00:18:11.737 02:29:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:11.737 02:29:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:11.737 02:29:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:11.737 02:29:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:11.737 02:29:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:11.737 02:29:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:11.737 02:29:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:11.737 02:29:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:11.737 02:29:36 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:11.737 02:29:36 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:11.737 02:29:36 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:11.737 02:29:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:11.738 02:29:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:11.738 02:29:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:11.738 02:29:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:11.738 02:29:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:11.738 02:29:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.738 02:29:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:11.738 02:29:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:11.738 02:29:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:11.738 02:29:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:11.738 02:29:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:11.738 02:29:36 -- common/autotest_common.sh@10 -- # set +x 00:18:14.299 02:29:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:14.299 02:29:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:14.299 02:29:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:14.299 02:29:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:14.299 02:29:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:14.299 02:29:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:14.299 02:29:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:14.299 02:29:38 -- nvmf/common.sh@294 -- # net_devs=() 00:18:14.299 02:29:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:14.299 02:29:38 -- nvmf/common.sh@295 -- # e810=() 00:18:14.299 02:29:38 -- nvmf/common.sh@295 -- # local -ga e810 00:18:14.299 02:29:38 -- nvmf/common.sh@296 -- # x722=() 00:18:14.299 02:29:38 -- nvmf/common.sh@296 -- # local -ga x722 00:18:14.299 02:29:38 -- nvmf/common.sh@297 -- # mlx=() 00:18:14.299 02:29:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:14.299 02:29:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:14.299 02:29:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:14.299 02:29:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:14.299 02:29:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:14.299 02:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:14.299 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:14.299 02:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:14.299 02:29:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:14.299 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:14.299 02:29:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:14.299 02:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.299 02:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.299 02:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:14.299 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:14.299 02:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.299 02:29:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:14.299 02:29:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.299 02:29:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.299 02:29:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:14.299 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:14.299 02:29:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.299 02:29:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:14.299 02:29:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:14.299 02:29:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:14.299 02:29:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:14.299 02:29:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:14.299 02:29:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:14.299 02:29:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:14.299 02:29:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:14.299 02:29:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:14.299 02:29:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:14.299 02:29:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:14.299 02:29:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:14.299 02:29:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:14.299 02:29:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:14.299 02:29:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:14.299 02:29:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:14.299 02:29:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:14.299 02:29:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:14.299 02:29:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:14.299 02:29:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:14.299 02:29:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:14.300 02:29:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:14.300 02:29:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:14.300 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:14.300 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.341 ms 00:18:14.300 00:18:14.300 --- 10.0.0.2 ping statistics --- 00:18:14.300 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:14.300 rtt min/avg/max/mdev = 0.341/0.341/0.341/0.000 ms 00:18:14.300 02:29:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:14.300 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:14.300 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:18:14.300 00:18:14.300 --- 10.0.0.1 ping statistics --- 00:18:14.300 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:14.300 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:18:14.300 02:29:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:14.300 02:29:38 -- nvmf/common.sh@410 -- # return 0 00:18:14.300 02:29:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:14.300 02:29:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:14.300 02:29:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:14.300 02:29:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:14.300 02:29:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:14.300 02:29:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:14.300 02:29:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:14.300 02:29:38 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:14.300 02:29:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:14.300 02:29:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 02:29:38 -- nvmf/common.sh@469 -- # nvmfpid=2069722 00:18:14.300 02:29:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:14.300 02:29:38 -- nvmf/common.sh@470 -- # waitforlisten 2069722 00:18:14.300 02:29:38 -- common/autotest_common.sh@829 -- # '[' -z 2069722 ']' 00:18:14.300 02:29:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:14.300 02:29:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.300 02:29:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:14.300 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:14.300 02:29:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 [2024-11-27 02:29:38.538698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:14.300 [2024-11-27 02:29:38.538795] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:14.300 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.300 [2024-11-27 02:29:38.612007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:14.300 [2024-11-27 02:29:38.710839] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:14.300 [2024-11-27 02:29:38.710990] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:14.300 [2024-11-27 02:29:38.711008] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:14.300 [2024-11-27 02:29:38.711021] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:14.300 [2024-11-27 02:29:38.711087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:14.300 [2024-11-27 02:29:38.711190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:14.300 [2024-11-27 02:29:38.711215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:14.300 [2024-11-27 02:29:38.711218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:14.300 02:29:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:14.300 02:29:38 -- common/autotest_common.sh@862 -- # return 0 00:18:14.300 02:29:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:14.300 02:29:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 02:29:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:14.300 02:29:38 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:14.300 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.300 02:29:38 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:14.300 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.300 02:29:38 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:14.300 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.300 [2024-11-27 02:29:38.885052] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:14.300 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.300 02:29:38 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:14.300 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.300 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.559 Malloc0 00:18:14.559 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:14.559 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.559 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.559 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:14.559 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.559 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.559 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:14.559 02:29:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.559 02:29:38 -- common/autotest_common.sh@10 -- # set +x 00:18:14.559 [2024-11-27 02:29:38.957213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:14.559 02:29:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2069761 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@30 -- # READ_PID=2069763 00:18:14.559 02:29:38 -- nvmf/common.sh@520 -- # config=() 00:18:14.559 02:29:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:14.559 02:29:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:14.559 02:29:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:14.559 { 00:18:14.559 "params": { 00:18:14.559 "name": "Nvme$subsystem", 00:18:14.559 "trtype": "$TEST_TRANSPORT", 00:18:14.559 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.559 "adrfam": "ipv4", 00:18:14.559 "trsvcid": "$NVMF_PORT", 00:18:14.559 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.559 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.559 "hdgst": ${hdgst:-false}, 00:18:14.559 "ddgst": ${ddgst:-false} 00:18:14.559 }, 00:18:14.559 "method": "bdev_nvme_attach_controller" 00:18:14.559 } 00:18:14.559 EOF 00:18:14.559 )") 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2069765 00:18:14.559 02:29:38 -- nvmf/common.sh@520 -- # config=() 00:18:14.559 02:29:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:14.559 02:29:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:14.559 02:29:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:14.559 { 00:18:14.559 "params": { 00:18:14.559 "name": "Nvme$subsystem", 00:18:14.559 "trtype": "$TEST_TRANSPORT", 00:18:14.559 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.559 "adrfam": "ipv4", 00:18:14.559 "trsvcid": "$NVMF_PORT", 00:18:14.559 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.559 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.559 "hdgst": ${hdgst:-false}, 00:18:14.559 "ddgst": ${ddgst:-false} 00:18:14.559 }, 00:18:14.559 "method": "bdev_nvme_attach_controller" 00:18:14.559 } 00:18:14.559 EOF 00:18:14.559 )") 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:14.559 02:29:38 -- nvmf/common.sh@542 -- # cat 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2069768 00:18:14.559 02:29:38 -- target/bdev_io_wait.sh@35 -- # sync 00:18:14.559 02:29:38 -- nvmf/common.sh@520 -- # config=() 00:18:14.560 02:29:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:14.560 02:29:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:14.560 02:29:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:14.560 { 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme$subsystem", 00:18:14.560 "trtype": "$TEST_TRANSPORT", 00:18:14.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "$NVMF_PORT", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.560 "hdgst": ${hdgst:-false}, 00:18:14.560 "ddgst": ${ddgst:-false} 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 } 00:18:14.560 EOF 00:18:14.560 )") 00:18:14.560 02:29:38 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:14.560 02:29:38 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:14.560 02:29:38 -- nvmf/common.sh@542 -- # cat 00:18:14.560 02:29:38 -- nvmf/common.sh@520 -- # config=() 00:18:14.560 02:29:38 -- nvmf/common.sh@520 -- # local subsystem config 00:18:14.560 02:29:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:14.560 02:29:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:14.560 { 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme$subsystem", 00:18:14.560 "trtype": "$TEST_TRANSPORT", 00:18:14.560 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "$NVMF_PORT", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.560 "hdgst": ${hdgst:-false}, 00:18:14.560 "ddgst": ${ddgst:-false} 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 } 00:18:14.560 EOF 00:18:14.560 )") 00:18:14.560 02:29:38 -- nvmf/common.sh@542 -- # cat 00:18:14.560 02:29:38 -- target/bdev_io_wait.sh@37 -- # wait 2069761 00:18:14.560 02:29:38 -- nvmf/common.sh@542 -- # cat 00:18:14.560 02:29:38 -- nvmf/common.sh@544 -- # jq . 00:18:14.560 02:29:38 -- nvmf/common.sh@544 -- # jq . 00:18:14.560 02:29:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:14.560 02:29:38 -- nvmf/common.sh@544 -- # jq . 00:18:14.560 02:29:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme1", 00:18:14.560 "trtype": "tcp", 00:18:14.560 "traddr": "10.0.0.2", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "4420", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.560 "hdgst": false, 00:18:14.560 "ddgst": false 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 }' 00:18:14.560 02:29:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:14.560 02:29:38 -- nvmf/common.sh@544 -- # jq . 00:18:14.560 02:29:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme1", 00:18:14.560 "trtype": "tcp", 00:18:14.560 "traddr": "10.0.0.2", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "4420", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.560 "hdgst": false, 00:18:14.560 "ddgst": false 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 }' 00:18:14.560 02:29:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:14.560 02:29:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme1", 00:18:14.560 "trtype": "tcp", 00:18:14.560 "traddr": "10.0.0.2", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "4420", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.560 "hdgst": false, 00:18:14.560 "ddgst": false 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 }' 00:18:14.560 02:29:38 -- nvmf/common.sh@545 -- # IFS=, 00:18:14.560 02:29:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:14.560 "params": { 00:18:14.560 "name": "Nvme1", 00:18:14.560 "trtype": "tcp", 00:18:14.560 "traddr": "10.0.0.2", 00:18:14.560 "adrfam": "ipv4", 00:18:14.560 "trsvcid": "4420", 00:18:14.560 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.560 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.560 "hdgst": false, 00:18:14.560 "ddgst": false 00:18:14.560 }, 00:18:14.560 "method": "bdev_nvme_attach_controller" 00:18:14.560 }' 00:18:14.560 [2024-11-27 02:29:39.001428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:14.560 [2024-11-27 02:29:39.001425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:14.560 [2024-11-27 02:29:39.001514] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 02:29:39.001514] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:14.560 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:14.560 [2024-11-27 02:29:39.001843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:14.560 [2024-11-27 02:29:39.001843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:14.560 [2024-11-27 02:29:39.001915] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 02:29:39.001915] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:14.560 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:14.560 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.560 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.560 [2024-11-27 02:29:39.178722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.817 [2024-11-27 02:29:39.255008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:14.817 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.817 [2024-11-27 02:29:39.285833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.817 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.817 [2024-11-27 02:29:39.355917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.817 [2024-11-27 02:29:39.357383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:14.817 [2024-11-27 02:29:39.421276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:14.817 [2024-11-27 02:29:39.421638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.076 [2024-11-27 02:29:39.488916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:15.076 Running I/O for 1 seconds... 00:18:15.076 Running I/O for 1 seconds... 00:18:15.076 Running I/O for 1 seconds... 00:18:15.335 Running I/O for 1 seconds... 00:18:16.273 00:18:16.273 Latency(us) 00:18:16.273 [2024-11-27T01:29:40.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.273 [2024-11-27T01:29:40.908Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:16.273 Nvme1n1 : 1.02 6633.09 25.91 0.00 0.00 19164.04 8641.04 27185.30 00:18:16.273 [2024-11-27T01:29:40.908Z] =================================================================================================================== 00:18:16.273 [2024-11-27T01:29:40.908Z] Total : 6633.09 25.91 0.00 0.00 19164.04 8641.04 27185.30 00:18:16.273 00:18:16.273 Latency(us) 00:18:16.273 [2024-11-27T01:29:40.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.273 [2024-11-27T01:29:40.908Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:16.273 Nvme1n1 : 1.00 170131.43 664.58 0.00 0.00 749.52 294.31 1031.59 00:18:16.273 [2024-11-27T01:29:40.908Z] =================================================================================================================== 00:18:16.273 [2024-11-27T01:29:40.908Z] Total : 170131.43 664.58 0.00 0.00 749.52 294.31 1031.59 00:18:16.273 00:18:16.273 Latency(us) 00:18:16.273 [2024-11-27T01:29:40.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.273 [2024-11-27T01:29:40.908Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:16.273 Nvme1n1 : 1.01 6448.28 25.19 0.00 0.00 19780.23 6553.60 40389.59 00:18:16.273 [2024-11-27T01:29:40.908Z] =================================================================================================================== 00:18:16.273 [2024-11-27T01:29:40.908Z] Total : 6448.28 25.19 0.00 0.00 19780.23 6553.60 40389.59 00:18:16.273 00:18:16.273 Latency(us) 00:18:16.273 [2024-11-27T01:29:40.908Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.273 [2024-11-27T01:29:40.908Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:16.273 Nvme1n1 : 1.01 10158.47 39.68 0.00 0.00 12554.72 6213.78 24660.95 00:18:16.273 [2024-11-27T01:29:40.908Z] =================================================================================================================== 00:18:16.273 [2024-11-27T01:29:40.908Z] Total : 10158.47 39.68 0.00 0.00 12554.72 6213.78 24660.95 00:18:16.534 02:29:40 -- target/bdev_io_wait.sh@38 -- # wait 2069763 00:18:16.534 02:29:40 -- target/bdev_io_wait.sh@39 -- # wait 2069765 00:18:16.534 02:29:40 -- target/bdev_io_wait.sh@40 -- # wait 2069768 00:18:16.534 02:29:41 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:16.534 02:29:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:16.534 02:29:41 -- common/autotest_common.sh@10 -- # set +x 00:18:16.534 02:29:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:16.534 02:29:41 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:16.534 02:29:41 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:16.534 02:29:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:16.534 02:29:41 -- nvmf/common.sh@116 -- # sync 00:18:16.534 02:29:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:16.534 02:29:41 -- nvmf/common.sh@119 -- # set +e 00:18:16.534 02:29:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:16.534 02:29:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:16.534 rmmod nvme_tcp 00:18:16.534 rmmod nvme_fabrics 00:18:16.534 rmmod nvme_keyring 00:18:16.534 02:29:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:16.534 02:29:41 -- nvmf/common.sh@123 -- # set -e 00:18:16.534 02:29:41 -- nvmf/common.sh@124 -- # return 0 00:18:16.534 02:29:41 -- nvmf/common.sh@477 -- # '[' -n 2069722 ']' 00:18:16.534 02:29:41 -- nvmf/common.sh@478 -- # killprocess 2069722 00:18:16.534 02:29:41 -- common/autotest_common.sh@936 -- # '[' -z 2069722 ']' 00:18:16.534 02:29:41 -- common/autotest_common.sh@940 -- # kill -0 2069722 00:18:16.534 02:29:41 -- common/autotest_common.sh@941 -- # uname 00:18:16.534 02:29:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.534 02:29:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2069722 00:18:16.534 02:29:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:16.534 02:29:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:16.534 02:29:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2069722' 00:18:16.534 killing process with pid 2069722 00:18:16.534 02:29:41 -- common/autotest_common.sh@955 -- # kill 2069722 00:18:16.534 02:29:41 -- common/autotest_common.sh@960 -- # wait 2069722 00:18:16.794 02:29:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:16.794 02:29:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:16.794 02:29:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:16.794 02:29:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:16.794 02:29:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:16.794 02:29:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.794 02:29:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.794 02:29:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:19.334 02:29:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:19.334 00:18:19.334 real 0m7.275s 00:18:19.334 user 0m16.043s 00:18:19.334 sys 0m3.656s 00:18:19.334 02:29:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:19.334 02:29:43 -- common/autotest_common.sh@10 -- # set +x 00:18:19.334 ************************************ 00:18:19.334 END TEST nvmf_bdev_io_wait 00:18:19.334 ************************************ 00:18:19.334 02:29:43 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:19.334 02:29:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:19.334 02:29:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:19.334 02:29:43 -- common/autotest_common.sh@10 -- # set +x 00:18:19.334 ************************************ 00:18:19.334 START TEST nvmf_queue_depth 00:18:19.334 ************************************ 00:18:19.334 02:29:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:19.334 * Looking for test storage... 00:18:19.334 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:19.334 02:29:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:19.334 02:29:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:19.334 02:29:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:19.334 02:29:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:19.334 02:29:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:19.334 02:29:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:19.334 02:29:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:19.334 02:29:43 -- scripts/common.sh@335 -- # IFS=.-: 00:18:19.334 02:29:43 -- scripts/common.sh@335 -- # read -ra ver1 00:18:19.334 02:29:43 -- scripts/common.sh@336 -- # IFS=.-: 00:18:19.334 02:29:43 -- scripts/common.sh@336 -- # read -ra ver2 00:18:19.334 02:29:43 -- scripts/common.sh@337 -- # local 'op=<' 00:18:19.334 02:29:43 -- scripts/common.sh@339 -- # ver1_l=2 00:18:19.334 02:29:43 -- scripts/common.sh@340 -- # ver2_l=1 00:18:19.334 02:29:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:19.334 02:29:43 -- scripts/common.sh@343 -- # case "$op" in 00:18:19.334 02:29:43 -- scripts/common.sh@344 -- # : 1 00:18:19.334 02:29:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:19.334 02:29:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:19.334 02:29:43 -- scripts/common.sh@364 -- # decimal 1 00:18:19.334 02:29:43 -- scripts/common.sh@352 -- # local d=1 00:18:19.334 02:29:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:19.334 02:29:43 -- scripts/common.sh@354 -- # echo 1 00:18:19.334 02:29:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:19.334 02:29:43 -- scripts/common.sh@365 -- # decimal 2 00:18:19.334 02:29:43 -- scripts/common.sh@352 -- # local d=2 00:18:19.334 02:29:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:19.334 02:29:43 -- scripts/common.sh@354 -- # echo 2 00:18:19.334 02:29:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:19.334 02:29:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:19.334 02:29:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:19.334 02:29:43 -- scripts/common.sh@367 -- # return 0 00:18:19.334 02:29:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:19.334 02:29:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:19.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.335 --rc genhtml_branch_coverage=1 00:18:19.335 --rc genhtml_function_coverage=1 00:18:19.335 --rc genhtml_legend=1 00:18:19.335 --rc geninfo_all_blocks=1 00:18:19.335 --rc geninfo_unexecuted_blocks=1 00:18:19.335 00:18:19.335 ' 00:18:19.335 02:29:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:19.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.335 --rc genhtml_branch_coverage=1 00:18:19.335 --rc genhtml_function_coverage=1 00:18:19.335 --rc genhtml_legend=1 00:18:19.335 --rc geninfo_all_blocks=1 00:18:19.335 --rc geninfo_unexecuted_blocks=1 00:18:19.335 00:18:19.335 ' 00:18:19.335 02:29:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:19.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.335 --rc genhtml_branch_coverage=1 00:18:19.335 --rc genhtml_function_coverage=1 00:18:19.335 --rc genhtml_legend=1 00:18:19.335 --rc geninfo_all_blocks=1 00:18:19.335 --rc geninfo_unexecuted_blocks=1 00:18:19.335 00:18:19.335 ' 00:18:19.335 02:29:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:19.335 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.335 --rc genhtml_branch_coverage=1 00:18:19.335 --rc genhtml_function_coverage=1 00:18:19.335 --rc genhtml_legend=1 00:18:19.335 --rc geninfo_all_blocks=1 00:18:19.335 --rc geninfo_unexecuted_blocks=1 00:18:19.335 00:18:19.335 ' 00:18:19.335 02:29:43 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:19.335 02:29:43 -- nvmf/common.sh@7 -- # uname -s 00:18:19.335 02:29:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:19.335 02:29:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:19.335 02:29:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:19.335 02:29:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:19.335 02:29:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:19.335 02:29:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:19.335 02:29:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:19.335 02:29:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:19.335 02:29:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:19.335 02:29:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:19.335 02:29:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:19.335 02:29:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:19.335 02:29:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:19.335 02:29:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:19.335 02:29:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:19.335 02:29:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:19.335 02:29:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:19.335 02:29:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:19.335 02:29:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:19.335 02:29:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.335 02:29:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.335 02:29:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.335 02:29:43 -- paths/export.sh@5 -- # export PATH 00:18:19.335 02:29:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.335 02:29:43 -- nvmf/common.sh@46 -- # : 0 00:18:19.335 02:29:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:19.335 02:29:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:19.335 02:29:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:19.335 02:29:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:19.335 02:29:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:19.335 02:29:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:19.335 02:29:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:19.335 02:29:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:19.335 02:29:43 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:19.335 02:29:43 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:19.335 02:29:43 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:19.335 02:29:43 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:19.335 02:29:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:19.335 02:29:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:19.335 02:29:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:19.335 02:29:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:19.335 02:29:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:19.335 02:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:19.335 02:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:19.335 02:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:19.335 02:29:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:19.335 02:29:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:19.335 02:29:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:19.335 02:29:43 -- common/autotest_common.sh@10 -- # set +x 00:18:21.241 02:29:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:21.241 02:29:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:21.241 02:29:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:21.241 02:29:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:21.241 02:29:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:21.241 02:29:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:21.241 02:29:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:21.241 02:29:45 -- nvmf/common.sh@294 -- # net_devs=() 00:18:21.241 02:29:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:21.241 02:29:45 -- nvmf/common.sh@295 -- # e810=() 00:18:21.241 02:29:45 -- nvmf/common.sh@295 -- # local -ga e810 00:18:21.241 02:29:45 -- nvmf/common.sh@296 -- # x722=() 00:18:21.241 02:29:45 -- nvmf/common.sh@296 -- # local -ga x722 00:18:21.241 02:29:45 -- nvmf/common.sh@297 -- # mlx=() 00:18:21.241 02:29:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:21.241 02:29:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:21.241 02:29:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:21.241 02:29:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:21.241 02:29:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:21.241 02:29:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:21.241 02:29:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:21.241 02:29:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:21.241 02:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.241 02:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:21.241 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:21.241 02:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.241 02:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.241 02:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.242 02:29:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:21.242 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:21.242 02:29:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:21.242 02:29:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.242 02:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.242 02:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.242 02:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.242 02:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:21.242 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:21.242 02:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.242 02:29:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.242 02:29:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.242 02:29:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.242 02:29:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.242 02:29:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:21.242 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:21.242 02:29:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.242 02:29:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:21.242 02:29:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:21.242 02:29:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:21.242 02:29:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:21.242 02:29:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:21.242 02:29:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:21.242 02:29:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:21.242 02:29:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:21.242 02:29:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:21.242 02:29:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:21.242 02:29:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:21.242 02:29:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:21.242 02:29:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:21.242 02:29:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:21.242 02:29:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:21.242 02:29:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:21.242 02:29:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:21.242 02:29:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:21.242 02:29:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:21.242 02:29:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:21.242 02:29:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:21.242 02:29:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:21.242 02:29:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:21.242 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:21.242 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.426 ms 00:18:21.242 00:18:21.242 --- 10.0.0.2 ping statistics --- 00:18:21.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.242 rtt min/avg/max/mdev = 0.426/0.426/0.426/0.000 ms 00:18:21.242 02:29:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:21.242 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:21.242 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:18:21.242 00:18:21.242 --- 10.0.0.1 ping statistics --- 00:18:21.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.242 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:18:21.242 02:29:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:21.242 02:29:45 -- nvmf/common.sh@410 -- # return 0 00:18:21.242 02:29:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:21.242 02:29:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:21.242 02:29:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:21.242 02:29:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:21.242 02:29:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:21.242 02:29:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:21.242 02:29:45 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:21.242 02:29:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.242 02:29:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.242 02:29:45 -- common/autotest_common.sh@10 -- # set +x 00:18:21.242 02:29:45 -- nvmf/common.sh@469 -- # nvmfpid=2072011 00:18:21.242 02:29:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:21.242 02:29:45 -- nvmf/common.sh@470 -- # waitforlisten 2072011 00:18:21.242 02:29:45 -- common/autotest_common.sh@829 -- # '[' -z 2072011 ']' 00:18:21.242 02:29:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.242 02:29:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.242 02:29:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.242 02:29:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.242 02:29:45 -- common/autotest_common.sh@10 -- # set +x 00:18:21.501 [2024-11-27 02:29:45.884635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:21.501 [2024-11-27 02:29:45.884729] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:21.501 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.501 [2024-11-27 02:29:45.956461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.501 [2024-11-27 02:29:46.046396] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:21.501 [2024-11-27 02:29:46.046567] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:21.501 [2024-11-27 02:29:46.046603] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:21.501 [2024-11-27 02:29:46.046615] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:21.501 [2024-11-27 02:29:46.046646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:22.438 02:29:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.438 02:29:46 -- common/autotest_common.sh@862 -- # return 0 00:18:22.438 02:29:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:22.438 02:29:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 02:29:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:22.438 02:29:46 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:22.438 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 [2024-11-27 02:29:46.901734] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:22.438 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.438 02:29:46 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:22.438 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 Malloc0 00:18:22.438 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.438 02:29:46 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:22.438 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.438 02:29:46 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:22.438 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.438 02:29:46 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:22.438 02:29:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 [2024-11-27 02:29:46.960338] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:22.438 02:29:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.438 02:29:46 -- target/queue_depth.sh@30 -- # bdevperf_pid=2072166 00:18:22.438 02:29:46 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:22.438 02:29:46 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:22.438 02:29:46 -- target/queue_depth.sh@33 -- # waitforlisten 2072166 /var/tmp/bdevperf.sock 00:18:22.438 02:29:46 -- common/autotest_common.sh@829 -- # '[' -z 2072166 ']' 00:18:22.438 02:29:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:22.438 02:29:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:22.438 02:29:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:22.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:22.438 02:29:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:22.438 02:29:46 -- common/autotest_common.sh@10 -- # set +x 00:18:22.438 [2024-11-27 02:29:47.002670] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:22.438 [2024-11-27 02:29:47.002730] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2072166 ] 00:18:22.438 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.438 [2024-11-27 02:29:47.065134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.699 [2024-11-27 02:29:47.154579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:23.635 02:29:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.635 02:29:47 -- common/autotest_common.sh@862 -- # return 0 00:18:23.635 02:29:47 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:23.635 02:29:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.635 02:29:47 -- common/autotest_common.sh@10 -- # set +x 00:18:23.635 NVMe0n1 00:18:23.635 02:29:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.635 02:29:48 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:23.893 Running I/O for 10 seconds... 00:18:33.875 00:18:33.875 Latency(us) 00:18:33.875 [2024-11-27T01:29:58.510Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.875 [2024-11-27T01:29:58.510Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:33.875 Verification LBA range: start 0x0 length 0x4000 00:18:33.875 NVMe0n1 : 10.08 11541.59 45.08 0.00 0.00 88347.24 16117.00 69516.71 00:18:33.875 [2024-11-27T01:29:58.510Z] =================================================================================================================== 00:18:33.875 [2024-11-27T01:29:58.510Z] Total : 11541.59 45.08 0.00 0.00 88347.24 16117.00 69516.71 00:18:33.875 0 00:18:33.875 02:29:58 -- target/queue_depth.sh@39 -- # killprocess 2072166 00:18:33.875 02:29:58 -- common/autotest_common.sh@936 -- # '[' -z 2072166 ']' 00:18:33.875 02:29:58 -- common/autotest_common.sh@940 -- # kill -0 2072166 00:18:33.875 02:29:58 -- common/autotest_common.sh@941 -- # uname 00:18:33.875 02:29:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:33.875 02:29:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2072166 00:18:33.875 02:29:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:33.875 02:29:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:33.875 02:29:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2072166' 00:18:33.875 killing process with pid 2072166 00:18:33.875 02:29:58 -- common/autotest_common.sh@955 -- # kill 2072166 00:18:33.875 Received shutdown signal, test time was about 10.000000 seconds 00:18:33.875 00:18:33.875 Latency(us) 00:18:33.875 [2024-11-27T01:29:58.510Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.875 [2024-11-27T01:29:58.510Z] =================================================================================================================== 00:18:33.875 [2024-11-27T01:29:58.510Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:33.875 02:29:58 -- common/autotest_common.sh@960 -- # wait 2072166 00:18:34.134 02:29:58 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:34.134 02:29:58 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:34.134 02:29:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:34.134 02:29:58 -- nvmf/common.sh@116 -- # sync 00:18:34.134 02:29:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:34.134 02:29:58 -- nvmf/common.sh@119 -- # set +e 00:18:34.134 02:29:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:34.135 02:29:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:34.135 rmmod nvme_tcp 00:18:34.135 rmmod nvme_fabrics 00:18:34.135 rmmod nvme_keyring 00:18:34.135 02:29:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:34.135 02:29:58 -- nvmf/common.sh@123 -- # set -e 00:18:34.135 02:29:58 -- nvmf/common.sh@124 -- # return 0 00:18:34.135 02:29:58 -- nvmf/common.sh@477 -- # '[' -n 2072011 ']' 00:18:34.135 02:29:58 -- nvmf/common.sh@478 -- # killprocess 2072011 00:18:34.135 02:29:58 -- common/autotest_common.sh@936 -- # '[' -z 2072011 ']' 00:18:34.135 02:29:58 -- common/autotest_common.sh@940 -- # kill -0 2072011 00:18:34.135 02:29:58 -- common/autotest_common.sh@941 -- # uname 00:18:34.135 02:29:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:34.135 02:29:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2072011 00:18:34.394 02:29:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:34.394 02:29:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:34.394 02:29:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2072011' 00:18:34.394 killing process with pid 2072011 00:18:34.394 02:29:58 -- common/autotest_common.sh@955 -- # kill 2072011 00:18:34.394 02:29:58 -- common/autotest_common.sh@960 -- # wait 2072011 00:18:34.394 02:29:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:34.394 02:29:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:34.394 02:29:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:34.394 02:29:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:34.394 02:29:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:34.394 02:29:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.394 02:29:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:34.394 02:29:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.929 02:30:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:36.929 00:18:36.929 real 0m17.637s 00:18:36.929 user 0m23.071s 00:18:36.929 sys 0m4.181s 00:18:36.929 02:30:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:36.929 02:30:01 -- common/autotest_common.sh@10 -- # set +x 00:18:36.929 ************************************ 00:18:36.929 END TEST nvmf_queue_depth 00:18:36.929 ************************************ 00:18:36.929 02:30:01 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:36.929 02:30:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:36.929 02:30:01 -- common/autotest_common.sh@10 -- # set +x 00:18:36.929 ************************************ 00:18:36.929 START TEST nvmf_multipath 00:18:36.929 ************************************ 00:18:36.929 02:30:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:36.929 * Looking for test storage... 00:18:36.929 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:36.929 02:30:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:36.929 02:30:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:36.929 02:30:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:36.929 02:30:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:36.929 02:30:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.929 02:30:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.929 02:30:01 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.929 02:30:01 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.929 02:30:01 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.929 02:30:01 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.929 02:30:01 -- scripts/common.sh@337 -- # local 'op=<' 00:18:36.929 02:30:01 -- scripts/common.sh@339 -- # ver1_l=2 00:18:36.929 02:30:01 -- scripts/common.sh@340 -- # ver2_l=1 00:18:36.929 02:30:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.929 02:30:01 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.929 02:30:01 -- scripts/common.sh@344 -- # : 1 00:18:36.929 02:30:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.929 02:30:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.929 02:30:01 -- scripts/common.sh@364 -- # decimal 1 00:18:36.929 02:30:01 -- scripts/common.sh@352 -- # local d=1 00:18:36.929 02:30:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.929 02:30:01 -- scripts/common.sh@354 -- # echo 1 00:18:36.929 02:30:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.929 02:30:01 -- scripts/common.sh@365 -- # decimal 2 00:18:36.929 02:30:01 -- scripts/common.sh@352 -- # local d=2 00:18:36.929 02:30:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:36.929 02:30:01 -- scripts/common.sh@354 -- # echo 2 00:18:36.929 02:30:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:36.929 02:30:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.929 02:30:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.929 02:30:01 -- scripts/common.sh@367 -- # return 0 00:18:36.929 02:30:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:36.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.929 --rc genhtml_branch_coverage=1 00:18:36.929 --rc genhtml_function_coverage=1 00:18:36.929 --rc genhtml_legend=1 00:18:36.929 --rc geninfo_all_blocks=1 00:18:36.929 --rc geninfo_unexecuted_blocks=1 00:18:36.929 00:18:36.929 ' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:36.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.929 --rc genhtml_branch_coverage=1 00:18:36.929 --rc genhtml_function_coverage=1 00:18:36.929 --rc genhtml_legend=1 00:18:36.929 --rc geninfo_all_blocks=1 00:18:36.929 --rc geninfo_unexecuted_blocks=1 00:18:36.929 00:18:36.929 ' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:36.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.929 --rc genhtml_branch_coverage=1 00:18:36.929 --rc genhtml_function_coverage=1 00:18:36.929 --rc genhtml_legend=1 00:18:36.929 --rc geninfo_all_blocks=1 00:18:36.929 --rc geninfo_unexecuted_blocks=1 00:18:36.929 00:18:36.929 ' 00:18:36.929 02:30:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:36.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.929 --rc genhtml_branch_coverage=1 00:18:36.929 --rc genhtml_function_coverage=1 00:18:36.929 --rc genhtml_legend=1 00:18:36.929 --rc geninfo_all_blocks=1 00:18:36.929 --rc geninfo_unexecuted_blocks=1 00:18:36.929 00:18:36.929 ' 00:18:36.929 02:30:01 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:36.929 02:30:01 -- nvmf/common.sh@7 -- # uname -s 00:18:36.929 02:30:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:36.929 02:30:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:36.929 02:30:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:36.929 02:30:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:36.929 02:30:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:36.929 02:30:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:36.929 02:30:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:36.929 02:30:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:36.929 02:30:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:36.929 02:30:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:36.929 02:30:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.929 02:30:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.929 02:30:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:36.929 02:30:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:36.929 02:30:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:36.929 02:30:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:36.929 02:30:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:36.929 02:30:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:36.929 02:30:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:36.930 02:30:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.930 02:30:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.930 02:30:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.930 02:30:01 -- paths/export.sh@5 -- # export PATH 00:18:36.930 02:30:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.930 02:30:01 -- nvmf/common.sh@46 -- # : 0 00:18:36.930 02:30:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:36.930 02:30:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:36.930 02:30:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:36.930 02:30:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:36.930 02:30:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:36.930 02:30:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:36.930 02:30:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:36.930 02:30:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:36.930 02:30:01 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:36.930 02:30:01 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:36.930 02:30:01 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:36.930 02:30:01 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:36.930 02:30:01 -- target/multipath.sh@43 -- # nvmftestinit 00:18:36.930 02:30:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:36.930 02:30:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:36.930 02:30:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:36.930 02:30:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:36.930 02:30:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:36.930 02:30:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:36.930 02:30:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:36.930 02:30:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.930 02:30:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:36.930 02:30:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:36.930 02:30:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:36.930 02:30:01 -- common/autotest_common.sh@10 -- # set +x 00:18:38.835 02:30:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:38.835 02:30:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:38.835 02:30:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:38.835 02:30:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:38.835 02:30:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:38.835 02:30:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:38.835 02:30:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:38.835 02:30:03 -- nvmf/common.sh@294 -- # net_devs=() 00:18:38.835 02:30:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:38.835 02:30:03 -- nvmf/common.sh@295 -- # e810=() 00:18:38.835 02:30:03 -- nvmf/common.sh@295 -- # local -ga e810 00:18:38.835 02:30:03 -- nvmf/common.sh@296 -- # x722=() 00:18:38.835 02:30:03 -- nvmf/common.sh@296 -- # local -ga x722 00:18:38.835 02:30:03 -- nvmf/common.sh@297 -- # mlx=() 00:18:38.835 02:30:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:38.835 02:30:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:38.835 02:30:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:38.836 02:30:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:38.836 02:30:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.836 02:30:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:38.836 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:38.836 02:30:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.836 02:30:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:38.836 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:38.836 02:30:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.836 02:30:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.836 02:30:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.836 02:30:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:38.836 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:38.836 02:30:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.836 02:30:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.836 02:30:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.836 02:30:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:38.836 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:38.836 02:30:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:38.836 02:30:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:38.836 02:30:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:38.836 02:30:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:38.836 02:30:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:38.836 02:30:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:38.836 02:30:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:38.836 02:30:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:38.836 02:30:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:38.836 02:30:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:38.836 02:30:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:38.836 02:30:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:38.836 02:30:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:38.836 02:30:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:38.836 02:30:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:38.836 02:30:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:38.836 02:30:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:38.836 02:30:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:38.836 02:30:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:38.836 02:30:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:38.836 02:30:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:38.836 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:38.836 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.388 ms 00:18:38.836 00:18:38.836 --- 10.0.0.2 ping statistics --- 00:18:38.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.836 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:18:38.836 02:30:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:38.836 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:38.836 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:18:38.836 00:18:38.836 --- 10.0.0.1 ping statistics --- 00:18:38.836 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.836 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:18:38.836 02:30:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:38.836 02:30:03 -- nvmf/common.sh@410 -- # return 0 00:18:38.836 02:30:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:38.836 02:30:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:38.836 02:30:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:38.836 02:30:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:38.836 02:30:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:38.836 02:30:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:39.094 02:30:03 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:39.094 02:30:03 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:39.094 only one NIC for nvmf test 00:18:39.094 02:30:03 -- target/multipath.sh@47 -- # nvmftestfini 00:18:39.094 02:30:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:39.094 02:30:03 -- nvmf/common.sh@116 -- # sync 00:18:39.094 02:30:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:39.094 02:30:03 -- nvmf/common.sh@119 -- # set +e 00:18:39.094 02:30:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:39.094 02:30:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:39.094 rmmod nvme_tcp 00:18:39.094 rmmod nvme_fabrics 00:18:39.094 rmmod nvme_keyring 00:18:39.094 02:30:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:39.094 02:30:03 -- nvmf/common.sh@123 -- # set -e 00:18:39.095 02:30:03 -- nvmf/common.sh@124 -- # return 0 00:18:39.095 02:30:03 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:39.095 02:30:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:39.095 02:30:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:39.095 02:30:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:39.095 02:30:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:39.095 02:30:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:39.095 02:30:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.095 02:30:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.095 02:30:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.001 02:30:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.001 02:30:05 -- target/multipath.sh@48 -- # exit 0 00:18:41.001 02:30:05 -- target/multipath.sh@1 -- # nvmftestfini 00:18:41.001 02:30:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:41.001 02:30:05 -- nvmf/common.sh@116 -- # sync 00:18:41.001 02:30:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:41.001 02:30:05 -- nvmf/common.sh@119 -- # set +e 00:18:41.001 02:30:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:41.001 02:30:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:41.001 02:30:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:41.001 02:30:05 -- nvmf/common.sh@123 -- # set -e 00:18:41.001 02:30:05 -- nvmf/common.sh@124 -- # return 0 00:18:41.001 02:30:05 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:41.001 02:30:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:41.001 02:30:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:41.001 02:30:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:41.001 02:30:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:41.001 02:30:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:41.001 02:30:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.001 02:30:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.001 02:30:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.001 02:30:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.001 00:18:41.001 real 0m4.490s 00:18:41.001 user 0m0.922s 00:18:41.001 sys 0m1.574s 00:18:41.001 02:30:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:41.001 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:18:41.001 ************************************ 00:18:41.001 END TEST nvmf_multipath 00:18:41.001 ************************************ 00:18:41.001 02:30:05 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:41.001 02:30:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:41.001 02:30:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:41.001 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:18:41.001 ************************************ 00:18:41.001 START TEST nvmf_zcopy 00:18:41.001 ************************************ 00:18:41.001 02:30:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:41.261 * Looking for test storage... 00:18:41.261 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:41.261 02:30:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:41.261 02:30:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:41.261 02:30:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:41.261 02:30:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:41.261 02:30:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:41.261 02:30:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:41.261 02:30:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:41.261 02:30:05 -- scripts/common.sh@335 -- # IFS=.-: 00:18:41.261 02:30:05 -- scripts/common.sh@335 -- # read -ra ver1 00:18:41.261 02:30:05 -- scripts/common.sh@336 -- # IFS=.-: 00:18:41.261 02:30:05 -- scripts/common.sh@336 -- # read -ra ver2 00:18:41.261 02:30:05 -- scripts/common.sh@337 -- # local 'op=<' 00:18:41.261 02:30:05 -- scripts/common.sh@339 -- # ver1_l=2 00:18:41.261 02:30:05 -- scripts/common.sh@340 -- # ver2_l=1 00:18:41.261 02:30:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:41.261 02:30:05 -- scripts/common.sh@343 -- # case "$op" in 00:18:41.261 02:30:05 -- scripts/common.sh@344 -- # : 1 00:18:41.261 02:30:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:41.261 02:30:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:41.261 02:30:05 -- scripts/common.sh@364 -- # decimal 1 00:18:41.261 02:30:05 -- scripts/common.sh@352 -- # local d=1 00:18:41.261 02:30:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:41.261 02:30:05 -- scripts/common.sh@354 -- # echo 1 00:18:41.261 02:30:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:41.261 02:30:05 -- scripts/common.sh@365 -- # decimal 2 00:18:41.261 02:30:05 -- scripts/common.sh@352 -- # local d=2 00:18:41.261 02:30:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:41.261 02:30:05 -- scripts/common.sh@354 -- # echo 2 00:18:41.261 02:30:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:41.261 02:30:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:41.261 02:30:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:41.261 02:30:05 -- scripts/common.sh@367 -- # return 0 00:18:41.261 02:30:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:41.261 02:30:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:41.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.261 --rc genhtml_branch_coverage=1 00:18:41.261 --rc genhtml_function_coverage=1 00:18:41.261 --rc genhtml_legend=1 00:18:41.261 --rc geninfo_all_blocks=1 00:18:41.261 --rc geninfo_unexecuted_blocks=1 00:18:41.261 00:18:41.261 ' 00:18:41.261 02:30:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:41.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.261 --rc genhtml_branch_coverage=1 00:18:41.261 --rc genhtml_function_coverage=1 00:18:41.261 --rc genhtml_legend=1 00:18:41.261 --rc geninfo_all_blocks=1 00:18:41.261 --rc geninfo_unexecuted_blocks=1 00:18:41.261 00:18:41.261 ' 00:18:41.261 02:30:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:41.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.261 --rc genhtml_branch_coverage=1 00:18:41.261 --rc genhtml_function_coverage=1 00:18:41.261 --rc genhtml_legend=1 00:18:41.261 --rc geninfo_all_blocks=1 00:18:41.261 --rc geninfo_unexecuted_blocks=1 00:18:41.261 00:18:41.261 ' 00:18:41.261 02:30:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:41.261 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.261 --rc genhtml_branch_coverage=1 00:18:41.261 --rc genhtml_function_coverage=1 00:18:41.261 --rc genhtml_legend=1 00:18:41.261 --rc geninfo_all_blocks=1 00:18:41.261 --rc geninfo_unexecuted_blocks=1 00:18:41.261 00:18:41.261 ' 00:18:41.261 02:30:05 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:41.261 02:30:05 -- nvmf/common.sh@7 -- # uname -s 00:18:41.261 02:30:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:41.261 02:30:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:41.261 02:30:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:41.261 02:30:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:41.261 02:30:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:41.261 02:30:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:41.261 02:30:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:41.261 02:30:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:41.261 02:30:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:41.261 02:30:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:41.261 02:30:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.261 02:30:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.261 02:30:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:41.261 02:30:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:41.261 02:30:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:41.261 02:30:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:41.261 02:30:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:41.261 02:30:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:41.261 02:30:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:41.261 02:30:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.262 02:30:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.262 02:30:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.262 02:30:05 -- paths/export.sh@5 -- # export PATH 00:18:41.262 02:30:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.262 02:30:05 -- nvmf/common.sh@46 -- # : 0 00:18:41.262 02:30:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:41.262 02:30:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:41.262 02:30:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:41.262 02:30:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:41.262 02:30:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:41.262 02:30:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:41.262 02:30:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:41.262 02:30:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:41.262 02:30:05 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:41.262 02:30:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:41.262 02:30:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:41.262 02:30:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:41.262 02:30:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:41.262 02:30:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:41.262 02:30:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.262 02:30:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.262 02:30:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.262 02:30:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:41.262 02:30:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:41.262 02:30:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:41.262 02:30:05 -- common/autotest_common.sh@10 -- # set +x 00:18:43.168 02:30:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.168 02:30:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.168 02:30:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.168 02:30:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.168 02:30:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.168 02:30:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.168 02:30:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.168 02:30:07 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.168 02:30:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.168 02:30:07 -- nvmf/common.sh@295 -- # e810=() 00:18:43.168 02:30:07 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.168 02:30:07 -- nvmf/common.sh@296 -- # x722=() 00:18:43.168 02:30:07 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.168 02:30:07 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.168 02:30:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.168 02:30:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.168 02:30:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.168 02:30:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.168 02:30:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.168 02:30:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:43.168 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:43.168 02:30:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.168 02:30:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:43.168 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:43.168 02:30:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.168 02:30:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.168 02:30:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.168 02:30:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:43.168 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:43.168 02:30:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.168 02:30:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.168 02:30:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.168 02:30:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.168 02:30:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:43.168 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:43.168 02:30:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.168 02:30:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.168 02:30:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.168 02:30:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.168 02:30:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.168 02:30:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.168 02:30:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.168 02:30:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.168 02:30:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.168 02:30:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.168 02:30:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.168 02:30:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.168 02:30:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.168 02:30:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.168 02:30:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.168 02:30:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.168 02:30:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.427 02:30:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.427 02:30:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.427 02:30:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.427 02:30:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:43.427 02:30:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:43.427 02:30:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:43.427 02:30:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:43.427 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:43.427 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:18:43.427 00:18:43.427 --- 10.0.0.2 ping statistics --- 00:18:43.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.427 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:18:43.427 02:30:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:43.427 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:43.427 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:18:43.427 00:18:43.427 --- 10.0.0.1 ping statistics --- 00:18:43.427 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.427 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:18:43.427 02:30:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:43.427 02:30:07 -- nvmf/common.sh@410 -- # return 0 00:18:43.427 02:30:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:43.427 02:30:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:43.427 02:30:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:43.427 02:30:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:43.427 02:30:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:43.427 02:30:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:43.427 02:30:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.427 02:30:07 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:43.427 02:30:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:43.427 02:30:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:43.427 02:30:07 -- common/autotest_common.sh@10 -- # set +x 00:18:43.427 02:30:07 -- nvmf/common.sh@469 -- # nvmfpid=2077978 00:18:43.427 02:30:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:43.427 02:30:07 -- nvmf/common.sh@470 -- # waitforlisten 2077978 00:18:43.427 02:30:07 -- common/autotest_common.sh@829 -- # '[' -z 2077978 ']' 00:18:43.427 02:30:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:43.427 02:30:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:43.427 02:30:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:43.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:43.427 02:30:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:43.427 02:30:07 -- common/autotest_common.sh@10 -- # set +x 00:18:43.427 [2024-11-27 02:30:08.032375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:43.427 [2024-11-27 02:30:08.032465] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:43.686 EAL: No free 2048 kB hugepages reported on node 1 00:18:43.686 [2024-11-27 02:30:08.101666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:43.686 [2024-11-27 02:30:08.190049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:43.686 [2024-11-27 02:30:08.190202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:43.686 [2024-11-27 02:30:08.190219] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:43.686 [2024-11-27 02:30:08.190232] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:43.686 [2024-11-27 02:30:08.190261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:44.625 02:30:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:44.625 02:30:09 -- common/autotest_common.sh@862 -- # return 0 00:18:44.625 02:30:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:44.625 02:30:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 02:30:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:44.625 02:30:09 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:44.625 02:30:09 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 [2024-11-27 02:30:09.046030] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 [2024-11-27 02:30:09.062223] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 malloc0 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:44.625 02:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.625 02:30:09 -- common/autotest_common.sh@10 -- # set +x 00:18:44.625 02:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.625 02:30:09 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:44.625 02:30:09 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:44.625 02:30:09 -- nvmf/common.sh@520 -- # config=() 00:18:44.625 02:30:09 -- nvmf/common.sh@520 -- # local subsystem config 00:18:44.625 02:30:09 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:44.625 02:30:09 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:44.625 { 00:18:44.625 "params": { 00:18:44.625 "name": "Nvme$subsystem", 00:18:44.626 "trtype": "$TEST_TRANSPORT", 00:18:44.626 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.626 "adrfam": "ipv4", 00:18:44.626 "trsvcid": "$NVMF_PORT", 00:18:44.626 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.626 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.626 "hdgst": ${hdgst:-false}, 00:18:44.626 "ddgst": ${ddgst:-false} 00:18:44.626 }, 00:18:44.626 "method": "bdev_nvme_attach_controller" 00:18:44.626 } 00:18:44.626 EOF 00:18:44.626 )") 00:18:44.626 02:30:09 -- nvmf/common.sh@542 -- # cat 00:18:44.626 02:30:09 -- nvmf/common.sh@544 -- # jq . 00:18:44.626 02:30:09 -- nvmf/common.sh@545 -- # IFS=, 00:18:44.626 02:30:09 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:44.626 "params": { 00:18:44.626 "name": "Nvme1", 00:18:44.626 "trtype": "tcp", 00:18:44.626 "traddr": "10.0.0.2", 00:18:44.626 "adrfam": "ipv4", 00:18:44.626 "trsvcid": "4420", 00:18:44.626 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:44.626 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:44.626 "hdgst": false, 00:18:44.626 "ddgst": false 00:18:44.626 }, 00:18:44.626 "method": "bdev_nvme_attach_controller" 00:18:44.626 }' 00:18:44.626 [2024-11-27 02:30:09.135628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:44.626 [2024-11-27 02:30:09.135707] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2078309 ] 00:18:44.626 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.626 [2024-11-27 02:30:09.199334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.884 [2024-11-27 02:30:09.289427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:44.884 Running I/O for 10 seconds... 00:18:54.924 00:18:54.924 Latency(us) 00:18:54.924 [2024-11-27T01:30:19.559Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:54.924 [2024-11-27T01:30:19.559Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:54.924 Verification LBA range: start 0x0 length 0x1000 00:18:54.924 Nvme1n1 : 10.01 8539.83 66.72 0.00 0.00 14952.85 1686.95 20194.80 00:18:54.924 [2024-11-27T01:30:19.559Z] =================================================================================================================== 00:18:54.924 [2024-11-27T01:30:19.559Z] Total : 8539.83 66.72 0.00 0.00 14952.85 1686.95 20194.80 00:18:55.182 02:30:19 -- target/zcopy.sh@39 -- # perfpid=2079550 00:18:55.182 02:30:19 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:55.182 02:30:19 -- common/autotest_common.sh@10 -- # set +x 00:18:55.182 02:30:19 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:55.182 02:30:19 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:55.182 02:30:19 -- nvmf/common.sh@520 -- # config=() 00:18:55.182 02:30:19 -- nvmf/common.sh@520 -- # local subsystem config 00:18:55.182 02:30:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:55.182 02:30:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:55.182 { 00:18:55.182 "params": { 00:18:55.182 "name": "Nvme$subsystem", 00:18:55.182 "trtype": "$TEST_TRANSPORT", 00:18:55.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:55.182 "adrfam": "ipv4", 00:18:55.182 "trsvcid": "$NVMF_PORT", 00:18:55.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:55.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:55.182 "hdgst": ${hdgst:-false}, 00:18:55.182 "ddgst": ${ddgst:-false} 00:18:55.183 }, 00:18:55.183 "method": "bdev_nvme_attach_controller" 00:18:55.183 } 00:18:55.183 EOF 00:18:55.183 )") 00:18:55.183 02:30:19 -- nvmf/common.sh@542 -- # cat 00:18:55.183 [2024-11-27 02:30:19.768802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.768847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.183 02:30:19 -- nvmf/common.sh@544 -- # jq . 00:18:55.183 02:30:19 -- nvmf/common.sh@545 -- # IFS=, 00:18:55.183 02:30:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:55.183 "params": { 00:18:55.183 "name": "Nvme1", 00:18:55.183 "trtype": "tcp", 00:18:55.183 "traddr": "10.0.0.2", 00:18:55.183 "adrfam": "ipv4", 00:18:55.183 "trsvcid": "4420", 00:18:55.183 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:55.183 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:55.183 "hdgst": false, 00:18:55.183 "ddgst": false 00:18:55.183 }, 00:18:55.183 "method": "bdev_nvme_attach_controller" 00:18:55.183 }' 00:18:55.183 [2024-11-27 02:30:19.776760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.776789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.183 [2024-11-27 02:30:19.784778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.784803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.183 [2024-11-27 02:30:19.792800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.792825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.183 [2024-11-27 02:30:19.800830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.800863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.183 [2024-11-27 02:30:19.807151] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:55.183 [2024-11-27 02:30:19.807220] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2079550 ] 00:18:55.183 [2024-11-27 02:30:19.808846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.183 [2024-11-27 02:30:19.808869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.816879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.816907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.824892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.824911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.832916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.832934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 EAL: No free 2048 kB hugepages reported on node 1 00:18:55.442 [2024-11-27 02:30:19.840967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.840992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.848975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.848999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.856998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.857021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.865021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.865045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.871477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:55.442 [2024-11-27 02:30:19.873045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.873070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.881107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.881148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.889099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.889129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.897114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.897138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.905136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.905161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.913157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.913181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.921189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.921218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.929236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.929275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.937232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.937257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.945253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.945277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.953273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.953297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.961293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.961317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.442 [2024-11-27 02:30:19.962344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:55.442 [2024-11-27 02:30:19.969318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.442 [2024-11-27 02:30:19.969343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:19.977353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:19.977384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:19.985392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:19.985430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:19.993412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:19.993452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.001483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.001550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.009480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.009553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.017490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.017543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.025492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.025523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.033564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.033617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.041603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.041646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.049619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.049662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.057596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.057620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.065613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.065638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.443 [2024-11-27 02:30:20.073639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.443 [2024-11-27 02:30:20.073681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.081652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.081684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.089663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.089687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.097721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.097746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.105708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.105731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.113733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.113756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.121753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.121776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.129778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.129806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.137825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.137848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.145843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.145866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.153862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.153903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.161898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.161924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.169923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.169949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.177948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.177973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.185981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.186006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.194014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.194043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.202032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.703 [2024-11-27 02:30:20.202058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.703 [2024-11-27 02:30:20.210054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.210080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.218081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.218105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.226104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.226130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.234133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.234167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.242153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.242179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.250177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.250203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.258202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.258228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.266225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.266251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.274246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.274272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.282268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.282294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.291354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.291384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.298381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.298410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 Running I/O for 5 seconds... 00:18:55.704 [2024-11-27 02:30:20.306400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.306426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.320608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.320652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.704 [2024-11-27 02:30:20.331496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.704 [2024-11-27 02:30:20.331537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.964 [2024-11-27 02:30:20.343039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.964 [2024-11-27 02:30:20.343071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.964 [2024-11-27 02:30:20.354366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.964 [2024-11-27 02:30:20.354397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.964 [2024-11-27 02:30:20.367871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.964 [2024-11-27 02:30:20.367905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.964 [2024-11-27 02:30:20.378181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.378208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.388582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.388610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.399117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.399144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.410271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.410302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.423075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.423102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.433684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.433712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.444851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.444882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.456092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.456122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.466995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.467027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.478243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.478273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.491740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.491782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.502685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.502712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.513960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.513990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.527310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.527340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.537634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.537671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.548686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.548714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.561514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.561552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.571935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.571965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.583626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.583653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.965 [2024-11-27 02:30:20.594542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:55.965 [2024-11-27 02:30:20.594586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.605732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.605760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.616427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.616458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.627878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.627908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.639007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.639037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.652020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.652051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.662498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.662537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.673984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.674014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.684995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.685025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.695726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.695753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.707167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.707197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.718020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.718050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.729096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.729126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.741471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.741502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.752202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.752233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.762922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.762952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.773855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.773886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.784712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.784740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.797248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.797278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.806697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.806725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.818505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.818543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.829988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.830018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.841447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.841477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.226 [2024-11-27 02:30:20.852846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.226 [2024-11-27 02:30:20.852888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.864107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.864139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.875054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.875084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.886496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.886534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.897778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.897805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.909060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.909090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.920375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.920406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.933431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.933461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.943672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.943699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.954494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.954532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.967571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.967599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.976866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.976893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.988479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.988510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:20.999893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:20.999924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.012951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.012981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.023485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.023515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.034301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.034331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.045715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.045742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.056814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.056869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.067435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.067466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.078621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.078648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.089395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.089426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.100219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.100250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.486 [2024-11-27 02:30:21.113086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.486 [2024-11-27 02:30:21.113117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.123416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.123446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.133961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.133991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.144355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.144385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.155661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.155688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.166570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.166597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.177312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.177342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.188532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.188576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.199652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.199680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.210573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.210601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.221960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.221992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.233069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.233100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.244641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.244669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.256055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.256085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.267930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.267974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.279430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.279460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.290931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.290963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.304318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.304348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.315255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.315286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.326159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.326190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.337620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.337648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.348691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.348718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.361497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.361535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.745 [2024-11-27 02:30:21.370689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.745 [2024-11-27 02:30:21.370716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.382605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.382633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.395256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.395286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.405022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.405054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.416798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.416826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.427675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.427702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.438409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.438439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.452077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.452107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.462482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.462512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.473264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.473294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.484020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.484059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.495171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.495202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.506210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.506240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.517475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.517504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.530125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.530156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.540995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.541025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.552280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.552311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.563303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.563333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.574101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.574130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.584771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.584799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.595925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.595956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.609206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.609236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.619538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.619583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.004 [2024-11-27 02:30:21.630667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.004 [2024-11-27 02:30:21.630694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.643630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.643658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.653571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.653599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.664630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.664672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.677451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.677481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.687676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.687703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.699254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.699294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.710347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.710377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.721385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.721416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.732379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.732409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.744756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.744786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.754954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.754984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.766498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.766537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.779822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.779852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.790842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.790872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.801382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.801412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.812549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.812579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.825248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.825279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.834592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.834623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.846343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.846373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.857671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.857702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.868461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.868491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.880909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.880939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.264 [2024-11-27 02:30:21.891243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.264 [2024-11-27 02:30:21.891274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.525 [2024-11-27 02:30:21.902673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.525 [2024-11-27 02:30:21.902704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.525 [2024-11-27 02:30:21.913960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.525 [2024-11-27 02:30:21.913990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.525 [2024-11-27 02:30:21.924922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.924953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.937543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.937573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.947196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.947226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.959136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.959167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.970469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.970500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.983341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.983372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:21.993503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:21.993545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.004961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.004991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.017873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.017902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.028449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.028479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.039374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.039404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.050283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.050313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.061489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.061519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.072507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.072548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.083532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.083561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.094692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.094722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.105601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.105631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.116683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.116714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.128193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.128223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.139160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.139190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.526 [2024-11-27 02:30:22.150250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.526 [2024-11-27 02:30:22.150279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.161616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.161647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.172984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.173014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.183941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.183971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.195300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.195331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.206247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.206277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.217026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.217056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.227860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.227891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.240694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.240726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.251331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.251361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.262002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.262033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.273023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.273053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.283915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.785 [2024-11-27 02:30:22.283947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.785 [2024-11-27 02:30:22.294966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.294997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.305736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.305767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.316712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.316743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.327951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.327981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.339024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.339054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.349792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.349824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.361411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.361442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.372904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.372935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.384099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.384130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.395135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.395165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.408059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.408089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.786 [2024-11-27 02:30:22.418336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.786 [2024-11-27 02:30:22.418368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.429683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.429714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.440834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.440864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.452466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.452496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.465394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.465425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.476005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.476035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.487673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.487703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.498870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.498900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.511631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.511661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.522155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.522185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.532987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.533017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.543502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.543541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.554606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.554636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.565306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.565336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.576477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.576508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.589729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.589761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.600310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.600341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.611812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.611842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.623177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.623208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.634127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.634157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.645155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.645186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.656557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.656587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.044 [2024-11-27 02:30:22.667495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.044 [2024-11-27 02:30:22.667532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.679004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.679035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.690235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.690266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.703214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.703245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.713589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.713619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.724740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.724770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.737520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.737558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.747469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.747499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.758722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.758761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.771693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.771724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.782199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.782229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.793400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.793430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.805896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.805926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.815159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.815189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.827081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.827111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.838098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.838129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.848992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.849022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.862705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.862735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.873540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.873570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.884311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.884341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.896787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.896818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.906633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.906664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.918359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.918389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.303 [2024-11-27 02:30:22.929171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.303 [2024-11-27 02:30:22.929201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.940969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.941005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.952116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.952147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.963036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.963066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.976108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.976148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.986535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.986565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:22.998116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:22.998146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.009321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.009351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.022479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.022510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.032513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.032552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.043719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.043749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.054674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.054705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.065500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.065540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.078197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.078228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.088334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.088365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.099875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.099905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.111078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.111108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.123846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.123876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.133730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.133760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.144969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.144999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.157553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.157583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.167868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.167899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.179323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.179353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.564 [2024-11-27 02:30:23.190822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.564 [2024-11-27 02:30:23.190859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.201736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.201767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.212807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.212838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.225868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.225898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.236600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.236632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.248227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.248257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.259750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.259780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.272582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.272613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.283153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.283184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.294179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.294209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.305659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.305689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.316999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.317031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.329982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.330013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.339847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.339878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.351035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.351065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.361547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.361577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.825 [2024-11-27 02:30:23.372636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.825 [2024-11-27 02:30:23.372666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.385430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.385459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.395641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.395671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.406647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.406686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.419605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.419635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.429843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.429873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.441406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.441436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.826 [2024-11-27 02:30:23.452667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.826 [2024-11-27 02:30:23.452698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.465993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.466024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.476148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.476179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.487001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.487033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.498278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.498309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.509043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.509074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.520038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.520068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.530870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.530900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.541734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.541764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.552827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.552858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.563596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.563626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.574273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.574303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.587390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.587420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.597570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.597601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.608975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.609005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.622465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.622495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.633073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.633103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.643801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.643832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.654966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.654997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.666279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.666309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.676809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.676839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.688075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.688105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.701273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.701303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.086 [2024-11-27 02:30:23.711815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.086 [2024-11-27 02:30:23.711846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.722595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.722626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.733274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.733304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.743852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.743882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.754568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.754598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.765987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.766016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.776981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.777011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.788050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.788081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.799130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.799160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.810318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.810347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.821333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.821363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.832482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.832511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.843551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.843582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.854295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.854326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.865412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.865442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.876560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.876591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.887718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.887748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.898997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.899028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.909711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.909741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.920620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.920650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.933827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.933858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.944106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.944136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.954555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.954586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.965208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.965237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.347 [2024-11-27 02:30:23.976504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.347 [2024-11-27 02:30:23.976544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.606 [2024-11-27 02:30:23.987519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:23.987570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:23.998513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:23.998552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.009584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.009615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.022917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.022947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.033821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.033851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.045087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.045117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.056593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.056623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.067708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.067738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.080589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.080619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.091475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.091505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.102800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.102831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.113644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.113675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.124827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.124858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.135672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.135702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.147292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.147322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.158619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.158650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.169580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.169611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.180603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.180633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.191532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.191563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.202489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.202519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.213456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.213486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.224681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.224712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.607 [2024-11-27 02:30:24.235108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.607 [2024-11-27 02:30:24.235139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.245729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.245760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.256538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.256568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.267289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.267318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.277944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.277974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.289084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.289114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.302096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.302126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.312601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.865 [2024-11-27 02:30:24.312633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.865 [2024-11-27 02:30:24.323991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.324022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.334911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.334942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.346007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.346038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.358492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.358522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.367979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.368009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.379720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.379750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.390640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.390670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.401484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.401514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.413818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.413848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.423146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.423176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.435185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.435215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.447956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.447987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.458036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.458079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.469178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.469208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.480254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.480285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.866 [2024-11-27 02:30:24.491271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.866 [2024-11-27 02:30:24.491302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.504380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.504411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.515226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.515257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.526388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.526418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.537890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.537921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.548428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.548459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.559079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.559109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.569924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.569955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.581034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.581064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.592395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.592425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.603631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.603663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.614750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.614781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.627831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.627862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.637928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.637958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.649104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.649145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.660310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.660341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.671202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.671241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.682386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.682417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.125 [2024-11-27 02:30:24.693167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.125 [2024-11-27 02:30:24.693198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.126 [2024-11-27 02:30:24.706333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.126 [2024-11-27 02:30:24.706364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.126 [2024-11-27 02:30:24.716897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.126 [2024-11-27 02:30:24.716927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.126 [2024-11-27 02:30:24.727935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.126 [2024-11-27 02:30:24.727965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.126 [2024-11-27 02:30:24.738918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.126 [2024-11-27 02:30:24.738948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.126 [2024-11-27 02:30:24.749906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.126 [2024-11-27 02:30:24.749936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.761451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.761482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.773106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.773136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.784153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.784183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.795047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.795077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.806417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.806447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.819562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.384 [2024-11-27 02:30:24.819591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.384 [2024-11-27 02:30:24.830049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.830079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.841036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.841066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.854069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.854099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.864330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.864361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.875700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.875731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.886782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.886819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.897551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.897581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.908441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.908472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.919516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.919556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.932692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.932722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.943410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.943441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.954439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.954469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.966914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.966945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.976186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.976216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.987746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.987777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:24.999046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:24.999076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.385 [2024-11-27 02:30:25.011865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.385 [2024-11-27 02:30:25.011896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.021958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.021988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.033202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.033232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.043778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.043808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.054670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.054701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.067611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.067642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.078322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.078352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.089919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.089950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.100770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.100809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.111831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.111861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.124978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.125008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.135683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.135713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.146427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.146459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.157921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.157951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.168619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.168658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.181431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.181462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.191745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.191777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.203092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.203123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.216213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.216244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.226567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.226597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.237535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.237566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.248965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.248995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.260327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.260357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.647 [2024-11-27 02:30:25.271162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.647 [2024-11-27 02:30:25.271193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.907 [2024-11-27 02:30:25.282145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.907 [2024-11-27 02:30:25.282177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.907 [2024-11-27 02:30:25.293122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.907 [2024-11-27 02:30:25.293152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.907 [2024-11-27 02:30:25.304485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.907 [2024-11-27 02:30:25.304515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.907 [2024-11-27 02:30:25.315706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.315736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.325505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.325545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 00:19:00.908 Latency(us) 00:19:00.908 [2024-11-27T01:30:25.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:00.908 [2024-11-27T01:30:25.543Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:00.908 Nvme1n1 : 5.01 11493.66 89.79 0.00 0.00 11121.73 4830.25 22524.97 00:19:00.908 [2024-11-27T01:30:25.543Z] =================================================================================================================== 00:19:00.908 [2024-11-27T01:30:25.543Z] Total : 11493.66 89.79 0.00 0.00 11121.73 4830.25 22524.97 00:19:00.908 [2024-11-27 02:30:25.331969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.331999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.339998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.340027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.348033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.348071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.356089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.356139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.364105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.364153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.372134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.372182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.380142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.380189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.388173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.388220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.396200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.396248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.404216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.404263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.412238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.412287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.420266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.420314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.428291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.428339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.436317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.436365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.444331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.444380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.452353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.452401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.460373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.460419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.468400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.468445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.476393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.476428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.484392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.484418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.492458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.492502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.500489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.500545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.508505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.508557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.516486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.516512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.524512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.524549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.532586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.532634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.908 [2024-11-27 02:30:25.540599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.908 [2024-11-27 02:30:25.540644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.167 [2024-11-27 02:30:25.548579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.167 [2024-11-27 02:30:25.548605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.167 [2024-11-27 02:30:25.556593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.167 [2024-11-27 02:30:25.556617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.167 [2024-11-27 02:30:25.564612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.167 [2024-11-27 02:30:25.564636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.167 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2079550) - No such process 00:19:01.167 02:30:25 -- target/zcopy.sh@49 -- # wait 2079550 00:19:01.167 02:30:25 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:01.167 02:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.167 02:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:01.167 02:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.167 02:30:25 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:01.167 02:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.167 02:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:01.167 delay0 00:19:01.167 02:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.167 02:30:25 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:01.167 02:30:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.167 02:30:25 -- common/autotest_common.sh@10 -- # set +x 00:19:01.167 02:30:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.167 02:30:25 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:01.167 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.167 [2024-11-27 02:30:25.723664] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:07.757 Initializing NVMe Controllers 00:19:07.757 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:07.757 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:07.757 Initialization complete. Launching workers. 00:19:07.757 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 191 00:19:07.757 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 478, failed to submit 33 00:19:07.757 success 305, unsuccess 173, failed 0 00:19:07.757 02:30:31 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:07.757 02:30:31 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:07.757 02:30:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:07.757 02:30:31 -- nvmf/common.sh@116 -- # sync 00:19:07.757 02:30:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:07.757 02:30:31 -- nvmf/common.sh@119 -- # set +e 00:19:07.757 02:30:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:07.757 02:30:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:07.757 rmmod nvme_tcp 00:19:07.757 rmmod nvme_fabrics 00:19:07.757 rmmod nvme_keyring 00:19:07.757 02:30:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:07.757 02:30:31 -- nvmf/common.sh@123 -- # set -e 00:19:07.757 02:30:31 -- nvmf/common.sh@124 -- # return 0 00:19:07.757 02:30:31 -- nvmf/common.sh@477 -- # '[' -n 2077978 ']' 00:19:07.757 02:30:31 -- nvmf/common.sh@478 -- # killprocess 2077978 00:19:07.757 02:30:31 -- common/autotest_common.sh@936 -- # '[' -z 2077978 ']' 00:19:07.757 02:30:31 -- common/autotest_common.sh@940 -- # kill -0 2077978 00:19:07.757 02:30:31 -- common/autotest_common.sh@941 -- # uname 00:19:07.757 02:30:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:07.758 02:30:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2077978 00:19:07.758 02:30:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:07.758 02:30:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:07.758 02:30:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2077978' 00:19:07.758 killing process with pid 2077978 00:19:07.758 02:30:32 -- common/autotest_common.sh@955 -- # kill 2077978 00:19:07.758 02:30:32 -- common/autotest_common.sh@960 -- # wait 2077978 00:19:07.758 02:30:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:07.758 02:30:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:07.758 02:30:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:07.758 02:30:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:07.758 02:30:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:07.758 02:30:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:07.758 02:30:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:07.758 02:30:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.663 02:30:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:09.663 00:19:09.663 real 0m28.680s 00:19:09.663 user 0m42.342s 00:19:09.663 sys 0m8.071s 00:19:09.663 02:30:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:09.663 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:19:09.663 ************************************ 00:19:09.663 END TEST nvmf_zcopy 00:19:09.663 ************************************ 00:19:09.922 02:30:34 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:09.922 02:30:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:09.922 02:30:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:09.922 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:19:09.922 ************************************ 00:19:09.922 START TEST nvmf_nmic 00:19:09.923 ************************************ 00:19:09.923 02:30:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:09.923 * Looking for test storage... 00:19:09.923 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:09.923 02:30:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:09.923 02:30:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:09.923 02:30:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:09.923 02:30:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:09.923 02:30:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:09.923 02:30:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:09.923 02:30:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:09.923 02:30:34 -- scripts/common.sh@335 -- # IFS=.-: 00:19:09.923 02:30:34 -- scripts/common.sh@335 -- # read -ra ver1 00:19:09.923 02:30:34 -- scripts/common.sh@336 -- # IFS=.-: 00:19:09.923 02:30:34 -- scripts/common.sh@336 -- # read -ra ver2 00:19:09.923 02:30:34 -- scripts/common.sh@337 -- # local 'op=<' 00:19:09.923 02:30:34 -- scripts/common.sh@339 -- # ver1_l=2 00:19:09.923 02:30:34 -- scripts/common.sh@340 -- # ver2_l=1 00:19:09.923 02:30:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:09.923 02:30:34 -- scripts/common.sh@343 -- # case "$op" in 00:19:09.923 02:30:34 -- scripts/common.sh@344 -- # : 1 00:19:09.923 02:30:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:09.923 02:30:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:09.923 02:30:34 -- scripts/common.sh@364 -- # decimal 1 00:19:09.923 02:30:34 -- scripts/common.sh@352 -- # local d=1 00:19:09.923 02:30:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:09.923 02:30:34 -- scripts/common.sh@354 -- # echo 1 00:19:09.923 02:30:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:09.923 02:30:34 -- scripts/common.sh@365 -- # decimal 2 00:19:09.923 02:30:34 -- scripts/common.sh@352 -- # local d=2 00:19:09.923 02:30:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:09.923 02:30:34 -- scripts/common.sh@354 -- # echo 2 00:19:09.923 02:30:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:09.923 02:30:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:09.923 02:30:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:09.923 02:30:34 -- scripts/common.sh@367 -- # return 0 00:19:09.923 02:30:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:09.923 02:30:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:09.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:09.923 --rc genhtml_branch_coverage=1 00:19:09.923 --rc genhtml_function_coverage=1 00:19:09.923 --rc genhtml_legend=1 00:19:09.923 --rc geninfo_all_blocks=1 00:19:09.923 --rc geninfo_unexecuted_blocks=1 00:19:09.923 00:19:09.923 ' 00:19:09.923 02:30:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:09.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:09.923 --rc genhtml_branch_coverage=1 00:19:09.923 --rc genhtml_function_coverage=1 00:19:09.923 --rc genhtml_legend=1 00:19:09.923 --rc geninfo_all_blocks=1 00:19:09.923 --rc geninfo_unexecuted_blocks=1 00:19:09.923 00:19:09.923 ' 00:19:09.923 02:30:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:09.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:09.923 --rc genhtml_branch_coverage=1 00:19:09.923 --rc genhtml_function_coverage=1 00:19:09.923 --rc genhtml_legend=1 00:19:09.923 --rc geninfo_all_blocks=1 00:19:09.923 --rc geninfo_unexecuted_blocks=1 00:19:09.923 00:19:09.923 ' 00:19:09.923 02:30:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:09.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:09.923 --rc genhtml_branch_coverage=1 00:19:09.923 --rc genhtml_function_coverage=1 00:19:09.923 --rc genhtml_legend=1 00:19:09.923 --rc geninfo_all_blocks=1 00:19:09.923 --rc geninfo_unexecuted_blocks=1 00:19:09.923 00:19:09.923 ' 00:19:09.923 02:30:34 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:09.923 02:30:34 -- nvmf/common.sh@7 -- # uname -s 00:19:09.923 02:30:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:09.923 02:30:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:09.923 02:30:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:09.923 02:30:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:09.923 02:30:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:09.923 02:30:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:09.923 02:30:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:09.923 02:30:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:09.923 02:30:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:09.923 02:30:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:09.923 02:30:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:09.923 02:30:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:09.923 02:30:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:09.923 02:30:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:09.923 02:30:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:09.923 02:30:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:09.923 02:30:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:09.923 02:30:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:09.923 02:30:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:09.923 02:30:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.923 02:30:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.923 02:30:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.923 02:30:34 -- paths/export.sh@5 -- # export PATH 00:19:09.923 02:30:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.923 02:30:34 -- nvmf/common.sh@46 -- # : 0 00:19:09.923 02:30:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:09.923 02:30:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:09.923 02:30:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:09.923 02:30:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:09.923 02:30:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:09.923 02:30:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:09.923 02:30:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:09.923 02:30:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:09.923 02:30:34 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:09.924 02:30:34 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:09.924 02:30:34 -- target/nmic.sh@14 -- # nvmftestinit 00:19:09.924 02:30:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:09.924 02:30:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:09.924 02:30:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:09.924 02:30:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:09.924 02:30:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:09.924 02:30:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:09.924 02:30:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:09.924 02:30:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.924 02:30:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:09.924 02:30:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:09.924 02:30:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:09.924 02:30:34 -- common/autotest_common.sh@10 -- # set +x 00:19:11.826 02:30:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:11.826 02:30:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:11.826 02:30:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:11.826 02:30:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:11.826 02:30:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:11.826 02:30:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:11.826 02:30:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:11.826 02:30:36 -- nvmf/common.sh@294 -- # net_devs=() 00:19:11.826 02:30:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:11.826 02:30:36 -- nvmf/common.sh@295 -- # e810=() 00:19:11.826 02:30:36 -- nvmf/common.sh@295 -- # local -ga e810 00:19:11.826 02:30:36 -- nvmf/common.sh@296 -- # x722=() 00:19:11.826 02:30:36 -- nvmf/common.sh@296 -- # local -ga x722 00:19:11.826 02:30:36 -- nvmf/common.sh@297 -- # mlx=() 00:19:11.826 02:30:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:11.826 02:30:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:11.826 02:30:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:11.826 02:30:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:11.826 02:30:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:11.826 02:30:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:11.826 02:30:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:11.826 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:11.826 02:30:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:11.826 02:30:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:11.827 02:30:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:11.827 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:11.827 02:30:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:11.827 02:30:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:11.827 02:30:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:11.827 02:30:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:11.827 02:30:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:11.827 02:30:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:11.827 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:11.827 02:30:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:11.827 02:30:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:11.827 02:30:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:11.827 02:30:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:11.827 02:30:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:11.827 02:30:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:11.827 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:11.827 02:30:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:11.827 02:30:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:11.827 02:30:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:11.827 02:30:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:11.827 02:30:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:11.827 02:30:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:11.827 02:30:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:11.827 02:30:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:11.827 02:30:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:11.827 02:30:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:11.827 02:30:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:11.827 02:30:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:11.827 02:30:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:11.827 02:30:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:11.827 02:30:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:11.827 02:30:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:11.827 02:30:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:11.827 02:30:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:12.087 02:30:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:12.087 02:30:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:12.087 02:30:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:12.087 02:30:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:12.087 02:30:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:12.087 02:30:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:12.087 02:30:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:12.087 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:12.087 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:19:12.087 00:19:12.087 --- 10.0.0.2 ping statistics --- 00:19:12.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.087 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:19:12.087 02:30:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:12.087 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:12.087 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:19:12.087 00:19:12.087 --- 10.0.0.1 ping statistics --- 00:19:12.087 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.087 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:19:12.087 02:30:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:12.087 02:30:36 -- nvmf/common.sh@410 -- # return 0 00:19:12.087 02:30:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:12.087 02:30:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:12.087 02:30:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:12.087 02:30:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:12.087 02:30:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:12.087 02:30:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:12.087 02:30:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:12.087 02:30:36 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:12.087 02:30:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:12.087 02:30:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:12.087 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:19:12.087 02:30:36 -- nvmf/common.sh@469 -- # nvmfpid=2082997 00:19:12.087 02:30:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:12.087 02:30:36 -- nvmf/common.sh@470 -- # waitforlisten 2082997 00:19:12.087 02:30:36 -- common/autotest_common.sh@829 -- # '[' -z 2082997 ']' 00:19:12.087 02:30:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:12.087 02:30:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:12.087 02:30:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:12.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:12.087 02:30:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:12.087 02:30:36 -- common/autotest_common.sh@10 -- # set +x 00:19:12.087 [2024-11-27 02:30:36.650037] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:12.087 [2024-11-27 02:30:36.650103] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:12.087 EAL: No free 2048 kB hugepages reported on node 1 00:19:12.087 [2024-11-27 02:30:36.717481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:12.346 [2024-11-27 02:30:36.812779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:12.346 [2024-11-27 02:30:36.812948] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:12.346 [2024-11-27 02:30:36.812966] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:12.346 [2024-11-27 02:30:36.812979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:12.346 [2024-11-27 02:30:36.813044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:12.346 [2024-11-27 02:30:36.813116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:12.346 [2024-11-27 02:30:36.813119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:12.347 [2024-11-27 02:30:36.813093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:13.283 02:30:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:13.284 02:30:37 -- common/autotest_common.sh@862 -- # return 0 00:19:13.284 02:30:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:13.284 02:30:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 02:30:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:13.284 02:30:37 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 [2024-11-27 02:30:37.712368] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 Malloc0 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 [2024-11-27 02:30:37.763652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:13.284 test case1: single bdev can't be used in multiple subsystems 00:19:13.284 02:30:37 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@28 -- # nmic_status=0 00:19:13.284 02:30:37 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 [2024-11-27 02:30:37.787427] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:13.284 [2024-11-27 02:30:37.787457] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:13.284 [2024-11-27 02:30:37.787486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.284 request: 00:19:13.284 { 00:19:13.284 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:13.284 "namespace": { 00:19:13.284 "bdev_name": "Malloc0" 00:19:13.284 }, 00:19:13.284 "method": "nvmf_subsystem_add_ns", 00:19:13.284 "req_id": 1 00:19:13.284 } 00:19:13.284 Got JSON-RPC error response 00:19:13.284 response: 00:19:13.284 { 00:19:13.284 "code": -32602, 00:19:13.284 "message": "Invalid parameters" 00:19:13.284 } 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@29 -- # nmic_status=1 00:19:13.284 02:30:37 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:13.284 02:30:37 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:13.284 Adding namespace failed - expected result. 00:19:13.284 02:30:37 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:13.284 test case2: host connect to nvmf target in multiple paths 00:19:13.284 02:30:37 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:13.284 02:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.284 02:30:37 -- common/autotest_common.sh@10 -- # set +x 00:19:13.284 [2024-11-27 02:30:37.795564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:13.284 02:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.284 02:30:37 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:14.221 02:30:38 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:14.480 02:30:39 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:14.480 02:30:39 -- common/autotest_common.sh@1187 -- # local i=0 00:19:14.480 02:30:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:14.480 02:30:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:14.480 02:30:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:17.021 02:30:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:17.021 02:30:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:17.021 02:30:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:17.021 02:30:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:17.021 02:30:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:17.021 02:30:41 -- common/autotest_common.sh@1197 -- # return 0 00:19:17.021 02:30:41 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:17.021 [global] 00:19:17.021 thread=1 00:19:17.021 invalidate=1 00:19:17.021 rw=write 00:19:17.021 time_based=1 00:19:17.021 runtime=1 00:19:17.021 ioengine=libaio 00:19:17.021 direct=1 00:19:17.021 bs=4096 00:19:17.021 iodepth=1 00:19:17.021 norandommap=0 00:19:17.021 numjobs=1 00:19:17.021 00:19:17.021 verify_dump=1 00:19:17.021 verify_backlog=512 00:19:17.021 verify_state_save=0 00:19:17.021 do_verify=1 00:19:17.021 verify=crc32c-intel 00:19:17.021 [job0] 00:19:17.021 filename=/dev/nvme0n1 00:19:17.021 Could not set queue depth (nvme0n1) 00:19:17.021 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.021 fio-3.35 00:19:17.021 Starting 1 thread 00:19:17.959 00:19:17.959 job0: (groupid=0, jobs=1): err= 0: pid=2083654: Wed Nov 27 02:30:42 2024 00:19:17.959 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:17.959 slat (nsec): min=7002, max=56926, avg=13538.76, stdev=4875.07 00:19:17.959 clat (usec): min=181, max=472, avg=223.79, stdev=16.59 00:19:17.959 lat (usec): min=193, max=480, avg=237.33, stdev=19.48 00:19:17.959 clat percentiles (usec): 00:19:17.959 | 1.00th=[ 192], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 208], 00:19:17.959 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 227], 60.00th=[ 229], 00:19:17.959 | 70.00th=[ 233], 80.00th=[ 237], 90.00th=[ 243], 95.00th=[ 247], 00:19:17.959 | 99.00th=[ 260], 99.50th=[ 265], 99.90th=[ 273], 99.95th=[ 277], 00:19:17.959 | 99.99th=[ 474] 00:19:17.959 write: IOPS=2222, BW=8891KiB/s (9104kB/s)(8900KiB/1001msec); 0 zone resets 00:19:17.959 slat (usec): min=9, max=28355, avg=30.59, stdev=600.80 00:19:17.959 clat (usec): min=144, max=619, avg=191.72, stdev=37.46 00:19:17.959 lat (usec): min=154, max=28650, avg=222.31, stdev=604.37 00:19:17.959 clat percentiles (usec): 00:19:17.959 | 1.00th=[ 149], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 163], 00:19:17.959 | 30.00th=[ 172], 40.00th=[ 178], 50.00th=[ 184], 60.00th=[ 190], 00:19:17.959 | 70.00th=[ 196], 80.00th=[ 212], 90.00th=[ 233], 95.00th=[ 273], 00:19:17.959 | 99.00th=[ 322], 99.50th=[ 355], 99.90th=[ 404], 99.95th=[ 420], 00:19:17.959 | 99.99th=[ 619] 00:19:17.959 bw ( KiB/s): min= 8488, max= 8488, per=95.47%, avg=8488.00, stdev= 0.00, samples=1 00:19:17.959 iops : min= 2122, max= 2122, avg=2122.00, stdev= 0.00, samples=1 00:19:17.959 lat (usec) : 250=94.43%, 500=5.55%, 750=0.02% 00:19:17.959 cpu : usr=6.40%, sys=7.80%, ctx=4276, majf=0, minf=1 00:19:17.959 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.959 issued rwts: total=2048,2225,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.959 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.959 00:19:17.959 Run status group 0 (all jobs): 00:19:17.959 READ: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:19:17.959 WRITE: bw=8891KiB/s (9104kB/s), 8891KiB/s-8891KiB/s (9104kB/s-9104kB/s), io=8900KiB (9114kB), run=1001-1001msec 00:19:17.959 00:19:17.959 Disk stats (read/write): 00:19:17.959 nvme0n1: ios=1785/2048, merge=0/0, ticks=1385/376, in_queue=1761, util=98.60% 00:19:17.959 02:30:42 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:17.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:17.959 02:30:42 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:17.959 02:30:42 -- common/autotest_common.sh@1208 -- # local i=0 00:19:17.959 02:30:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:17.959 02:30:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.217 02:30:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:18.217 02:30:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.217 02:30:42 -- common/autotest_common.sh@1220 -- # return 0 00:19:18.217 02:30:42 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:18.217 02:30:42 -- target/nmic.sh@53 -- # nvmftestfini 00:19:18.217 02:30:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:18.218 02:30:42 -- nvmf/common.sh@116 -- # sync 00:19:18.218 02:30:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:18.218 02:30:42 -- nvmf/common.sh@119 -- # set +e 00:19:18.218 02:30:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:18.218 02:30:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:18.218 rmmod nvme_tcp 00:19:18.218 rmmod nvme_fabrics 00:19:18.218 rmmod nvme_keyring 00:19:18.218 02:30:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:18.218 02:30:42 -- nvmf/common.sh@123 -- # set -e 00:19:18.218 02:30:42 -- nvmf/common.sh@124 -- # return 0 00:19:18.218 02:30:42 -- nvmf/common.sh@477 -- # '[' -n 2082997 ']' 00:19:18.218 02:30:42 -- nvmf/common.sh@478 -- # killprocess 2082997 00:19:18.218 02:30:42 -- common/autotest_common.sh@936 -- # '[' -z 2082997 ']' 00:19:18.218 02:30:42 -- common/autotest_common.sh@940 -- # kill -0 2082997 00:19:18.218 02:30:42 -- common/autotest_common.sh@941 -- # uname 00:19:18.218 02:30:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:18.218 02:30:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2082997 00:19:18.218 02:30:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:18.218 02:30:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:18.218 02:30:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2082997' 00:19:18.218 killing process with pid 2082997 00:19:18.218 02:30:42 -- common/autotest_common.sh@955 -- # kill 2082997 00:19:18.218 02:30:42 -- common/autotest_common.sh@960 -- # wait 2082997 00:19:18.476 02:30:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:18.476 02:30:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:18.476 02:30:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:18.476 02:30:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:18.476 02:30:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:18.476 02:30:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:18.476 02:30:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:18.476 02:30:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:20.384 02:30:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:20.385 00:19:20.385 real 0m10.700s 00:19:20.385 user 0m25.573s 00:19:20.385 sys 0m2.541s 00:19:20.385 02:30:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:20.385 02:30:45 -- common/autotest_common.sh@10 -- # set +x 00:19:20.385 ************************************ 00:19:20.385 END TEST nvmf_nmic 00:19:20.385 ************************************ 00:19:20.645 02:30:45 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:20.645 02:30:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:20.645 02:30:45 -- common/autotest_common.sh@10 -- # set +x 00:19:20.645 ************************************ 00:19:20.645 START TEST nvmf_fio_target 00:19:20.645 ************************************ 00:19:20.645 02:30:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:20.645 * Looking for test storage... 00:19:20.645 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:20.645 02:30:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:20.645 02:30:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:20.645 02:30:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:20.645 02:30:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:20.645 02:30:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:20.645 02:30:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:20.645 02:30:45 -- scripts/common.sh@335 -- # IFS=.-: 00:19:20.645 02:30:45 -- scripts/common.sh@335 -- # read -ra ver1 00:19:20.645 02:30:45 -- scripts/common.sh@336 -- # IFS=.-: 00:19:20.645 02:30:45 -- scripts/common.sh@336 -- # read -ra ver2 00:19:20.645 02:30:45 -- scripts/common.sh@337 -- # local 'op=<' 00:19:20.645 02:30:45 -- scripts/common.sh@339 -- # ver1_l=2 00:19:20.645 02:30:45 -- scripts/common.sh@340 -- # ver2_l=1 00:19:20.645 02:30:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:20.645 02:30:45 -- scripts/common.sh@343 -- # case "$op" in 00:19:20.645 02:30:45 -- scripts/common.sh@344 -- # : 1 00:19:20.645 02:30:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:20.645 02:30:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:20.645 02:30:45 -- scripts/common.sh@364 -- # decimal 1 00:19:20.645 02:30:45 -- scripts/common.sh@352 -- # local d=1 00:19:20.645 02:30:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:20.645 02:30:45 -- scripts/common.sh@354 -- # echo 1 00:19:20.645 02:30:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:20.645 02:30:45 -- scripts/common.sh@365 -- # decimal 2 00:19:20.645 02:30:45 -- scripts/common.sh@352 -- # local d=2 00:19:20.645 02:30:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:20.645 02:30:45 -- scripts/common.sh@354 -- # echo 2 00:19:20.645 02:30:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:20.645 02:30:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:20.645 02:30:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:20.645 02:30:45 -- scripts/common.sh@367 -- # return 0 00:19:20.645 02:30:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:20.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:20.645 --rc genhtml_branch_coverage=1 00:19:20.645 --rc genhtml_function_coverage=1 00:19:20.645 --rc genhtml_legend=1 00:19:20.645 --rc geninfo_all_blocks=1 00:19:20.645 --rc geninfo_unexecuted_blocks=1 00:19:20.645 00:19:20.645 ' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:20.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:20.645 --rc genhtml_branch_coverage=1 00:19:20.645 --rc genhtml_function_coverage=1 00:19:20.645 --rc genhtml_legend=1 00:19:20.645 --rc geninfo_all_blocks=1 00:19:20.645 --rc geninfo_unexecuted_blocks=1 00:19:20.645 00:19:20.645 ' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:20.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:20.645 --rc genhtml_branch_coverage=1 00:19:20.645 --rc genhtml_function_coverage=1 00:19:20.645 --rc genhtml_legend=1 00:19:20.645 --rc geninfo_all_blocks=1 00:19:20.645 --rc geninfo_unexecuted_blocks=1 00:19:20.645 00:19:20.645 ' 00:19:20.645 02:30:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:20.645 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:20.645 --rc genhtml_branch_coverage=1 00:19:20.645 --rc genhtml_function_coverage=1 00:19:20.645 --rc genhtml_legend=1 00:19:20.645 --rc geninfo_all_blocks=1 00:19:20.645 --rc geninfo_unexecuted_blocks=1 00:19:20.645 00:19:20.645 ' 00:19:20.645 02:30:45 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:20.645 02:30:45 -- nvmf/common.sh@7 -- # uname -s 00:19:20.645 02:30:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:20.645 02:30:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:20.645 02:30:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:20.645 02:30:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:20.645 02:30:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:20.645 02:30:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:20.645 02:30:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:20.645 02:30:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:20.645 02:30:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:20.645 02:30:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:20.645 02:30:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:20.645 02:30:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:20.645 02:30:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:20.645 02:30:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:20.645 02:30:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:20.645 02:30:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:20.645 02:30:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:20.645 02:30:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:20.645 02:30:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:20.645 02:30:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:20.645 02:30:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:20.645 02:30:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:20.645 02:30:45 -- paths/export.sh@5 -- # export PATH 00:19:20.645 02:30:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:20.645 02:30:45 -- nvmf/common.sh@46 -- # : 0 00:19:20.645 02:30:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:20.645 02:30:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:20.645 02:30:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:20.645 02:30:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:20.645 02:30:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:20.645 02:30:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:20.645 02:30:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:20.645 02:30:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:20.645 02:30:45 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:20.645 02:30:45 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:20.645 02:30:45 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:20.645 02:30:45 -- target/fio.sh@16 -- # nvmftestinit 00:19:20.645 02:30:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:20.645 02:30:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:20.645 02:30:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:20.645 02:30:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:20.645 02:30:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:20.645 02:30:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:20.645 02:30:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:20.645 02:30:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:20.645 02:30:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:20.645 02:30:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:20.645 02:30:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:20.645 02:30:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.179 02:30:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:23.179 02:30:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:23.179 02:30:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:23.179 02:30:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:23.179 02:30:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:23.179 02:30:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:23.179 02:30:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:23.179 02:30:47 -- nvmf/common.sh@294 -- # net_devs=() 00:19:23.179 02:30:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:23.179 02:30:47 -- nvmf/common.sh@295 -- # e810=() 00:19:23.179 02:30:47 -- nvmf/common.sh@295 -- # local -ga e810 00:19:23.179 02:30:47 -- nvmf/common.sh@296 -- # x722=() 00:19:23.179 02:30:47 -- nvmf/common.sh@296 -- # local -ga x722 00:19:23.179 02:30:47 -- nvmf/common.sh@297 -- # mlx=() 00:19:23.179 02:30:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:23.179 02:30:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:23.179 02:30:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:23.179 02:30:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:23.179 02:30:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.179 02:30:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:23.179 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:23.179 02:30:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.179 02:30:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:23.179 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:23.179 02:30:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.179 02:30:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.179 02:30:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.179 02:30:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:23.179 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:23.179 02:30:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.179 02:30:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.179 02:30:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.179 02:30:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.179 02:30:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:23.179 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:23.179 02:30:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.179 02:30:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:23.179 02:30:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:23.179 02:30:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:23.179 02:30:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:23.179 02:30:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:23.179 02:30:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:23.179 02:30:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:23.179 02:30:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:23.179 02:30:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:23.179 02:30:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:23.179 02:30:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:23.179 02:30:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:23.179 02:30:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:23.179 02:30:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:23.179 02:30:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:23.179 02:30:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:23.179 02:30:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:23.179 02:30:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:23.180 02:30:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:23.180 02:30:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:23.180 02:30:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:23.180 02:30:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:23.180 02:30:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:23.180 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:23.180 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:19:23.180 00:19:23.180 --- 10.0.0.2 ping statistics --- 00:19:23.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.180 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:19:23.180 02:30:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:23.180 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:23.180 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:19:23.180 00:19:23.180 --- 10.0.0.1 ping statistics --- 00:19:23.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.180 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:19:23.180 02:30:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:23.180 02:30:47 -- nvmf/common.sh@410 -- # return 0 00:19:23.180 02:30:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:23.180 02:30:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:23.180 02:30:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:23.180 02:30:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:23.180 02:30:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:23.180 02:30:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:23.180 02:30:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:23.180 02:30:47 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:23.180 02:30:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:23.180 02:30:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:23.180 02:30:47 -- common/autotest_common.sh@10 -- # set +x 00:19:23.180 02:30:47 -- nvmf/common.sh@469 -- # nvmfpid=2085746 00:19:23.180 02:30:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:23.180 02:30:47 -- nvmf/common.sh@470 -- # waitforlisten 2085746 00:19:23.180 02:30:47 -- common/autotest_common.sh@829 -- # '[' -z 2085746 ']' 00:19:23.180 02:30:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:23.180 02:30:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:23.180 02:30:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:23.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:23.180 02:30:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:23.180 02:30:47 -- common/autotest_common.sh@10 -- # set +x 00:19:23.180 [2024-11-27 02:30:47.415939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:23.180 [2024-11-27 02:30:47.416002] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:23.180 EAL: No free 2048 kB hugepages reported on node 1 00:19:23.180 [2024-11-27 02:30:47.488476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:23.180 [2024-11-27 02:30:47.582696] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:23.180 [2024-11-27 02:30:47.582856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:23.180 [2024-11-27 02:30:47.582875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:23.180 [2024-11-27 02:30:47.582888] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:23.180 [2024-11-27 02:30:47.582948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:23.180 [2024-11-27 02:30:47.583020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:23.180 [2024-11-27 02:30:47.583071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:23.180 [2024-11-27 02:30:47.583074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:24.117 02:30:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:24.117 02:30:48 -- common/autotest_common.sh@862 -- # return 0 00:19:24.117 02:30:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:24.117 02:30:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:24.117 02:30:48 -- common/autotest_common.sh@10 -- # set +x 00:19:24.117 02:30:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:24.117 02:30:48 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:24.117 [2024-11-27 02:30:48.660174] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:24.117 02:30:48 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:24.375 02:30:48 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:24.375 02:30:48 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:24.633 02:30:49 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:24.633 02:30:49 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:24.891 02:30:49 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:24.891 02:30:49 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:25.149 02:30:49 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:25.149 02:30:49 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:25.414 02:30:50 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:25.764 02:30:50 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:25.764 02:30:50 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:26.023 02:30:50 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:26.023 02:30:50 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:26.281 02:30:50 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:26.281 02:30:50 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:26.539 02:30:51 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:26.797 02:30:51 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:26.797 02:30:51 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:27.056 02:30:51 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:27.056 02:30:51 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:27.315 02:30:51 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:27.573 [2024-11-27 02:30:52.067201] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:27.573 02:30:52 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:27.832 02:30:52 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:28.090 02:30:52 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:28.658 02:30:53 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:28.658 02:30:53 -- common/autotest_common.sh@1187 -- # local i=0 00:19:28.658 02:30:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:28.658 02:30:53 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:28.658 02:30:53 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:28.658 02:30:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:30.568 02:30:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:30.568 02:30:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:30.568 02:30:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:30.568 02:30:55 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:30.568 02:30:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:30.568 02:30:55 -- common/autotest_common.sh@1197 -- # return 0 00:19:30.568 02:30:55 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:30.827 [global] 00:19:30.827 thread=1 00:19:30.827 invalidate=1 00:19:30.827 rw=write 00:19:30.827 time_based=1 00:19:30.827 runtime=1 00:19:30.827 ioengine=libaio 00:19:30.827 direct=1 00:19:30.827 bs=4096 00:19:30.827 iodepth=1 00:19:30.827 norandommap=0 00:19:30.827 numjobs=1 00:19:30.827 00:19:30.827 verify_dump=1 00:19:30.827 verify_backlog=512 00:19:30.827 verify_state_save=0 00:19:30.827 do_verify=1 00:19:30.827 verify=crc32c-intel 00:19:30.827 [job0] 00:19:30.827 filename=/dev/nvme0n1 00:19:30.827 [job1] 00:19:30.827 filename=/dev/nvme0n2 00:19:30.827 [job2] 00:19:30.827 filename=/dev/nvme0n3 00:19:30.827 [job3] 00:19:30.827 filename=/dev/nvme0n4 00:19:30.827 Could not set queue depth (nvme0n1) 00:19:30.827 Could not set queue depth (nvme0n2) 00:19:30.827 Could not set queue depth (nvme0n3) 00:19:30.827 Could not set queue depth (nvme0n4) 00:19:30.827 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:30.827 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:30.827 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:30.827 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:30.827 fio-3.35 00:19:30.827 Starting 4 threads 00:19:32.203 00:19:32.203 job0: (groupid=0, jobs=1): err= 0: pid=2086980: Wed Nov 27 02:30:56 2024 00:19:32.203 read: IOPS=1001, BW=4008KiB/s (4104kB/s)(4112KiB/1026msec) 00:19:32.203 slat (nsec): min=5644, max=66956, avg=12985.82, stdev=6046.33 00:19:32.203 clat (usec): min=187, max=41122, avg=643.38, stdev=4000.46 00:19:32.203 lat (usec): min=194, max=41132, avg=656.37, stdev=4001.61 00:19:32.203 clat percentiles (usec): 00:19:32.203 | 1.00th=[ 202], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 229], 00:19:32.203 | 30.00th=[ 237], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 253], 00:19:32.203 | 70.00th=[ 258], 80.00th=[ 265], 90.00th=[ 273], 95.00th=[ 281], 00:19:32.203 | 99.00th=[ 824], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:32.203 | 99.99th=[41157] 00:19:32.203 write: IOPS=1497, BW=5988KiB/s (6132kB/s)(6144KiB/1026msec); 0 zone resets 00:19:32.203 slat (usec): min=9, max=26652, avg=36.49, stdev=680.08 00:19:32.203 clat (usec): min=136, max=1091, avg=184.52, stdev=37.17 00:19:32.203 lat (usec): min=147, max=26890, avg=221.01, stdev=682.68 00:19:32.203 clat percentiles (usec): 00:19:32.203 | 1.00th=[ 143], 5.00th=[ 149], 10.00th=[ 153], 20.00th=[ 159], 00:19:32.203 | 30.00th=[ 167], 40.00th=[ 174], 50.00th=[ 180], 60.00th=[ 188], 00:19:32.203 | 70.00th=[ 196], 80.00th=[ 208], 90.00th=[ 221], 95.00th=[ 229], 00:19:32.203 | 99.00th=[ 247], 99.50th=[ 265], 99.90th=[ 652], 99.95th=[ 1090], 00:19:32.203 | 99.99th=[ 1090] 00:19:32.203 bw ( KiB/s): min= 4087, max= 8192, per=30.47%, avg=6139.50, stdev=2902.67, samples=2 00:19:32.203 iops : min= 1021, max= 2048, avg=1534.50, stdev=726.20, samples=2 00:19:32.203 lat (usec) : 250=81.75%, 500=17.71%, 750=0.08%, 1000=0.04% 00:19:32.203 lat (msec) : 2=0.04%, 50=0.39% 00:19:32.203 cpu : usr=3.32%, sys=5.07%, ctx=2568, majf=0, minf=1 00:19:32.203 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:32.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.203 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.203 issued rwts: total=1028,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.203 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:32.203 job1: (groupid=0, jobs=1): err= 0: pid=2086981: Wed Nov 27 02:30:56 2024 00:19:32.203 read: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec) 00:19:32.203 slat (nsec): min=4304, max=58159, avg=10773.16, stdev=5475.30 00:19:32.203 clat (usec): min=156, max=487, avg=198.74, stdev=33.59 00:19:32.203 lat (usec): min=161, max=500, avg=209.52, stdev=35.32 00:19:32.203 clat percentiles (usec): 00:19:32.203 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 178], 00:19:32.203 | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 192], 00:19:32.203 | 70.00th=[ 198], 80.00th=[ 210], 90.00th=[ 247], 95.00th=[ 265], 00:19:32.203 | 99.00th=[ 314], 99.50th=[ 408], 99.90th=[ 445], 99.95th=[ 453], 00:19:32.203 | 99.99th=[ 486] 00:19:32.203 write: IOPS=2640, BW=10.3MiB/s (10.8MB/s)(10.3MiB/1001msec); 0 zone resets 00:19:32.203 slat (nsec): min=5538, max=45956, avg=12771.28, stdev=5355.34 00:19:32.203 clat (usec): min=120, max=757, avg=155.72, stdev=33.90 00:19:32.203 lat (usec): min=129, max=774, avg=168.50, stdev=36.15 00:19:32.203 clat percentiles (usec): 00:19:32.203 | 1.00th=[ 126], 5.00th=[ 130], 10.00th=[ 133], 20.00th=[ 137], 00:19:32.203 | 30.00th=[ 141], 40.00th=[ 143], 50.00th=[ 147], 60.00th=[ 151], 00:19:32.203 | 70.00th=[ 157], 80.00th=[ 165], 90.00th=[ 198], 95.00th=[ 223], 00:19:32.203 | 99.00th=[ 247], 99.50th=[ 281], 99.90th=[ 506], 99.95th=[ 570], 00:19:32.203 | 99.99th=[ 758] 00:19:32.203 bw ( KiB/s): min=12263, max=12263, per=60.87%, avg=12263.00, stdev= 0.00, samples=1 00:19:32.203 iops : min= 3065, max= 3065, avg=3065.00, stdev= 0.00, samples=1 00:19:32.203 lat (usec) : 250=95.46%, 500=4.48%, 750=0.04%, 1000=0.02% 00:19:32.203 cpu : usr=3.50%, sys=6.40%, ctx=5203, majf=0, minf=2 00:19:32.203 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:32.204 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 issued rwts: total=2560,2643,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.204 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:32.204 job2: (groupid=0, jobs=1): err= 0: pid=2086982: Wed Nov 27 02:30:56 2024 00:19:32.204 read: IOPS=23, BW=92.9KiB/s (95.2kB/s)(96.0KiB/1033msec) 00:19:32.204 slat (nsec): min=10146, max=35169, avg=22515.58, stdev=9122.49 00:19:32.204 clat (usec): min=316, max=41208, avg=37551.30, stdev=11464.19 00:19:32.204 lat (usec): min=335, max=41223, avg=37573.81, stdev=11465.79 00:19:32.204 clat percentiles (usec): 00:19:32.204 | 1.00th=[ 318], 5.00th=[ 347], 10.00th=[40633], 20.00th=[40633], 00:19:32.204 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:32.204 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:32.204 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:32.204 | 99.99th=[41157] 00:19:32.204 write: IOPS=495, BW=1983KiB/s (2030kB/s)(2048KiB/1033msec); 0 zone resets 00:19:32.204 slat (nsec): min=8100, max=56481, avg=18312.54, stdev=5797.87 00:19:32.204 clat (usec): min=160, max=372, avg=232.81, stdev=31.73 00:19:32.204 lat (usec): min=183, max=390, avg=251.12, stdev=31.14 00:19:32.204 clat percentiles (usec): 00:19:32.204 | 1.00th=[ 172], 5.00th=[ 188], 10.00th=[ 198], 20.00th=[ 208], 00:19:32.204 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 239], 00:19:32.204 | 70.00th=[ 243], 80.00th=[ 251], 90.00th=[ 269], 95.00th=[ 285], 00:19:32.204 | 99.00th=[ 343], 99.50th=[ 355], 99.90th=[ 371], 99.95th=[ 371], 00:19:32.204 | 99.99th=[ 371] 00:19:32.204 bw ( KiB/s): min= 4087, max= 4087, per=20.29%, avg=4087.00, stdev= 0.00, samples=1 00:19:32.204 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:32.204 lat (usec) : 250=74.81%, 500=21.08% 00:19:32.204 lat (msec) : 50=4.10% 00:19:32.204 cpu : usr=0.68%, sys=0.68%, ctx=537, majf=0, minf=1 00:19:32.204 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:32.204 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.204 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:32.204 job3: (groupid=0, jobs=1): err= 0: pid=2086983: Wed Nov 27 02:30:56 2024 00:19:32.204 read: IOPS=25, BW=104KiB/s (106kB/s)(104KiB/1001msec) 00:19:32.204 slat (nsec): min=7882, max=34378, avg=21788.04, stdev=9559.74 00:19:32.204 clat (usec): min=218, max=42004, avg=33333.16, stdev=15504.14 00:19:32.204 lat (usec): min=236, max=42022, avg=33354.95, stdev=15507.38 00:19:32.204 clat percentiles (usec): 00:19:32.204 | 1.00th=[ 219], 5.00th=[ 293], 10.00th=[ 347], 20.00th=[31065], 00:19:32.204 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:32.204 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:19:32.204 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:32.204 | 99.99th=[42206] 00:19:32.204 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:32.204 slat (nsec): min=8757, max=41227, avg=18739.59, stdev=6429.56 00:19:32.204 clat (usec): min=160, max=420, avg=238.21, stdev=41.04 00:19:32.204 lat (usec): min=180, max=455, avg=256.95, stdev=43.27 00:19:32.204 clat percentiles (usec): 00:19:32.204 | 1.00th=[ 178], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 212], 00:19:32.204 | 30.00th=[ 219], 40.00th=[ 227], 50.00th=[ 233], 60.00th=[ 237], 00:19:32.204 | 70.00th=[ 243], 80.00th=[ 255], 90.00th=[ 273], 95.00th=[ 322], 00:19:32.204 | 99.00th=[ 408], 99.50th=[ 412], 99.90th=[ 420], 99.95th=[ 420], 00:19:32.204 | 99.99th=[ 420] 00:19:32.204 bw ( KiB/s): min= 4087, max= 4087, per=20.29%, avg=4087.00, stdev= 0.00, samples=1 00:19:32.204 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:19:32.204 lat (usec) : 250=72.86%, 500=23.05% 00:19:32.204 lat (msec) : 20=0.19%, 50=3.90% 00:19:32.204 cpu : usr=0.70%, sys=0.70%, ctx=538, majf=0, minf=1 00:19:32.204 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:32.204 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:32.204 issued rwts: total=26,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:32.204 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:32.204 00:19:32.204 Run status group 0 (all jobs): 00:19:32.204 READ: bw=13.8MiB/s (14.4MB/s), 92.9KiB/s-9.99MiB/s (95.2kB/s-10.5MB/s), io=14.2MiB (14.9MB), run=1001-1033msec 00:19:32.204 WRITE: bw=19.7MiB/s (20.6MB/s), 1983KiB/s-10.3MiB/s (2030kB/s-10.8MB/s), io=20.3MiB (21.3MB), run=1001-1033msec 00:19:32.204 00:19:32.204 Disk stats (read/write): 00:19:32.204 nvme0n1: ios=1070/1456, merge=0/0, ticks=592/250, in_queue=842, util=86.27% 00:19:32.204 nvme0n2: ios=2098/2289, merge=0/0, ticks=485/355, in_queue=840, util=90.64% 00:19:32.204 nvme0n3: ios=75/512, merge=0/0, ticks=1157/117, in_queue=1274, util=93.50% 00:19:32.204 nvme0n4: ios=78/512, merge=0/0, ticks=783/118, in_queue=901, util=95.78% 00:19:32.204 02:30:56 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:32.204 [global] 00:19:32.204 thread=1 00:19:32.204 invalidate=1 00:19:32.204 rw=randwrite 00:19:32.204 time_based=1 00:19:32.204 runtime=1 00:19:32.204 ioengine=libaio 00:19:32.204 direct=1 00:19:32.204 bs=4096 00:19:32.204 iodepth=1 00:19:32.204 norandommap=0 00:19:32.204 numjobs=1 00:19:32.204 00:19:32.204 verify_dump=1 00:19:32.204 verify_backlog=512 00:19:32.204 verify_state_save=0 00:19:32.204 do_verify=1 00:19:32.204 verify=crc32c-intel 00:19:32.204 [job0] 00:19:32.204 filename=/dev/nvme0n1 00:19:32.204 [job1] 00:19:32.204 filename=/dev/nvme0n2 00:19:32.204 [job2] 00:19:32.204 filename=/dev/nvme0n3 00:19:32.204 [job3] 00:19:32.204 filename=/dev/nvme0n4 00:19:32.204 Could not set queue depth (nvme0n1) 00:19:32.204 Could not set queue depth (nvme0n2) 00:19:32.204 Could not set queue depth (nvme0n3) 00:19:32.204 Could not set queue depth (nvme0n4) 00:19:32.462 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.462 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.462 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.462 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.462 fio-3.35 00:19:32.462 Starting 4 threads 00:19:33.843 00:19:33.843 job0: (groupid=0, jobs=1): err= 0: pid=2087215: Wed Nov 27 02:30:58 2024 00:19:33.843 read: IOPS=21, BW=86.1KiB/s (88.2kB/s)(88.0KiB/1022msec) 00:19:33.843 slat (nsec): min=5784, max=32697, avg=21946.05, stdev=9605.41 00:19:33.843 clat (usec): min=40836, max=42045, avg=41423.06, stdev=512.50 00:19:33.843 lat (usec): min=40848, max=42077, avg=41445.01, stdev=513.35 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:33.843 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:33.843 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:33.843 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:33.843 | 99.99th=[42206] 00:19:33.843 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:19:33.843 slat (nsec): min=5351, max=25260, avg=7198.24, stdev=2166.14 00:19:33.843 clat (usec): min=150, max=1188, avg=204.48, stdev=70.59 00:19:33.843 lat (usec): min=156, max=1195, avg=211.68, stdev=70.86 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 167], 20.00th=[ 174], 00:19:33.843 | 30.00th=[ 180], 40.00th=[ 186], 50.00th=[ 190], 60.00th=[ 194], 00:19:33.843 | 70.00th=[ 200], 80.00th=[ 219], 90.00th=[ 247], 95.00th=[ 260], 00:19:33.843 | 99.00th=[ 420], 99.50th=[ 742], 99.90th=[ 1188], 99.95th=[ 1188], 00:19:33.843 | 99.99th=[ 1188] 00:19:33.843 bw ( KiB/s): min= 4096, max= 4096, per=51.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.843 lat (usec) : 250=88.95%, 500=6.18%, 750=0.37%, 1000=0.19% 00:19:33.843 lat (msec) : 2=0.19%, 50=4.12% 00:19:33.843 cpu : usr=0.10%, sys=0.39%, ctx=534, majf=0, minf=2 00:19:33.843 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.843 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.843 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.843 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.843 job1: (groupid=0, jobs=1): err= 0: pid=2087216: Wed Nov 27 02:30:58 2024 00:19:33.843 read: IOPS=42, BW=172KiB/s (176kB/s)(172KiB/1001msec) 00:19:33.843 slat (nsec): min=7478, max=33866, avg=22587.07, stdev=8646.94 00:19:33.843 clat (usec): min=227, max=41207, avg=21096.10, stdev=20526.58 00:19:33.843 lat (usec): min=235, max=41225, avg=21118.69, stdev=20521.54 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[ 229], 5.00th=[ 245], 10.00th=[ 249], 20.00th=[ 269], 00:19:33.843 | 30.00th=[ 351], 40.00th=[ 445], 50.00th=[40633], 60.00th=[40633], 00:19:33.843 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:33.843 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.843 | 99.99th=[41157] 00:19:33.843 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:33.843 slat (nsec): min=7171, max=27994, avg=8661.90, stdev=1946.22 00:19:33.843 clat (usec): min=137, max=269, avg=168.07, stdev=18.06 00:19:33.843 lat (usec): min=145, max=277, avg=176.73, stdev=18.33 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 153], 00:19:33.843 | 30.00th=[ 157], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 172], 00:19:33.843 | 70.00th=[ 176], 80.00th=[ 182], 90.00th=[ 192], 95.00th=[ 202], 00:19:33.843 | 99.00th=[ 221], 99.50th=[ 227], 99.90th=[ 269], 99.95th=[ 269], 00:19:33.843 | 99.99th=[ 269] 00:19:33.843 bw ( KiB/s): min= 4096, max= 4096, per=51.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.843 lat (usec) : 250=92.97%, 500=3.06% 00:19:33.843 lat (msec) : 50=3.96% 00:19:33.843 cpu : usr=0.20%, sys=0.80%, ctx=555, majf=0, minf=2 00:19:33.843 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.843 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.843 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.843 issued rwts: total=43,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.843 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.843 job2: (groupid=0, jobs=1): err= 0: pid=2087217: Wed Nov 27 02:30:58 2024 00:19:33.843 read: IOPS=21, BW=86.9KiB/s (89.0kB/s)(88.0KiB/1013msec) 00:19:33.843 slat (nsec): min=5744, max=45034, avg=23799.68, stdev=11042.49 00:19:33.843 clat (usec): min=40836, max=41079, avg=40959.72, stdev=59.95 00:19:33.843 lat (usec): min=40865, max=41092, avg=40983.52, stdev=58.37 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:33.843 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:33.843 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:33.843 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.843 | 99.99th=[41157] 00:19:33.843 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:19:33.843 slat (nsec): min=5870, max=33235, avg=7699.82, stdev=2449.83 00:19:33.843 clat (usec): min=128, max=393, avg=205.96, stdev=32.44 00:19:33.843 lat (usec): min=135, max=426, avg=213.66, stdev=33.04 00:19:33.843 clat percentiles (usec): 00:19:33.843 | 1.00th=[ 149], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 178], 00:19:33.843 | 30.00th=[ 186], 40.00th=[ 198], 50.00th=[ 208], 60.00th=[ 217], 00:19:33.843 | 70.00th=[ 223], 80.00th=[ 229], 90.00th=[ 237], 95.00th=[ 247], 00:19:33.843 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 392], 99.95th=[ 392], 00:19:33.843 | 99.99th=[ 392] 00:19:33.843 bw ( KiB/s): min= 4096, max= 4096, per=51.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.843 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.843 lat (usec) : 250=91.76%, 500=4.12% 00:19:33.843 lat (msec) : 50=4.12% 00:19:33.844 cpu : usr=0.20%, sys=0.30%, ctx=535, majf=0, minf=1 00:19:33.844 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.844 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.844 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.844 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.844 job3: (groupid=0, jobs=1): err= 0: pid=2087218: Wed Nov 27 02:30:58 2024 00:19:33.844 read: IOPS=22, BW=91.0KiB/s (93.2kB/s)(92.0KiB/1011msec) 00:19:33.844 slat (nsec): min=6542, max=35069, avg=20963.83, stdev=9750.43 00:19:33.844 clat (usec): min=420, max=41089, avg=39197.51, stdev=8453.38 00:19:33.844 lat (usec): min=426, max=41102, avg=39218.48, stdev=8456.53 00:19:33.844 clat percentiles (usec): 00:19:33.844 | 1.00th=[ 420], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:33.844 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:33.844 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:33.844 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.844 | 99.99th=[41157] 00:19:33.844 write: IOPS=506, BW=2026KiB/s (2074kB/s)(2048KiB/1011msec); 0 zone resets 00:19:33.844 slat (nsec): min=6820, max=29515, avg=8123.56, stdev=2031.11 00:19:33.844 clat (usec): min=148, max=284, avg=202.61, stdev=24.95 00:19:33.844 lat (usec): min=156, max=306, avg=210.74, stdev=24.97 00:19:33.844 clat percentiles (usec): 00:19:33.844 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 169], 20.00th=[ 178], 00:19:33.844 | 30.00th=[ 184], 40.00th=[ 194], 50.00th=[ 204], 60.00th=[ 212], 00:19:33.844 | 70.00th=[ 219], 80.00th=[ 227], 90.00th=[ 235], 95.00th=[ 241], 00:19:33.844 | 99.00th=[ 255], 99.50th=[ 265], 99.90th=[ 285], 99.95th=[ 285], 00:19:33.844 | 99.99th=[ 285] 00:19:33.844 bw ( KiB/s): min= 4096, max= 4096, per=51.10%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.844 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.844 lat (usec) : 250=93.64%, 500=2.24% 00:19:33.844 lat (msec) : 50=4.11% 00:19:33.844 cpu : usr=0.10%, sys=0.50%, ctx=537, majf=0, minf=1 00:19:33.844 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.844 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.844 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.844 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.844 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.844 00:19:33.844 Run status group 0 (all jobs): 00:19:33.844 READ: bw=431KiB/s (441kB/s), 86.1KiB/s-172KiB/s (88.2kB/s-176kB/s), io=440KiB (451kB), run=1001-1022msec 00:19:33.844 WRITE: bw=8016KiB/s (8208kB/s), 2004KiB/s-2046KiB/s (2052kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1022msec 00:19:33.844 00:19:33.844 Disk stats (read/write): 00:19:33.844 nvme0n1: ios=68/512, merge=0/0, ticks=774/105, in_queue=879, util=87.27% 00:19:33.844 nvme0n2: ios=81/512, merge=0/0, ticks=802/83, in_queue=885, util=91.07% 00:19:33.844 nvme0n3: ios=41/512, merge=0/0, ticks=1681/103, in_queue=1784, util=97.29% 00:19:33.844 nvme0n4: ios=72/512, merge=0/0, ticks=923/104, in_queue=1027, util=97.28% 00:19:33.844 02:30:58 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:33.844 [global] 00:19:33.844 thread=1 00:19:33.844 invalidate=1 00:19:33.844 rw=write 00:19:33.844 time_based=1 00:19:33.844 runtime=1 00:19:33.844 ioengine=libaio 00:19:33.844 direct=1 00:19:33.844 bs=4096 00:19:33.844 iodepth=128 00:19:33.844 norandommap=0 00:19:33.844 numjobs=1 00:19:33.844 00:19:33.844 verify_dump=1 00:19:33.844 verify_backlog=512 00:19:33.844 verify_state_save=0 00:19:33.844 do_verify=1 00:19:33.844 verify=crc32c-intel 00:19:33.844 [job0] 00:19:33.844 filename=/dev/nvme0n1 00:19:33.844 [job1] 00:19:33.844 filename=/dev/nvme0n2 00:19:33.844 [job2] 00:19:33.844 filename=/dev/nvme0n3 00:19:33.844 [job3] 00:19:33.844 filename=/dev/nvme0n4 00:19:33.844 Could not set queue depth (nvme0n1) 00:19:33.844 Could not set queue depth (nvme0n2) 00:19:33.844 Could not set queue depth (nvme0n3) 00:19:33.844 Could not set queue depth (nvme0n4) 00:19:33.844 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:33.844 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:33.844 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:33.844 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:33.844 fio-3.35 00:19:33.844 Starting 4 threads 00:19:35.217 00:19:35.217 job0: (groupid=0, jobs=1): err= 0: pid=2087451: Wed Nov 27 02:30:59 2024 00:19:35.217 read: IOPS=5570, BW=21.8MiB/s (22.8MB/s)(22.0MiB/1011msec) 00:19:35.217 slat (usec): min=2, max=10644, avg=90.75, stdev=640.24 00:19:35.217 clat (usec): min=3572, max=22630, avg=11445.78, stdev=3080.39 00:19:35.217 lat (usec): min=3945, max=22648, avg=11536.52, stdev=3114.02 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 4817], 5.00th=[ 7767], 10.00th=[ 8848], 20.00th=[ 9503], 00:19:35.217 | 30.00th=[ 9765], 40.00th=[10028], 50.00th=[10290], 60.00th=[10814], 00:19:35.217 | 70.00th=[12256], 80.00th=[13960], 90.00th=[15795], 95.00th=[18220], 00:19:35.217 | 99.00th=[20579], 99.50th=[21365], 99.90th=[22414], 99.95th=[22676], 00:19:35.217 | 99.99th=[22676] 00:19:35.217 write: IOPS=5972, BW=23.3MiB/s (24.5MB/s)(23.6MiB/1011msec); 0 zone resets 00:19:35.217 slat (usec): min=4, max=10510, avg=72.57, stdev=359.11 00:19:35.217 clat (usec): min=2707, max=22623, avg=10548.55, stdev=2603.91 00:19:35.217 lat (usec): min=2716, max=22638, avg=10621.12, stdev=2632.84 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 3359], 5.00th=[ 4883], 10.00th=[ 6456], 20.00th=[ 9110], 00:19:35.217 | 30.00th=[10028], 40.00th=[10945], 50.00th=[11338], 60.00th=[11469], 00:19:35.217 | 70.00th=[11731], 80.00th=[12125], 90.00th=[12649], 95.00th=[13042], 00:19:35.217 | 99.00th=[18220], 99.50th=[20317], 99.90th=[21890], 99.95th=[22414], 00:19:35.217 | 99.99th=[22676] 00:19:35.217 bw ( KiB/s): min=22712, max=24576, per=32.77%, avg=23644.00, stdev=1318.05, samples=2 00:19:35.217 iops : min= 5678, max= 6144, avg=5911.00, stdev=329.51, samples=2 00:19:35.217 lat (msec) : 4=1.37%, 10=33.73%, 20=63.58%, 50=1.32% 00:19:35.217 cpu : usr=7.43%, sys=9.21%, ctx=690, majf=0, minf=1 00:19:35.217 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:35.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:35.217 issued rwts: total=5632,6038,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.217 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:35.217 job1: (groupid=0, jobs=1): err= 0: pid=2087452: Wed Nov 27 02:30:59 2024 00:19:35.217 read: IOPS=3035, BW=11.9MiB/s (12.4MB/s)(12.0MiB/1012msec) 00:19:35.217 slat (usec): min=3, max=18133, avg=126.34, stdev=931.48 00:19:35.217 clat (usec): min=3958, max=52283, avg=14775.22, stdev=7202.22 00:19:35.217 lat (usec): min=4366, max=52298, avg=14901.56, stdev=7279.95 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 5735], 5.00th=[ 7832], 10.00th=[ 9241], 20.00th=[10290], 00:19:35.217 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11469], 00:19:35.217 | 70.00th=[15139], 80.00th=[20055], 90.00th=[25297], 95.00th=[32113], 00:19:35.217 | 99.00th=[34341], 99.50th=[34341], 99.90th=[38011], 99.95th=[51119], 00:19:35.217 | 99.99th=[52167] 00:19:35.217 write: IOPS=3468, BW=13.5MiB/s (14.2MB/s)(13.7MiB/1012msec); 0 zone resets 00:19:35.217 slat (usec): min=2, max=19885, avg=168.65, stdev=998.25 00:19:35.217 clat (usec): min=2556, max=64489, avg=23498.85, stdev=14437.56 00:19:35.217 lat (usec): min=2564, max=68700, avg=23667.51, stdev=14525.13 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 3425], 5.00th=[ 5997], 10.00th=[ 7635], 20.00th=[11338], 00:19:35.217 | 30.00th=[11731], 40.00th=[16909], 50.00th=[22676], 60.00th=[23725], 00:19:35.217 | 70.00th=[27395], 80.00th=[35390], 90.00th=[46924], 95.00th=[51119], 00:19:35.217 | 99.00th=[64226], 99.50th=[64226], 99.90th=[64226], 99.95th=[64750], 00:19:35.217 | 99.99th=[64750] 00:19:35.217 bw ( KiB/s): min=12288, max=14768, per=18.75%, avg=13528.00, stdev=1753.62, samples=2 00:19:35.217 iops : min= 3072, max= 3692, avg=3382.00, stdev=438.41, samples=2 00:19:35.217 lat (msec) : 4=1.05%, 10=13.93%, 20=46.00%, 50=36.02%, 100=2.99% 00:19:35.217 cpu : usr=2.57%, sys=4.35%, ctx=420, majf=0, minf=2 00:19:35.217 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:35.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:35.217 issued rwts: total=3072,3510,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.217 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:35.217 job2: (groupid=0, jobs=1): err= 0: pid=2087453: Wed Nov 27 02:30:59 2024 00:19:35.217 read: IOPS=3300, BW=12.9MiB/s (13.5MB/s)(13.0MiB/1007msec) 00:19:35.217 slat (usec): min=2, max=20368, avg=128.36, stdev=997.19 00:19:35.217 clat (usec): min=1746, max=44310, avg=15854.91, stdev=7357.24 00:19:35.217 lat (usec): min=1749, max=44323, avg=15983.27, stdev=7410.71 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 3654], 5.00th=[ 7504], 10.00th=[ 9896], 20.00th=[11600], 00:19:35.217 | 30.00th=[12518], 40.00th=[13042], 50.00th=[13173], 60.00th=[13698], 00:19:35.217 | 70.00th=[15401], 80.00th=[20055], 90.00th=[26870], 95.00th=[32375], 00:19:35.217 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[43779], 00:19:35.217 | 99.99th=[44303] 00:19:35.217 write: IOPS=3559, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1007msec); 0 zone resets 00:19:35.217 slat (usec): min=3, max=18036, avg=151.36, stdev=830.13 00:19:35.217 clat (usec): min=2231, max=58207, avg=20899.18, stdev=12761.75 00:19:35.217 lat (usec): min=2243, max=58212, avg=21050.54, stdev=12843.28 00:19:35.217 clat percentiles (usec): 00:19:35.217 | 1.00th=[ 4817], 5.00th=[ 7832], 10.00th=[11863], 20.00th=[12780], 00:19:35.217 | 30.00th=[13566], 40.00th=[13960], 50.00th=[15008], 60.00th=[20579], 00:19:35.217 | 70.00th=[23200], 80.00th=[23987], 90.00th=[41157], 95.00th=[56361], 00:19:35.217 | 99.00th=[57934], 99.50th=[57934], 99.90th=[58459], 99.95th=[58459], 00:19:35.217 | 99.99th=[58459] 00:19:35.217 bw ( KiB/s): min=13936, max=14736, per=19.87%, avg=14336.00, stdev=565.69, samples=2 00:19:35.217 iops : min= 3484, max= 3684, avg=3584.00, stdev=141.42, samples=2 00:19:35.217 lat (msec) : 2=0.04%, 4=1.29%, 10=8.29%, 20=58.60%, 50=28.24% 00:19:35.217 lat (msec) : 100=3.53% 00:19:35.217 cpu : usr=2.39%, sys=4.57%, ctx=386, majf=0, minf=1 00:19:35.217 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:35.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:35.218 issued rwts: total=3324,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.218 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:35.218 job3: (groupid=0, jobs=1): err= 0: pid=2087454: Wed Nov 27 02:30:59 2024 00:19:35.218 read: IOPS=4904, BW=19.2MiB/s (20.1MB/s)(19.3MiB/1007msec) 00:19:35.218 slat (usec): min=3, max=11849, avg=109.65, stdev=777.32 00:19:35.218 clat (usec): min=2532, max=24813, avg=13348.16, stdev=3720.29 00:19:35.218 lat (usec): min=3948, max=24828, avg=13457.81, stdev=3756.88 00:19:35.218 clat percentiles (usec): 00:19:35.218 | 1.00th=[ 4752], 5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[10552], 00:19:35.218 | 30.00th=[11207], 40.00th=[11863], 50.00th=[12256], 60.00th=[13042], 00:19:35.218 | 70.00th=[15139], 80.00th=[16450], 90.00th=[18482], 95.00th=[20579], 00:19:35.218 | 99.00th=[23200], 99.50th=[23987], 99.90th=[24511], 99.95th=[24773], 00:19:35.218 | 99.99th=[24773] 00:19:35.218 write: IOPS=5084, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1007msec); 0 zone resets 00:19:35.218 slat (usec): min=3, max=12404, avg=79.54, stdev=381.52 00:19:35.218 clat (usec): min=280, max=32730, avg=11970.60, stdev=3656.79 00:19:35.218 lat (usec): min=554, max=32737, avg=12050.14, stdev=3683.62 00:19:35.218 clat percentiles (usec): 00:19:35.218 | 1.00th=[ 2966], 5.00th=[ 5145], 10.00th=[ 6718], 20.00th=[ 9503], 00:19:35.218 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12518], 60.00th=[12649], 00:19:35.218 | 70.00th=[13042], 80.00th=[13698], 90.00th=[15139], 95.00th=[17433], 00:19:35.218 | 99.00th=[24773], 99.50th=[27919], 99.90th=[28443], 99.95th=[28443], 00:19:35.218 | 99.99th=[32637] 00:19:35.218 bw ( KiB/s): min=20480, max=20480, per=28.39%, avg=20480.00, stdev= 0.00, samples=2 00:19:35.218 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:19:35.218 lat (usec) : 500=0.01%, 750=0.04% 00:19:35.218 lat (msec) : 2=0.15%, 4=1.40%, 10=15.10%, 20=79.21%, 50=4.09% 00:19:35.218 cpu : usr=4.37%, sys=6.36%, ctx=624, majf=0, minf=1 00:19:35.218 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:35.218 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.218 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:35.218 issued rwts: total=4939,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.218 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:35.218 00:19:35.218 Run status group 0 (all jobs): 00:19:35.218 READ: bw=65.5MiB/s (68.7MB/s), 11.9MiB/s-21.8MiB/s (12.4MB/s-22.8MB/s), io=66.3MiB (69.5MB), run=1007-1012msec 00:19:35.218 WRITE: bw=70.5MiB/s (73.9MB/s), 13.5MiB/s-23.3MiB/s (14.2MB/s-24.5MB/s), io=71.3MiB (74.8MB), run=1007-1012msec 00:19:35.218 00:19:35.218 Disk stats (read/write): 00:19:35.218 nvme0n1: ios=4653/5120, merge=0/0, ticks=51347/52440, in_queue=103787, util=100.00% 00:19:35.218 nvme0n2: ios=2560/2911, merge=0/0, ticks=37272/56216, in_queue=93488, util=86.89% 00:19:35.218 nvme0n3: ios=3120/3103, merge=0/0, ticks=37847/52046, in_queue=89893, util=99.79% 00:19:35.218 nvme0n4: ios=4147/4343, merge=0/0, ticks=53831/49677, in_queue=103508, util=100.00% 00:19:35.218 02:30:59 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:35.218 [global] 00:19:35.218 thread=1 00:19:35.218 invalidate=1 00:19:35.218 rw=randwrite 00:19:35.218 time_based=1 00:19:35.218 runtime=1 00:19:35.218 ioengine=libaio 00:19:35.218 direct=1 00:19:35.218 bs=4096 00:19:35.218 iodepth=128 00:19:35.218 norandommap=0 00:19:35.218 numjobs=1 00:19:35.218 00:19:35.218 verify_dump=1 00:19:35.218 verify_backlog=512 00:19:35.218 verify_state_save=0 00:19:35.218 do_verify=1 00:19:35.218 verify=crc32c-intel 00:19:35.218 [job0] 00:19:35.218 filename=/dev/nvme0n1 00:19:35.218 [job1] 00:19:35.218 filename=/dev/nvme0n2 00:19:35.218 [job2] 00:19:35.218 filename=/dev/nvme0n3 00:19:35.218 [job3] 00:19:35.218 filename=/dev/nvme0n4 00:19:35.218 Could not set queue depth (nvme0n1) 00:19:35.218 Could not set queue depth (nvme0n2) 00:19:35.218 Could not set queue depth (nvme0n3) 00:19:35.218 Could not set queue depth (nvme0n4) 00:19:35.477 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:35.477 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:35.477 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:35.477 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:35.477 fio-3.35 00:19:35.477 Starting 4 threads 00:19:36.853 00:19:36.853 job0: (groupid=0, jobs=1): err= 0: pid=2087810: Wed Nov 27 02:31:01 2024 00:19:36.853 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:19:36.853 slat (nsec): min=1974, max=17933k, avg=154351.84, stdev=905565.38 00:19:36.853 clat (usec): min=7972, max=75772, avg=19951.30, stdev=14017.14 00:19:36.853 lat (usec): min=8039, max=75777, avg=20105.65, stdev=14093.44 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 8455], 5.00th=[ 9241], 10.00th=[10290], 20.00th=[10683], 00:19:36.853 | 30.00th=[10814], 40.00th=[10945], 50.00th=[11338], 60.00th=[19792], 00:19:36.853 | 70.00th=[22938], 80.00th=[29230], 90.00th=[39584], 95.00th=[45876], 00:19:36.853 | 99.00th=[72877], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], 00:19:36.853 | 99.99th=[76022] 00:19:36.853 write: IOPS=3868, BW=15.1MiB/s (15.8MB/s)(15.2MiB/1006msec); 0 zone resets 00:19:36.853 slat (usec): min=2, max=7007, avg=109.54, stdev=574.15 00:19:36.853 clat (usec): min=2089, max=34249, avg=14310.40, stdev=5178.67 00:19:36.853 lat (usec): min=5679, max=34264, avg=14419.94, stdev=5188.37 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 8094], 5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[10683], 00:19:36.853 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11469], 60.00th=[14484], 00:19:36.853 | 70.00th=[16057], 80.00th=[19792], 90.00th=[22414], 95.00th=[23200], 00:19:36.853 | 99.00th=[31065], 99.50th=[33817], 99.90th=[34341], 99.95th=[34341], 00:19:36.853 | 99.99th=[34341] 00:19:36.853 bw ( KiB/s): min= 9632, max=20480, per=25.09%, avg=15056.00, stdev=7670.69, samples=2 00:19:36.853 iops : min= 2408, max= 5120, avg=3764.00, stdev=1917.67, samples=2 00:19:36.853 lat (msec) : 4=0.01%, 10=9.80%, 20=61.50%, 50=26.74%, 100=1.94% 00:19:36.853 cpu : usr=2.79%, sys=4.18%, ctx=402, majf=0, minf=2 00:19:36.853 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:36.853 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.853 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.853 issued rwts: total=3584,3892,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.853 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.853 job1: (groupid=0, jobs=1): err= 0: pid=2087813: Wed Nov 27 02:31:01 2024 00:19:36.853 read: IOPS=3032, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1013msec) 00:19:36.853 slat (nsec): min=1970, max=15136k, avg=128367.39, stdev=965724.34 00:19:36.853 clat (usec): min=4353, max=59731, avg=16309.87, stdev=10627.56 00:19:36.853 lat (usec): min=4356, max=59736, avg=16438.23, stdev=10702.10 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 5473], 5.00th=[ 9503], 10.00th=[ 9503], 20.00th=[ 9765], 00:19:36.853 | 30.00th=[10814], 40.00th=[11338], 50.00th=[12387], 60.00th=[13435], 00:19:36.853 | 70.00th=[15664], 80.00th=[19006], 90.00th=[27132], 95.00th=[43254], 00:19:36.853 | 99.00th=[59507], 99.50th=[59507], 99.90th=[59507], 99.95th=[59507], 00:19:36.853 | 99.99th=[59507] 00:19:36.853 write: IOPS=3488, BW=13.6MiB/s (14.3MB/s)(13.8MiB/1013msec); 0 zone resets 00:19:36.853 slat (usec): min=2, max=13277, avg=153.80, stdev=821.55 00:19:36.853 clat (usec): min=1428, max=54507, avg=22189.24, stdev=13778.02 00:19:36.853 lat (usec): min=1433, max=54513, avg=22343.05, stdev=13866.83 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 2606], 5.00th=[ 5735], 10.00th=[ 8979], 20.00th=[10159], 00:19:36.853 | 30.00th=[11863], 40.00th=[15139], 50.00th=[17695], 60.00th=[19792], 00:19:36.853 | 70.00th=[28181], 80.00th=[39060], 90.00th=[43254], 95.00th=[47449], 00:19:36.853 | 99.00th=[53216], 99.50th=[53216], 99.90th=[54264], 99.95th=[54264], 00:19:36.853 | 99.99th=[54264] 00:19:36.853 bw ( KiB/s): min=10872, max=16384, per=22.71%, avg=13628.00, stdev=3897.57, samples=2 00:19:36.853 iops : min= 2718, max= 4096, avg=3407.00, stdev=974.39, samples=2 00:19:36.853 lat (msec) : 2=0.42%, 4=0.45%, 10=18.60%, 20=52.72%, 50=24.04% 00:19:36.853 lat (msec) : 100=3.75% 00:19:36.853 cpu : usr=1.78%, sys=3.36%, ctx=315, majf=0, minf=1 00:19:36.853 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:36.853 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.853 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.853 issued rwts: total=3072,3534,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.853 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.853 job2: (groupid=0, jobs=1): err= 0: pid=2087814: Wed Nov 27 02:31:01 2024 00:19:36.853 read: IOPS=4724, BW=18.5MiB/s (19.4MB/s)(18.5MiB/1002msec) 00:19:36.853 slat (usec): min=2, max=10767, avg=96.66, stdev=633.21 00:19:36.853 clat (usec): min=991, max=28812, avg=11691.64, stdev=3775.73 00:19:36.853 lat (usec): min=3223, max=28817, avg=11788.30, stdev=3809.11 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 5342], 5.00th=[ 6980], 10.00th=[ 8160], 20.00th=[ 9110], 00:19:36.853 | 30.00th=[ 9503], 40.00th=[10290], 50.00th=[10683], 60.00th=[11469], 00:19:36.853 | 70.00th=[12125], 80.00th=[14222], 90.00th=[16909], 95.00th=[19268], 00:19:36.853 | 99.00th=[25035], 99.50th=[27395], 99.90th=[28705], 99.95th=[28705], 00:19:36.853 | 99.99th=[28705] 00:19:36.853 write: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec); 0 zone resets 00:19:36.853 slat (usec): min=4, max=9868, avg=98.04, stdev=515.68 00:19:36.853 clat (usec): min=2889, max=55025, avg=13987.50, stdev=9530.24 00:19:36.853 lat (usec): min=2896, max=55038, avg=14085.54, stdev=9587.19 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[ 3425], 5.00th=[ 5407], 10.00th=[ 6194], 20.00th=[ 9634], 00:19:36.853 | 30.00th=[10421], 40.00th=[10683], 50.00th=[11207], 60.00th=[12387], 00:19:36.853 | 70.00th=[12911], 80.00th=[14615], 90.00th=[20841], 95.00th=[38536], 00:19:36.853 | 99.00th=[52691], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], 00:19:36.853 | 99.99th=[54789] 00:19:36.853 bw ( KiB/s): min=19056, max=21896, per=34.12%, avg=20476.00, stdev=2008.18, samples=2 00:19:36.853 iops : min= 4764, max= 5474, avg=5119.00, stdev=502.05, samples=2 00:19:36.853 lat (usec) : 1000=0.01% 00:19:36.853 lat (msec) : 4=1.15%, 10=26.13%, 20=65.36%, 50=6.63%, 100=0.72% 00:19:36.853 cpu : usr=6.19%, sys=7.19%, ctx=593, majf=0, minf=1 00:19:36.853 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:36.853 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.853 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.853 issued rwts: total=4734,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.853 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.853 job3: (groupid=0, jobs=1): err= 0: pid=2087815: Wed Nov 27 02:31:01 2024 00:19:36.853 read: IOPS=2539, BW=9.92MiB/s (10.4MB/s)(10.0MiB/1008msec) 00:19:36.853 slat (usec): min=2, max=12602, avg=166.55, stdev=889.49 00:19:36.853 clat (usec): min=10585, max=74841, avg=21540.39, stdev=7496.12 00:19:36.853 lat (usec): min=10588, max=85677, avg=21706.94, stdev=7563.93 00:19:36.853 clat percentiles (usec): 00:19:36.853 | 1.00th=[12649], 5.00th=[14615], 10.00th=[14746], 20.00th=[16712], 00:19:36.853 | 30.00th=[17433], 40.00th=[19268], 50.00th=[20055], 60.00th=[21365], 00:19:36.853 | 70.00th=[22676], 80.00th=[25035], 90.00th=[28181], 95.00th=[30802], 00:19:36.853 | 99.00th=[58459], 99.50th=[69731], 99.90th=[74974], 99.95th=[74974], 00:19:36.853 | 99.99th=[74974] 00:19:36.853 write: IOPS=2628, BW=10.3MiB/s (10.8MB/s)(10.4MiB/1008msec); 0 zone resets 00:19:36.853 slat (usec): min=3, max=26712, avg=210.81, stdev=1314.04 00:19:36.853 clat (usec): min=6701, max=84213, avg=26735.77, stdev=14727.05 00:19:36.853 lat (usec): min=7792, max=84218, avg=26946.58, stdev=14833.76 00:19:36.853 clat percentiles (usec): 00:19:36.854 | 1.00th=[11994], 5.00th=[13698], 10.00th=[14746], 20.00th=[15270], 00:19:36.854 | 30.00th=[17695], 40.00th=[20317], 50.00th=[21103], 60.00th=[23987], 00:19:36.854 | 70.00th=[28181], 80.00th=[32375], 90.00th=[53216], 95.00th=[58459], 00:19:36.854 | 99.00th=[81265], 99.50th=[81265], 99.90th=[84411], 99.95th=[84411], 00:19:36.854 | 99.99th=[84411] 00:19:36.854 bw ( KiB/s): min=10224, max=10256, per=17.07%, avg=10240.00, stdev=22.63, samples=2 00:19:36.854 iops : min= 2556, max= 2564, avg=2560.00, stdev= 5.66, samples=2 00:19:36.854 lat (msec) : 10=0.17%, 20=43.22%, 50=50.27%, 100=6.33% 00:19:36.854 cpu : usr=1.89%, sys=2.48%, ctx=273, majf=0, minf=1 00:19:36.854 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:36.854 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.854 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.854 issued rwts: total=2560,2650,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.854 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.854 00:19:36.854 Run status group 0 (all jobs): 00:19:36.854 READ: bw=53.8MiB/s (56.4MB/s), 9.92MiB/s-18.5MiB/s (10.4MB/s-19.4MB/s), io=54.5MiB (57.1MB), run=1002-1013msec 00:19:36.854 WRITE: bw=58.6MiB/s (61.4MB/s), 10.3MiB/s-20.0MiB/s (10.8MB/s-20.9MB/s), io=59.4MiB (62.2MB), run=1002-1013msec 00:19:36.854 00:19:36.854 Disk stats (read/write): 00:19:36.854 nvme0n1: ios=3365/3584, merge=0/0, ticks=14470/11528, in_queue=25998, util=87.17% 00:19:36.854 nvme0n2: ios=2610/3072, merge=0/0, ticks=31361/61608, in_queue=92969, util=90.86% 00:19:36.854 nvme0n3: ios=3879/4096, merge=0/0, ticks=44979/61039, in_queue=106018, util=93.55% 00:19:36.854 nvme0n4: ios=2106/2399, merge=0/0, ticks=16012/25732, in_queue=41744, util=98.22% 00:19:36.854 02:31:01 -- target/fio.sh@55 -- # sync 00:19:36.854 02:31:01 -- target/fio.sh@59 -- # fio_pid=2087955 00:19:36.854 02:31:01 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:36.854 02:31:01 -- target/fio.sh@61 -- # sleep 3 00:19:36.854 [global] 00:19:36.854 thread=1 00:19:36.854 invalidate=1 00:19:36.854 rw=read 00:19:36.854 time_based=1 00:19:36.854 runtime=10 00:19:36.854 ioengine=libaio 00:19:36.854 direct=1 00:19:36.854 bs=4096 00:19:36.854 iodepth=1 00:19:36.854 norandommap=1 00:19:36.854 numjobs=1 00:19:36.854 00:19:36.854 [job0] 00:19:36.854 filename=/dev/nvme0n1 00:19:36.854 [job1] 00:19:36.854 filename=/dev/nvme0n2 00:19:36.854 [job2] 00:19:36.854 filename=/dev/nvme0n3 00:19:36.854 [job3] 00:19:36.854 filename=/dev/nvme0n4 00:19:36.854 Could not set queue depth (nvme0n1) 00:19:36.854 Could not set queue depth (nvme0n2) 00:19:36.854 Could not set queue depth (nvme0n3) 00:19:36.854 Could not set queue depth (nvme0n4) 00:19:36.854 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.854 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.854 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.854 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.854 fio-3.35 00:19:36.854 Starting 4 threads 00:19:40.139 02:31:04 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:40.139 02:31:04 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:40.139 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=290816, buflen=4096 00:19:40.139 fio: pid=2088046, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:40.139 02:31:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:40.139 02:31:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:40.139 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=47452160, buflen=4096 00:19:40.139 fio: pid=2088045, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:40.397 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=25010176, buflen=4096 00:19:40.397 fio: pid=2088043, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:40.397 02:31:04 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:40.397 02:31:04 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:40.655 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=51732480, buflen=4096 00:19:40.655 fio: pid=2088044, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:40.655 02:31:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:40.655 02:31:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:40.655 00:19:40.655 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2088043: Wed Nov 27 02:31:05 2024 00:19:40.655 read: IOPS=1773, BW=7094KiB/s (7264kB/s)(23.9MiB/3443msec) 00:19:40.655 slat (usec): min=3, max=16941, avg=13.11, stdev=229.43 00:19:40.655 clat (usec): min=164, max=41094, avg=544.79, stdev=3535.80 00:19:40.655 lat (usec): min=169, max=41107, avg=556.94, stdev=3543.24 00:19:40.655 clat percentiles (usec): 00:19:40.655 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 196], 00:19:40.655 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 212], 60.00th=[ 221], 00:19:40.655 | 70.00th=[ 241], 80.00th=[ 269], 90.00th=[ 326], 95.00th=[ 363], 00:19:40.655 | 99.00th=[ 510], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:40.655 | 99.99th=[41157] 00:19:40.655 bw ( KiB/s): min= 96, max=17072, per=24.79%, avg=8126.17, stdev=7408.05, samples=6 00:19:40.655 iops : min= 24, max= 4268, avg=2031.50, stdev=1852.03, samples=6 00:19:40.655 lat (usec) : 250=73.90%, 500=25.04%, 750=0.28% 00:19:40.655 lat (msec) : 50=0.77% 00:19:40.655 cpu : usr=0.73%, sys=1.92%, ctx=6109, majf=0, minf=1 00:19:40.655 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:40.655 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.655 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.655 issued rwts: total=6107,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.655 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:40.655 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2088044: Wed Nov 27 02:31:05 2024 00:19:40.655 read: IOPS=3405, BW=13.3MiB/s (13.9MB/s)(49.3MiB/3709msec) 00:19:40.655 slat (usec): min=3, max=15153, avg=12.78, stdev=199.01 00:19:40.655 clat (usec): min=160, max=41109, avg=276.80, stdev=1085.74 00:19:40.655 lat (usec): min=165, max=47000, avg=289.59, stdev=1121.14 00:19:40.655 clat percentiles (usec): 00:19:40.655 | 1.00th=[ 174], 5.00th=[ 188], 10.00th=[ 198], 20.00th=[ 223], 00:19:40.655 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 245], 60.00th=[ 249], 00:19:40.655 | 70.00th=[ 253], 80.00th=[ 262], 90.00th=[ 285], 95.00th=[ 314], 00:19:40.655 | 99.00th=[ 474], 99.50th=[ 519], 99.90th=[ 570], 99.95th=[41157], 00:19:40.655 | 99.99th=[41157] 00:19:40.655 bw ( KiB/s): min= 5716, max=15704, per=41.91%, avg=13735.43, stdev=3616.56, samples=7 00:19:40.655 iops : min= 1429, max= 3926, avg=3433.86, stdev=904.14, samples=7 00:19:40.655 lat (usec) : 250=62.15%, 500=37.09%, 750=0.68% 00:19:40.655 lat (msec) : 50=0.07% 00:19:40.655 cpu : usr=1.27%, sys=3.83%, ctx=12635, majf=0, minf=2 00:19:40.655 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:40.655 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.655 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.655 issued rwts: total=12631,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.656 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:40.656 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2088045: Wed Nov 27 02:31:05 2024 00:19:40.656 read: IOPS=3661, BW=14.3MiB/s (15.0MB/s)(45.3MiB/3164msec) 00:19:40.656 slat (usec): min=5, max=15731, avg=14.38, stdev=203.11 00:19:40.656 clat (usec): min=190, max=2879, avg=253.65, stdev=49.29 00:19:40.656 lat (usec): min=195, max=16003, avg=268.04, stdev=209.68 00:19:40.656 clat percentiles (usec): 00:19:40.656 | 1.00th=[ 204], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 229], 00:19:40.656 | 30.00th=[ 239], 40.00th=[ 245], 50.00th=[ 249], 60.00th=[ 253], 00:19:40.656 | 70.00th=[ 260], 80.00th=[ 265], 90.00th=[ 277], 95.00th=[ 302], 00:19:40.656 | 99.00th=[ 441], 99.50th=[ 486], 99.90th=[ 594], 99.95th=[ 906], 00:19:40.656 | 99.99th=[ 1385] 00:19:40.656 bw ( KiB/s): min=13992, max=15392, per=44.68%, avg=14644.00, stdev=472.06, samples=6 00:19:40.656 iops : min= 3498, max= 3848, avg=3661.00, stdev=118.02, samples=6 00:19:40.656 lat (usec) : 250=51.92%, 500=47.64%, 750=0.37%, 1000=0.02% 00:19:40.656 lat (msec) : 2=0.03%, 4=0.01% 00:19:40.656 cpu : usr=2.66%, sys=6.58%, ctx=11588, majf=0, minf=2 00:19:40.656 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:40.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.656 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.656 issued rwts: total=11586,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.656 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:40.656 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2088046: Wed Nov 27 02:31:05 2024 00:19:40.656 read: IOPS=24, BW=98.0KiB/s (100kB/s)(284KiB/2899msec) 00:19:40.656 slat (nsec): min=12880, max=48826, avg=21059.03, stdev=9505.75 00:19:40.656 clat (usec): min=657, max=42082, avg=40419.72, stdev=4788.50 00:19:40.656 lat (usec): min=682, max=42096, avg=40440.84, stdev=4787.90 00:19:40.656 clat percentiles (usec): 00:19:40.656 | 1.00th=[ 660], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:40.656 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:40.656 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:40.656 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:40.656 | 99.99th=[42206] 00:19:40.656 bw ( KiB/s): min= 96, max= 104, per=0.30%, avg=99.20, stdev= 4.38, samples=5 00:19:40.656 iops : min= 24, max= 26, avg=24.80, stdev= 1.10, samples=5 00:19:40.656 lat (usec) : 750=1.39% 00:19:40.656 lat (msec) : 50=97.22% 00:19:40.656 cpu : usr=0.10%, sys=0.00%, ctx=72, majf=0, minf=2 00:19:40.656 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:40.656 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.656 complete : 0=1.4%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.656 issued rwts: total=72,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.656 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:40.656 00:19:40.656 Run status group 0 (all jobs): 00:19:40.656 READ: bw=32.0MiB/s (33.6MB/s), 98.0KiB/s-14.3MiB/s (100kB/s-15.0MB/s), io=119MiB (124MB), run=2899-3709msec 00:19:40.656 00:19:40.656 Disk stats (read/write): 00:19:40.656 nvme0n1: ios=6104/0, merge=0/0, ticks=3187/0, in_queue=3187, util=95.31% 00:19:40.656 nvme0n2: ios=12150/0, merge=0/0, ticks=3294/0, in_queue=3294, util=95.36% 00:19:40.656 nvme0n3: ios=11392/0, merge=0/0, ticks=2760/0, in_queue=2760, util=95.81% 00:19:40.656 nvme0n4: ios=70/0, merge=0/0, ticks=2831/0, in_queue=2831, util=96.74% 00:19:40.914 02:31:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:40.914 02:31:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:41.171 02:31:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.171 02:31:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:41.429 02:31:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.429 02:31:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:41.687 02:31:06 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.687 02:31:06 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:41.945 02:31:06 -- target/fio.sh@69 -- # fio_status=0 00:19:41.945 02:31:06 -- target/fio.sh@70 -- # wait 2087955 00:19:41.945 02:31:06 -- target/fio.sh@70 -- # fio_status=4 00:19:41.945 02:31:06 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:42.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:42.203 02:31:06 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:42.203 02:31:06 -- common/autotest_common.sh@1208 -- # local i=0 00:19:42.203 02:31:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:42.203 02:31:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:42.203 02:31:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:42.203 02:31:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:42.203 02:31:06 -- common/autotest_common.sh@1220 -- # return 0 00:19:42.203 02:31:06 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:42.203 02:31:06 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:42.203 nvmf hotplug test: fio failed as expected 00:19:42.203 02:31:06 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:42.463 02:31:06 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:42.463 02:31:06 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:42.463 02:31:06 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:42.463 02:31:06 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:42.463 02:31:06 -- target/fio.sh@91 -- # nvmftestfini 00:19:42.463 02:31:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:42.463 02:31:06 -- nvmf/common.sh@116 -- # sync 00:19:42.463 02:31:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:42.463 02:31:06 -- nvmf/common.sh@119 -- # set +e 00:19:42.463 02:31:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:42.463 02:31:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:42.463 rmmod nvme_tcp 00:19:42.463 rmmod nvme_fabrics 00:19:42.463 rmmod nvme_keyring 00:19:42.463 02:31:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:42.463 02:31:07 -- nvmf/common.sh@123 -- # set -e 00:19:42.463 02:31:07 -- nvmf/common.sh@124 -- # return 0 00:19:42.463 02:31:07 -- nvmf/common.sh@477 -- # '[' -n 2085746 ']' 00:19:42.463 02:31:07 -- nvmf/common.sh@478 -- # killprocess 2085746 00:19:42.463 02:31:07 -- common/autotest_common.sh@936 -- # '[' -z 2085746 ']' 00:19:42.463 02:31:07 -- common/autotest_common.sh@940 -- # kill -0 2085746 00:19:42.463 02:31:07 -- common/autotest_common.sh@941 -- # uname 00:19:42.463 02:31:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:42.463 02:31:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2085746 00:19:42.463 02:31:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:42.463 02:31:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:42.463 02:31:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2085746' 00:19:42.463 killing process with pid 2085746 00:19:42.463 02:31:07 -- common/autotest_common.sh@955 -- # kill 2085746 00:19:42.463 02:31:07 -- common/autotest_common.sh@960 -- # wait 2085746 00:19:42.721 02:31:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:42.721 02:31:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:42.721 02:31:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:42.721 02:31:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:42.721 02:31:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:42.721 02:31:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:42.721 02:31:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:42.721 02:31:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:45.262 02:31:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:45.262 00:19:45.262 real 0m24.293s 00:19:45.262 user 1m25.271s 00:19:45.262 sys 0m6.808s 00:19:45.262 02:31:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:45.262 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:19:45.262 ************************************ 00:19:45.262 END TEST nvmf_fio_target 00:19:45.262 ************************************ 00:19:45.262 02:31:09 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:45.262 02:31:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:45.262 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:19:45.262 ************************************ 00:19:45.262 START TEST nvmf_bdevio 00:19:45.262 ************************************ 00:19:45.262 02:31:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:45.262 * Looking for test storage... 00:19:45.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:45.262 02:31:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:45.262 02:31:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:45.262 02:31:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:45.262 02:31:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:45.262 02:31:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:45.262 02:31:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:45.262 02:31:09 -- scripts/common.sh@335 -- # IFS=.-: 00:19:45.262 02:31:09 -- scripts/common.sh@335 -- # read -ra ver1 00:19:45.262 02:31:09 -- scripts/common.sh@336 -- # IFS=.-: 00:19:45.262 02:31:09 -- scripts/common.sh@336 -- # read -ra ver2 00:19:45.262 02:31:09 -- scripts/common.sh@337 -- # local 'op=<' 00:19:45.262 02:31:09 -- scripts/common.sh@339 -- # ver1_l=2 00:19:45.262 02:31:09 -- scripts/common.sh@340 -- # ver2_l=1 00:19:45.262 02:31:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:45.262 02:31:09 -- scripts/common.sh@343 -- # case "$op" in 00:19:45.262 02:31:09 -- scripts/common.sh@344 -- # : 1 00:19:45.262 02:31:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:45.262 02:31:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:45.262 02:31:09 -- scripts/common.sh@364 -- # decimal 1 00:19:45.262 02:31:09 -- scripts/common.sh@352 -- # local d=1 00:19:45.262 02:31:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:45.262 02:31:09 -- scripts/common.sh@354 -- # echo 1 00:19:45.262 02:31:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:45.262 02:31:09 -- scripts/common.sh@365 -- # decimal 2 00:19:45.262 02:31:09 -- scripts/common.sh@352 -- # local d=2 00:19:45.262 02:31:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:45.262 02:31:09 -- scripts/common.sh@354 -- # echo 2 00:19:45.262 02:31:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:45.262 02:31:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:45.262 02:31:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:45.262 02:31:09 -- scripts/common.sh@367 -- # return 0 00:19:45.262 02:31:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:45.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.262 --rc genhtml_branch_coverage=1 00:19:45.262 --rc genhtml_function_coverage=1 00:19:45.262 --rc genhtml_legend=1 00:19:45.262 --rc geninfo_all_blocks=1 00:19:45.262 --rc geninfo_unexecuted_blocks=1 00:19:45.262 00:19:45.262 ' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:45.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.262 --rc genhtml_branch_coverage=1 00:19:45.262 --rc genhtml_function_coverage=1 00:19:45.262 --rc genhtml_legend=1 00:19:45.262 --rc geninfo_all_blocks=1 00:19:45.262 --rc geninfo_unexecuted_blocks=1 00:19:45.262 00:19:45.262 ' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:45.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.262 --rc genhtml_branch_coverage=1 00:19:45.262 --rc genhtml_function_coverage=1 00:19:45.262 --rc genhtml_legend=1 00:19:45.262 --rc geninfo_all_blocks=1 00:19:45.262 --rc geninfo_unexecuted_blocks=1 00:19:45.262 00:19:45.262 ' 00:19:45.262 02:31:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:45.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:45.262 --rc genhtml_branch_coverage=1 00:19:45.262 --rc genhtml_function_coverage=1 00:19:45.262 --rc genhtml_legend=1 00:19:45.262 --rc geninfo_all_blocks=1 00:19:45.262 --rc geninfo_unexecuted_blocks=1 00:19:45.262 00:19:45.262 ' 00:19:45.262 02:31:09 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:45.262 02:31:09 -- nvmf/common.sh@7 -- # uname -s 00:19:45.262 02:31:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:45.262 02:31:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:45.262 02:31:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:45.262 02:31:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:45.262 02:31:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:45.262 02:31:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:45.262 02:31:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:45.262 02:31:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:45.262 02:31:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:45.262 02:31:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:45.262 02:31:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:45.262 02:31:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:45.262 02:31:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:45.262 02:31:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:45.262 02:31:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:45.262 02:31:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:45.262 02:31:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:45.262 02:31:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:45.262 02:31:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:45.262 02:31:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.262 02:31:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.262 02:31:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.262 02:31:09 -- paths/export.sh@5 -- # export PATH 00:19:45.262 02:31:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.262 02:31:09 -- nvmf/common.sh@46 -- # : 0 00:19:45.262 02:31:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:45.262 02:31:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:45.262 02:31:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:45.263 02:31:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:45.263 02:31:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:45.263 02:31:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:45.263 02:31:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:45.263 02:31:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:45.263 02:31:09 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:45.263 02:31:09 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:45.263 02:31:09 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:45.263 02:31:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:45.263 02:31:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:45.263 02:31:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:45.263 02:31:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:45.263 02:31:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:45.263 02:31:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:45.263 02:31:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:45.263 02:31:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:45.263 02:31:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:45.263 02:31:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:45.263 02:31:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:45.263 02:31:09 -- common/autotest_common.sh@10 -- # set +x 00:19:47.170 02:31:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:47.170 02:31:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:47.170 02:31:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:47.170 02:31:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:47.170 02:31:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:47.170 02:31:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:47.170 02:31:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:47.170 02:31:11 -- nvmf/common.sh@294 -- # net_devs=() 00:19:47.170 02:31:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:47.170 02:31:11 -- nvmf/common.sh@295 -- # e810=() 00:19:47.170 02:31:11 -- nvmf/common.sh@295 -- # local -ga e810 00:19:47.170 02:31:11 -- nvmf/common.sh@296 -- # x722=() 00:19:47.170 02:31:11 -- nvmf/common.sh@296 -- # local -ga x722 00:19:47.170 02:31:11 -- nvmf/common.sh@297 -- # mlx=() 00:19:47.170 02:31:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:47.170 02:31:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:47.170 02:31:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:47.170 02:31:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:47.170 02:31:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:47.170 02:31:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:47.170 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:47.170 02:31:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:47.170 02:31:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:47.170 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:47.170 02:31:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:47.170 02:31:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:47.170 02:31:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:47.170 02:31:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:47.170 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:47.170 02:31:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:47.170 02:31:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:47.170 02:31:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:47.170 02:31:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:47.170 02:31:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:47.170 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:47.170 02:31:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:47.170 02:31:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:47.170 02:31:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:47.170 02:31:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:47.170 02:31:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:47.170 02:31:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:47.170 02:31:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:47.170 02:31:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:47.170 02:31:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:47.170 02:31:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:47.170 02:31:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:47.170 02:31:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:47.170 02:31:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:47.170 02:31:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:47.170 02:31:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:47.170 02:31:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:47.170 02:31:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:47.171 02:31:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:47.171 02:31:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:47.171 02:31:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:47.171 02:31:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:47.171 02:31:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:47.171 02:31:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:47.171 02:31:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:47.171 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:47.171 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:19:47.171 00:19:47.171 --- 10.0.0.2 ping statistics --- 00:19:47.171 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:47.171 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:19:47.171 02:31:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:47.171 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:47.171 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:19:47.171 00:19:47.171 --- 10.0.0.1 ping statistics --- 00:19:47.171 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:47.171 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:19:47.171 02:31:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:47.171 02:31:11 -- nvmf/common.sh@410 -- # return 0 00:19:47.171 02:31:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:47.171 02:31:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:47.171 02:31:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:47.171 02:31:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:47.171 02:31:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:47.171 02:31:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:47.171 02:31:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:47.171 02:31:11 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:47.171 02:31:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:47.171 02:31:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:47.171 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.171 02:31:11 -- nvmf/common.sh@469 -- # nvmfpid=2090708 00:19:47.171 02:31:11 -- nvmf/common.sh@470 -- # waitforlisten 2090708 00:19:47.171 02:31:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:47.171 02:31:11 -- common/autotest_common.sh@829 -- # '[' -z 2090708 ']' 00:19:47.171 02:31:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:47.171 02:31:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:47.171 02:31:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:47.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:47.171 02:31:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:47.171 02:31:11 -- common/autotest_common.sh@10 -- # set +x 00:19:47.171 [2024-11-27 02:31:11.709060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:47.171 [2024-11-27 02:31:11.709140] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:47.171 EAL: No free 2048 kB hugepages reported on node 1 00:19:47.171 [2024-11-27 02:31:11.778513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:47.429 [2024-11-27 02:31:11.871706] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:47.429 [2024-11-27 02:31:11.871872] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:47.429 [2024-11-27 02:31:11.871891] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:47.429 [2024-11-27 02:31:11.871905] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:47.429 [2024-11-27 02:31:11.872013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:47.429 [2024-11-27 02:31:11.872062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:47.429 [2024-11-27 02:31:11.872091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:47.429 [2024-11-27 02:31:11.872094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:48.363 02:31:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:48.363 02:31:12 -- common/autotest_common.sh@862 -- # return 0 00:19:48.363 02:31:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:48.363 02:31:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:48.363 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.363 02:31:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:48.363 02:31:12 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:48.363 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:48.363 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.363 [2024-11-27 02:31:12.716156] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:48.363 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:48.363 02:31:12 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:48.363 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:48.363 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.363 Malloc0 00:19:48.363 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:48.363 02:31:12 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:48.363 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:48.363 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.363 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:48.363 02:31:12 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:48.363 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:48.363 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.363 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:48.363 02:31:12 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:48.363 02:31:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:48.364 02:31:12 -- common/autotest_common.sh@10 -- # set +x 00:19:48.364 [2024-11-27 02:31:12.767305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:48.364 02:31:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:48.364 02:31:12 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:48.364 02:31:12 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:48.364 02:31:12 -- nvmf/common.sh@520 -- # config=() 00:19:48.364 02:31:12 -- nvmf/common.sh@520 -- # local subsystem config 00:19:48.364 02:31:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:48.364 02:31:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:48.364 { 00:19:48.364 "params": { 00:19:48.364 "name": "Nvme$subsystem", 00:19:48.364 "trtype": "$TEST_TRANSPORT", 00:19:48.364 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:48.364 "adrfam": "ipv4", 00:19:48.364 "trsvcid": "$NVMF_PORT", 00:19:48.364 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:48.364 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:48.364 "hdgst": ${hdgst:-false}, 00:19:48.364 "ddgst": ${ddgst:-false} 00:19:48.364 }, 00:19:48.364 "method": "bdev_nvme_attach_controller" 00:19:48.364 } 00:19:48.364 EOF 00:19:48.364 )") 00:19:48.364 02:31:12 -- nvmf/common.sh@542 -- # cat 00:19:48.364 02:31:12 -- nvmf/common.sh@544 -- # jq . 00:19:48.364 02:31:12 -- nvmf/common.sh@545 -- # IFS=, 00:19:48.364 02:31:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:48.364 "params": { 00:19:48.364 "name": "Nvme1", 00:19:48.364 "trtype": "tcp", 00:19:48.364 "traddr": "10.0.0.2", 00:19:48.364 "adrfam": "ipv4", 00:19:48.364 "trsvcid": "4420", 00:19:48.364 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:48.364 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:48.364 "hdgst": false, 00:19:48.364 "ddgst": false 00:19:48.364 }, 00:19:48.364 "method": "bdev_nvme_attach_controller" 00:19:48.364 }' 00:19:48.364 [2024-11-27 02:31:12.807388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:48.364 [2024-11-27 02:31:12.807458] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2090870 ] 00:19:48.364 EAL: No free 2048 kB hugepages reported on node 1 00:19:48.364 [2024-11-27 02:31:12.868642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:48.364 [2024-11-27 02:31:12.955601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:48.364 [2024-11-27 02:31:12.955643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:48.364 [2024-11-27 02:31:12.955646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:48.622 [2024-11-27 02:31:13.248735] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:48.622 [2024-11-27 02:31:13.248786] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:48.622 I/O targets: 00:19:48.622 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:48.622 00:19:48.622 00:19:48.622 CUnit - A unit testing framework for C - Version 2.1-3 00:19:48.622 http://cunit.sourceforge.net/ 00:19:48.622 00:19:48.622 00:19:48.622 Suite: bdevio tests on: Nvme1n1 00:19:48.881 Test: blockdev write read block ...passed 00:19:48.881 Test: blockdev write zeroes read block ...passed 00:19:48.881 Test: blockdev write zeroes read no split ...passed 00:19:48.881 Test: blockdev write zeroes read split ...passed 00:19:48.881 Test: blockdev write zeroes read split partial ...passed 00:19:48.881 Test: blockdev reset ...[2024-11-27 02:31:13.405335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:48.881 [2024-11-27 02:31:13.405465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa73e40 (9): Bad file descriptor 00:19:48.881 [2024-11-27 02:31:13.459340] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:48.881 passed 00:19:48.881 Test: blockdev write read 8 blocks ...passed 00:19:48.881 Test: blockdev write read size > 128k ...passed 00:19:48.881 Test: blockdev write read invalid size ...passed 00:19:49.141 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:49.141 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:49.141 Test: blockdev write read max offset ...passed 00:19:49.141 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:49.141 Test: blockdev writev readv 8 blocks ...passed 00:19:49.141 Test: blockdev writev readv 30 x 1block ...passed 00:19:49.141 Test: blockdev writev readv block ...passed 00:19:49.141 Test: blockdev writev readv size > 128k ...passed 00:19:49.141 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:49.141 Test: blockdev comparev and writev ...[2024-11-27 02:31:13.751579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.751616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.751640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.751657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.751986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.752032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.752372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.752418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.752757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:49.141 [2024-11-27 02:31:13.752811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:49.141 [2024-11-27 02:31:13.752826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:49.401 passed 00:19:49.401 Test: blockdev nvme passthru rw ...passed 00:19:49.401 Test: blockdev nvme passthru vendor specific ...[2024-11-27 02:31:13.834784] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:49.401 [2024-11-27 02:31:13.834812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:49.401 [2024-11-27 02:31:13.834958] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:49.401 [2024-11-27 02:31:13.834981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:49.401 [2024-11-27 02:31:13.835119] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:49.402 [2024-11-27 02:31:13.835141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:49.402 [2024-11-27 02:31:13.835275] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:49.402 [2024-11-27 02:31:13.835297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:49.402 passed 00:19:49.402 Test: blockdev nvme admin passthru ...passed 00:19:49.402 Test: blockdev copy ...passed 00:19:49.402 00:19:49.402 Run Summary: Type Total Ran Passed Failed Inactive 00:19:49.402 suites 1 1 n/a 0 0 00:19:49.402 tests 23 23 23 0 0 00:19:49.402 asserts 152 152 152 0 n/a 00:19:49.402 00:19:49.402 Elapsed time = 1.277 seconds 00:19:49.661 02:31:14 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:49.661 02:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.661 02:31:14 -- common/autotest_common.sh@10 -- # set +x 00:19:49.661 02:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.661 02:31:14 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:49.661 02:31:14 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:49.661 02:31:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:49.661 02:31:14 -- nvmf/common.sh@116 -- # sync 00:19:49.661 02:31:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:49.661 02:31:14 -- nvmf/common.sh@119 -- # set +e 00:19:49.661 02:31:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:49.661 02:31:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:49.661 rmmod nvme_tcp 00:19:49.661 rmmod nvme_fabrics 00:19:49.661 rmmod nvme_keyring 00:19:49.661 02:31:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:49.661 02:31:14 -- nvmf/common.sh@123 -- # set -e 00:19:49.661 02:31:14 -- nvmf/common.sh@124 -- # return 0 00:19:49.661 02:31:14 -- nvmf/common.sh@477 -- # '[' -n 2090708 ']' 00:19:49.661 02:31:14 -- nvmf/common.sh@478 -- # killprocess 2090708 00:19:49.661 02:31:14 -- common/autotest_common.sh@936 -- # '[' -z 2090708 ']' 00:19:49.661 02:31:14 -- common/autotest_common.sh@940 -- # kill -0 2090708 00:19:49.661 02:31:14 -- common/autotest_common.sh@941 -- # uname 00:19:49.661 02:31:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:49.661 02:31:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2090708 00:19:49.661 02:31:14 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:49.661 02:31:14 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:49.661 02:31:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2090708' 00:19:49.661 killing process with pid 2090708 00:19:49.661 02:31:14 -- common/autotest_common.sh@955 -- # kill 2090708 00:19:49.661 02:31:14 -- common/autotest_common.sh@960 -- # wait 2090708 00:19:49.919 02:31:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:49.919 02:31:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:49.919 02:31:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:49.919 02:31:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:49.919 02:31:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:49.919 02:31:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:49.919 02:31:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:49.919 02:31:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.462 02:31:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:52.462 00:19:52.462 real 0m7.118s 00:19:52.462 user 0m13.734s 00:19:52.462 sys 0m2.087s 00:19:52.462 02:31:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:52.462 02:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.462 ************************************ 00:19:52.462 END TEST nvmf_bdevio 00:19:52.462 ************************************ 00:19:52.462 02:31:16 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:52.462 02:31:16 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:52.462 02:31:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:52.462 02:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:52.462 ************************************ 00:19:52.462 START TEST nvmf_bdevio_no_huge 00:19:52.462 ************************************ 00:19:52.462 02:31:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:52.462 * Looking for test storage... 00:19:52.462 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:52.462 02:31:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:52.462 02:31:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:52.462 02:31:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:52.462 02:31:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:52.462 02:31:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:52.462 02:31:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:52.462 02:31:16 -- scripts/common.sh@335 -- # IFS=.-: 00:19:52.462 02:31:16 -- scripts/common.sh@335 -- # read -ra ver1 00:19:52.462 02:31:16 -- scripts/common.sh@336 -- # IFS=.-: 00:19:52.462 02:31:16 -- scripts/common.sh@336 -- # read -ra ver2 00:19:52.462 02:31:16 -- scripts/common.sh@337 -- # local 'op=<' 00:19:52.462 02:31:16 -- scripts/common.sh@339 -- # ver1_l=2 00:19:52.462 02:31:16 -- scripts/common.sh@340 -- # ver2_l=1 00:19:52.462 02:31:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:52.462 02:31:16 -- scripts/common.sh@343 -- # case "$op" in 00:19:52.462 02:31:16 -- scripts/common.sh@344 -- # : 1 00:19:52.462 02:31:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:52.462 02:31:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:52.462 02:31:16 -- scripts/common.sh@364 -- # decimal 1 00:19:52.462 02:31:16 -- scripts/common.sh@352 -- # local d=1 00:19:52.462 02:31:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:52.462 02:31:16 -- scripts/common.sh@354 -- # echo 1 00:19:52.462 02:31:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:52.462 02:31:16 -- scripts/common.sh@365 -- # decimal 2 00:19:52.462 02:31:16 -- scripts/common.sh@352 -- # local d=2 00:19:52.462 02:31:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:52.462 02:31:16 -- scripts/common.sh@354 -- # echo 2 00:19:52.462 02:31:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:52.462 02:31:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:52.462 02:31:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:52.462 02:31:16 -- scripts/common.sh@367 -- # return 0 00:19:52.462 02:31:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:52.462 --rc genhtml_branch_coverage=1 00:19:52.462 --rc genhtml_function_coverage=1 00:19:52.462 --rc genhtml_legend=1 00:19:52.462 --rc geninfo_all_blocks=1 00:19:52.462 --rc geninfo_unexecuted_blocks=1 00:19:52.462 00:19:52.462 ' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:52.462 --rc genhtml_branch_coverage=1 00:19:52.462 --rc genhtml_function_coverage=1 00:19:52.462 --rc genhtml_legend=1 00:19:52.462 --rc geninfo_all_blocks=1 00:19:52.462 --rc geninfo_unexecuted_blocks=1 00:19:52.462 00:19:52.462 ' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:52.462 --rc genhtml_branch_coverage=1 00:19:52.462 --rc genhtml_function_coverage=1 00:19:52.462 --rc genhtml_legend=1 00:19:52.462 --rc geninfo_all_blocks=1 00:19:52.462 --rc geninfo_unexecuted_blocks=1 00:19:52.462 00:19:52.462 ' 00:19:52.462 02:31:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:52.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:52.462 --rc genhtml_branch_coverage=1 00:19:52.462 --rc genhtml_function_coverage=1 00:19:52.462 --rc genhtml_legend=1 00:19:52.462 --rc geninfo_all_blocks=1 00:19:52.462 --rc geninfo_unexecuted_blocks=1 00:19:52.462 00:19:52.462 ' 00:19:52.462 02:31:16 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:52.462 02:31:16 -- nvmf/common.sh@7 -- # uname -s 00:19:52.462 02:31:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:52.462 02:31:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:52.462 02:31:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:52.462 02:31:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:52.462 02:31:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:52.462 02:31:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:52.462 02:31:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:52.462 02:31:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:52.462 02:31:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:52.462 02:31:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:52.462 02:31:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:52.462 02:31:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:52.462 02:31:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:52.462 02:31:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:52.462 02:31:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:52.462 02:31:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:52.462 02:31:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:52.462 02:31:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:52.462 02:31:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:52.462 02:31:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.462 02:31:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.462 02:31:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.462 02:31:16 -- paths/export.sh@5 -- # export PATH 00:19:52.462 02:31:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.462 02:31:16 -- nvmf/common.sh@46 -- # : 0 00:19:52.462 02:31:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:52.462 02:31:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:52.462 02:31:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:52.462 02:31:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:52.462 02:31:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:52.463 02:31:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:52.463 02:31:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:52.463 02:31:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:52.463 02:31:16 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:52.463 02:31:16 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:52.463 02:31:16 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:52.463 02:31:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:52.463 02:31:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:52.463 02:31:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:52.463 02:31:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:52.463 02:31:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:52.463 02:31:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:52.463 02:31:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:52.463 02:31:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.463 02:31:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:52.463 02:31:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:52.463 02:31:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:52.463 02:31:16 -- common/autotest_common.sh@10 -- # set +x 00:19:54.366 02:31:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:54.366 02:31:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:54.366 02:31:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:54.366 02:31:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:54.366 02:31:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:54.366 02:31:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:54.366 02:31:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:54.366 02:31:18 -- nvmf/common.sh@294 -- # net_devs=() 00:19:54.366 02:31:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:54.366 02:31:18 -- nvmf/common.sh@295 -- # e810=() 00:19:54.366 02:31:18 -- nvmf/common.sh@295 -- # local -ga e810 00:19:54.366 02:31:18 -- nvmf/common.sh@296 -- # x722=() 00:19:54.366 02:31:18 -- nvmf/common.sh@296 -- # local -ga x722 00:19:54.366 02:31:18 -- nvmf/common.sh@297 -- # mlx=() 00:19:54.366 02:31:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:54.366 02:31:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:54.366 02:31:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:54.366 02:31:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:54.366 02:31:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:54.366 02:31:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:54.366 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:54.366 02:31:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:54.366 02:31:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:54.366 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:54.366 02:31:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:54.366 02:31:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.366 02:31:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.366 02:31:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:54.366 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:54.366 02:31:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.366 02:31:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:54.366 02:31:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.366 02:31:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.366 02:31:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:54.366 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:54.366 02:31:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.366 02:31:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:54.366 02:31:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:54.366 02:31:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:54.366 02:31:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:54.366 02:31:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:54.366 02:31:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:54.366 02:31:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:54.366 02:31:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:54.366 02:31:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:54.366 02:31:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:54.366 02:31:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:54.366 02:31:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:54.366 02:31:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:54.366 02:31:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:54.366 02:31:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:54.366 02:31:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:54.366 02:31:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:54.366 02:31:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:54.366 02:31:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:54.367 02:31:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:54.367 02:31:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:54.367 02:31:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:54.367 02:31:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:54.367 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:54.367 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:19:54.367 00:19:54.367 --- 10.0.0.2 ping statistics --- 00:19:54.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:54.367 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:19:54.367 02:31:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:54.367 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:54.367 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:19:54.367 00:19:54.367 --- 10.0.0.1 ping statistics --- 00:19:54.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:54.367 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:19:54.367 02:31:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:54.367 02:31:18 -- nvmf/common.sh@410 -- # return 0 00:19:54.367 02:31:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:54.367 02:31:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:54.367 02:31:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:54.367 02:31:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:54.367 02:31:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:54.367 02:31:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:54.367 02:31:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:54.367 02:31:18 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:54.367 02:31:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:54.367 02:31:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:54.367 02:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:54.367 02:31:18 -- nvmf/common.sh@469 -- # nvmfpid=2092962 00:19:54.367 02:31:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:54.367 02:31:18 -- nvmf/common.sh@470 -- # waitforlisten 2092962 00:19:54.367 02:31:18 -- common/autotest_common.sh@829 -- # '[' -z 2092962 ']' 00:19:54.367 02:31:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:54.367 02:31:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:54.367 02:31:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:54.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:54.367 02:31:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:54.367 02:31:18 -- common/autotest_common.sh@10 -- # set +x 00:19:54.624 [2024-11-27 02:31:19.021610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:54.624 [2024-11-27 02:31:19.021689] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:54.624 [2024-11-27 02:31:19.100057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:54.624 [2024-11-27 02:31:19.191659] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:54.624 [2024-11-27 02:31:19.191806] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:54.624 [2024-11-27 02:31:19.191824] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:54.624 [2024-11-27 02:31:19.191839] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:54.624 [2024-11-27 02:31:19.191892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:54.624 [2024-11-27 02:31:19.191929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:54.624 [2024-11-27 02:31:19.192042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:54.624 [2024-11-27 02:31:19.192046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:55.563 02:31:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:55.563 02:31:20 -- common/autotest_common.sh@862 -- # return 0 00:19:55.563 02:31:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:55.563 02:31:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 02:31:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:55.563 02:31:20 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:55.563 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 [2024-11-27 02:31:20.060727] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:55.563 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:55.563 02:31:20 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:55.563 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 Malloc0 00:19:55.563 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:55.563 02:31:20 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:55.563 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:55.563 02:31:20 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:55.563 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:55.563 02:31:20 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:55.563 02:31:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:55.563 02:31:20 -- common/autotest_common.sh@10 -- # set +x 00:19:55.563 [2024-11-27 02:31:20.099001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:55.563 02:31:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:55.563 02:31:20 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:55.563 02:31:20 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:55.563 02:31:20 -- nvmf/common.sh@520 -- # config=() 00:19:55.563 02:31:20 -- nvmf/common.sh@520 -- # local subsystem config 00:19:55.563 02:31:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:55.563 02:31:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:55.563 { 00:19:55.563 "params": { 00:19:55.563 "name": "Nvme$subsystem", 00:19:55.563 "trtype": "$TEST_TRANSPORT", 00:19:55.564 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:55.564 "adrfam": "ipv4", 00:19:55.564 "trsvcid": "$NVMF_PORT", 00:19:55.564 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:55.564 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:55.564 "hdgst": ${hdgst:-false}, 00:19:55.564 "ddgst": ${ddgst:-false} 00:19:55.564 }, 00:19:55.564 "method": "bdev_nvme_attach_controller" 00:19:55.564 } 00:19:55.564 EOF 00:19:55.564 )") 00:19:55.564 02:31:20 -- nvmf/common.sh@542 -- # cat 00:19:55.564 02:31:20 -- nvmf/common.sh@544 -- # jq . 00:19:55.564 02:31:20 -- nvmf/common.sh@545 -- # IFS=, 00:19:55.564 02:31:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:55.564 "params": { 00:19:55.564 "name": "Nvme1", 00:19:55.564 "trtype": "tcp", 00:19:55.564 "traddr": "10.0.0.2", 00:19:55.564 "adrfam": "ipv4", 00:19:55.564 "trsvcid": "4420", 00:19:55.564 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:55.564 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:55.564 "hdgst": false, 00:19:55.564 "ddgst": false 00:19:55.564 }, 00:19:55.564 "method": "bdev_nvme_attach_controller" 00:19:55.564 }' 00:19:55.564 [2024-11-27 02:31:20.141379] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:55.564 [2024-11-27 02:31:20.141467] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2093125 ] 00:19:55.860 [2024-11-27 02:31:20.204648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:55.860 [2024-11-27 02:31:20.292960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:55.860 [2024-11-27 02:31:20.293011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:55.860 [2024-11-27 02:31:20.293014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:56.143 [2024-11-27 02:31:20.482796] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:56.143 [2024-11-27 02:31:20.482847] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:56.143 I/O targets: 00:19:56.143 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:56.143 00:19:56.143 00:19:56.143 CUnit - A unit testing framework for C - Version 2.1-3 00:19:56.143 http://cunit.sourceforge.net/ 00:19:56.143 00:19:56.143 00:19:56.143 Suite: bdevio tests on: Nvme1n1 00:19:56.143 Test: blockdev write read block ...passed 00:19:56.143 Test: blockdev write zeroes read block ...passed 00:19:56.143 Test: blockdev write zeroes read no split ...passed 00:19:56.143 Test: blockdev write zeroes read split ...passed 00:19:56.143 Test: blockdev write zeroes read split partial ...passed 00:19:56.143 Test: blockdev reset ...[2024-11-27 02:31:20.682873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:56.143 [2024-11-27 02:31:20.682985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17407c0 (9): Bad file descriptor 00:19:56.403 [2024-11-27 02:31:20.793318] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:56.403 passed 00:19:56.403 Test: blockdev write read 8 blocks ...passed 00:19:56.403 Test: blockdev write read size > 128k ...passed 00:19:56.403 Test: blockdev write read invalid size ...passed 00:19:56.403 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:56.403 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:56.403 Test: blockdev write read max offset ...passed 00:19:56.403 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:56.403 Test: blockdev writev readv 8 blocks ...passed 00:19:56.403 Test: blockdev writev readv 30 x 1block ...passed 00:19:56.403 Test: blockdev writev readv block ...passed 00:19:56.403 Test: blockdev writev readv size > 128k ...passed 00:19:56.403 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:56.403 Test: blockdev comparev and writev ...[2024-11-27 02:31:21.007478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.007516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.007551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.007569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.007902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.007926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.007948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.007965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.008247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.008271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.008293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.008309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.008623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.008650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:56.403 [2024-11-27 02:31:21.008672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:56.403 [2024-11-27 02:31:21.008688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:56.664 passed 00:19:56.664 Test: blockdev nvme passthru rw ...passed 00:19:56.664 Test: blockdev nvme passthru vendor specific ...[2024-11-27 02:31:21.090775] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:56.664 [2024-11-27 02:31:21.090804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:56.664 [2024-11-27 02:31:21.090945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:56.664 [2024-11-27 02:31:21.090968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:56.664 [2024-11-27 02:31:21.091110] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:56.664 [2024-11-27 02:31:21.091134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:56.664 [2024-11-27 02:31:21.091279] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:56.664 [2024-11-27 02:31:21.091302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:56.664 passed 00:19:56.664 Test: blockdev nvme admin passthru ...passed 00:19:56.664 Test: blockdev copy ...passed 00:19:56.664 00:19:56.664 Run Summary: Type Total Ran Passed Failed Inactive 00:19:56.664 suites 1 1 n/a 0 0 00:19:56.664 tests 23 23 23 0 0 00:19:56.664 asserts 152 152 152 0 n/a 00:19:56.664 00:19:56.664 Elapsed time = 1.322 seconds 00:19:56.923 02:31:21 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:56.923 02:31:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.923 02:31:21 -- common/autotest_common.sh@10 -- # set +x 00:19:56.923 02:31:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.923 02:31:21 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:56.923 02:31:21 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:56.923 02:31:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:56.923 02:31:21 -- nvmf/common.sh@116 -- # sync 00:19:56.923 02:31:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:56.923 02:31:21 -- nvmf/common.sh@119 -- # set +e 00:19:56.923 02:31:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:56.923 02:31:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:56.923 rmmod nvme_tcp 00:19:56.923 rmmod nvme_fabrics 00:19:56.923 rmmod nvme_keyring 00:19:56.923 02:31:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:56.923 02:31:21 -- nvmf/common.sh@123 -- # set -e 00:19:56.923 02:31:21 -- nvmf/common.sh@124 -- # return 0 00:19:56.923 02:31:21 -- nvmf/common.sh@477 -- # '[' -n 2092962 ']' 00:19:56.923 02:31:21 -- nvmf/common.sh@478 -- # killprocess 2092962 00:19:56.923 02:31:21 -- common/autotest_common.sh@936 -- # '[' -z 2092962 ']' 00:19:56.923 02:31:21 -- common/autotest_common.sh@940 -- # kill -0 2092962 00:19:56.923 02:31:21 -- common/autotest_common.sh@941 -- # uname 00:19:56.923 02:31:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:56.923 02:31:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2092962 00:19:57.183 02:31:21 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:57.183 02:31:21 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:57.183 02:31:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2092962' 00:19:57.183 killing process with pid 2092962 00:19:57.183 02:31:21 -- common/autotest_common.sh@955 -- # kill 2092962 00:19:57.183 02:31:21 -- common/autotest_common.sh@960 -- # wait 2092962 00:19:57.442 02:31:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:57.442 02:31:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:57.442 02:31:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:57.442 02:31:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:57.442 02:31:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:57.442 02:31:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:57.442 02:31:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:57.442 02:31:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.983 02:31:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:59.983 00:19:59.983 real 0m7.516s 00:19:59.983 user 0m14.155s 00:19:59.983 sys 0m2.627s 00:19:59.983 02:31:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:59.983 02:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.983 ************************************ 00:19:59.983 END TEST nvmf_bdevio_no_huge 00:19:59.983 ************************************ 00:19:59.983 02:31:24 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:59.983 02:31:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:59.983 02:31:24 -- common/autotest_common.sh@10 -- # set +x 00:19:59.983 ************************************ 00:19:59.983 START TEST nvmf_tls 00:19:59.983 ************************************ 00:19:59.983 02:31:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:59.983 * Looking for test storage... 00:19:59.983 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:59.983 02:31:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:59.983 02:31:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:59.983 02:31:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:59.983 02:31:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:59.983 02:31:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:59.983 02:31:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:59.983 02:31:24 -- scripts/common.sh@335 -- # IFS=.-: 00:19:59.983 02:31:24 -- scripts/common.sh@335 -- # read -ra ver1 00:19:59.983 02:31:24 -- scripts/common.sh@336 -- # IFS=.-: 00:19:59.983 02:31:24 -- scripts/common.sh@336 -- # read -ra ver2 00:19:59.983 02:31:24 -- scripts/common.sh@337 -- # local 'op=<' 00:19:59.983 02:31:24 -- scripts/common.sh@339 -- # ver1_l=2 00:19:59.983 02:31:24 -- scripts/common.sh@340 -- # ver2_l=1 00:19:59.983 02:31:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:59.983 02:31:24 -- scripts/common.sh@343 -- # case "$op" in 00:19:59.983 02:31:24 -- scripts/common.sh@344 -- # : 1 00:19:59.983 02:31:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:59.983 02:31:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:59.983 02:31:24 -- scripts/common.sh@364 -- # decimal 1 00:19:59.983 02:31:24 -- scripts/common.sh@352 -- # local d=1 00:19:59.983 02:31:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:59.983 02:31:24 -- scripts/common.sh@354 -- # echo 1 00:19:59.983 02:31:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:59.983 02:31:24 -- scripts/common.sh@365 -- # decimal 2 00:19:59.983 02:31:24 -- scripts/common.sh@352 -- # local d=2 00:19:59.983 02:31:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:59.983 02:31:24 -- scripts/common.sh@354 -- # echo 2 00:19:59.983 02:31:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:59.983 02:31:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:59.983 02:31:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:59.983 02:31:24 -- scripts/common.sh@367 -- # return 0 00:19:59.983 02:31:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:59.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.983 --rc genhtml_branch_coverage=1 00:19:59.983 --rc genhtml_function_coverage=1 00:19:59.983 --rc genhtml_legend=1 00:19:59.983 --rc geninfo_all_blocks=1 00:19:59.983 --rc geninfo_unexecuted_blocks=1 00:19:59.983 00:19:59.983 ' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:59.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.983 --rc genhtml_branch_coverage=1 00:19:59.983 --rc genhtml_function_coverage=1 00:19:59.983 --rc genhtml_legend=1 00:19:59.983 --rc geninfo_all_blocks=1 00:19:59.983 --rc geninfo_unexecuted_blocks=1 00:19:59.983 00:19:59.983 ' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:59.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.983 --rc genhtml_branch_coverage=1 00:19:59.983 --rc genhtml_function_coverage=1 00:19:59.983 --rc genhtml_legend=1 00:19:59.983 --rc geninfo_all_blocks=1 00:19:59.983 --rc geninfo_unexecuted_blocks=1 00:19:59.983 00:19:59.983 ' 00:19:59.983 02:31:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:59.984 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.984 --rc genhtml_branch_coverage=1 00:19:59.984 --rc genhtml_function_coverage=1 00:19:59.984 --rc genhtml_legend=1 00:19:59.984 --rc geninfo_all_blocks=1 00:19:59.984 --rc geninfo_unexecuted_blocks=1 00:19:59.984 00:19:59.984 ' 00:19:59.984 02:31:24 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:59.984 02:31:24 -- nvmf/common.sh@7 -- # uname -s 00:19:59.984 02:31:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:59.984 02:31:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:59.984 02:31:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:59.984 02:31:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:59.984 02:31:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:59.984 02:31:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:59.984 02:31:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:59.984 02:31:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:59.984 02:31:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:59.984 02:31:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:59.984 02:31:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:59.984 02:31:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:59.984 02:31:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:59.984 02:31:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:59.984 02:31:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:59.984 02:31:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:59.984 02:31:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:59.984 02:31:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:59.984 02:31:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:59.984 02:31:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.984 02:31:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.984 02:31:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.984 02:31:24 -- paths/export.sh@5 -- # export PATH 00:19:59.984 02:31:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.984 02:31:24 -- nvmf/common.sh@46 -- # : 0 00:19:59.984 02:31:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:59.984 02:31:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:59.984 02:31:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:59.984 02:31:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:59.984 02:31:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:59.984 02:31:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:59.984 02:31:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:59.984 02:31:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:59.984 02:31:24 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:59.984 02:31:24 -- target/tls.sh@71 -- # nvmftestinit 00:19:59.984 02:31:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:59.984 02:31:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:59.984 02:31:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:59.984 02:31:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:59.984 02:31:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:59.984 02:31:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:59.984 02:31:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:59.984 02:31:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.984 02:31:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:59.984 02:31:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:59.984 02:31:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:59.984 02:31:24 -- common/autotest_common.sh@10 -- # set +x 00:20:01.887 02:31:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:01.887 02:31:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:01.887 02:31:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:01.887 02:31:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:01.887 02:31:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:01.887 02:31:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:01.887 02:31:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:01.887 02:31:26 -- nvmf/common.sh@294 -- # net_devs=() 00:20:01.887 02:31:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:01.887 02:31:26 -- nvmf/common.sh@295 -- # e810=() 00:20:01.887 02:31:26 -- nvmf/common.sh@295 -- # local -ga e810 00:20:01.887 02:31:26 -- nvmf/common.sh@296 -- # x722=() 00:20:01.887 02:31:26 -- nvmf/common.sh@296 -- # local -ga x722 00:20:01.887 02:31:26 -- nvmf/common.sh@297 -- # mlx=() 00:20:01.887 02:31:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:01.887 02:31:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:01.887 02:31:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:01.887 02:31:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:01.887 02:31:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:01.887 02:31:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:01.887 02:31:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:01.887 02:31:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:01.887 02:31:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:01.887 02:31:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:01.887 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:01.887 02:31:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:01.887 02:31:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:01.887 02:31:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:01.888 02:31:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:01.888 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:01.888 02:31:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:01.888 02:31:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:01.888 02:31:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:01.888 02:31:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:01.888 02:31:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:01.888 02:31:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:01.888 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:01.888 02:31:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:01.888 02:31:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:01.888 02:31:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:01.888 02:31:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:01.888 02:31:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:01.888 02:31:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:01.888 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:01.888 02:31:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:01.888 02:31:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:01.888 02:31:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:01.888 02:31:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:01.888 02:31:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:01.888 02:31:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:01.888 02:31:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:01.888 02:31:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:01.888 02:31:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:01.888 02:31:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:01.888 02:31:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:01.888 02:31:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:01.888 02:31:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:01.888 02:31:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:01.888 02:31:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:01.888 02:31:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:01.888 02:31:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:01.888 02:31:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:01.888 02:31:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:01.888 02:31:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:01.888 02:31:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:01.888 02:31:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:01.888 02:31:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:01.888 02:31:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:01.888 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:01.888 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:20:01.888 00:20:01.888 --- 10.0.0.2 ping statistics --- 00:20:01.888 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:01.888 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:20:01.888 02:31:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:01.888 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:01.888 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:20:01.888 00:20:01.888 --- 10.0.0.1 ping statistics --- 00:20:01.888 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:01.888 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:20:01.888 02:31:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:01.888 02:31:26 -- nvmf/common.sh@410 -- # return 0 00:20:01.888 02:31:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:01.888 02:31:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:01.888 02:31:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:01.888 02:31:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:01.888 02:31:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:01.888 02:31:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:01.888 02:31:26 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:01.888 02:31:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:01.888 02:31:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:01.888 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.888 02:31:26 -- nvmf/common.sh@469 -- # nvmfpid=2095339 00:20:01.888 02:31:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:01.888 02:31:26 -- nvmf/common.sh@470 -- # waitforlisten 2095339 00:20:01.888 02:31:26 -- common/autotest_common.sh@829 -- # '[' -z 2095339 ']' 00:20:01.888 02:31:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:01.888 02:31:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:01.888 02:31:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:01.888 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:01.888 02:31:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:01.888 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:01.888 [2024-11-27 02:31:26.488137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:01.888 [2024-11-27 02:31:26.488221] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:02.147 EAL: No free 2048 kB hugepages reported on node 1 00:20:02.147 [2024-11-27 02:31:26.563703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:02.147 [2024-11-27 02:31:26.651411] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:02.147 [2024-11-27 02:31:26.651587] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:02.147 [2024-11-27 02:31:26.651609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:02.147 [2024-11-27 02:31:26.651624] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:02.147 [2024-11-27 02:31:26.651664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:02.147 02:31:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:02.147 02:31:26 -- common/autotest_common.sh@862 -- # return 0 00:20:02.147 02:31:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:02.147 02:31:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:02.147 02:31:26 -- common/autotest_common.sh@10 -- # set +x 00:20:02.147 02:31:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:02.147 02:31:26 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:02.147 02:31:26 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:02.406 true 00:20:02.406 02:31:26 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:02.406 02:31:26 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:02.666 02:31:27 -- target/tls.sh@82 -- # version=0 00:20:02.666 02:31:27 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:02.666 02:31:27 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:02.926 02:31:27 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:02.926 02:31:27 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:03.186 02:31:27 -- target/tls.sh@90 -- # version=13 00:20:03.186 02:31:27 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:03.186 02:31:27 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:03.446 02:31:28 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:03.446 02:31:28 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:03.705 02:31:28 -- target/tls.sh@98 -- # version=7 00:20:03.705 02:31:28 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:03.705 02:31:28 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:03.705 02:31:28 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:03.985 02:31:28 -- target/tls.sh@105 -- # ktls=false 00:20:03.985 02:31:28 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:03.985 02:31:28 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:04.249 02:31:28 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:04.249 02:31:28 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:04.508 02:31:29 -- target/tls.sh@113 -- # ktls=true 00:20:04.508 02:31:29 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:04.508 02:31:29 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:04.768 02:31:29 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:04.768 02:31:29 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:05.026 02:31:29 -- target/tls.sh@121 -- # ktls=false 00:20:05.026 02:31:29 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:05.026 02:31:29 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:05.026 02:31:29 -- target/tls.sh@49 -- # local key hash crc 00:20:05.026 02:31:29 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:05.026 02:31:29 -- target/tls.sh@51 -- # hash=01 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # gzip -1 -c 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # tail -c8 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # head -c 4 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # crc='p$H�' 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.026 02:31:29 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.026 02:31:29 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:05.026 02:31:29 -- target/tls.sh@49 -- # local key hash crc 00:20:05.026 02:31:29 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:05.026 02:31:29 -- target/tls.sh@51 -- # hash=01 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # gzip -1 -c 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # tail -c8 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # head -c 4 00:20:05.026 02:31:29 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:05.026 02:31:29 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.026 02:31:29 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.026 02:31:29 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.026 02:31:29 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:05.026 02:31:29 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.026 02:31:29 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.026 02:31:29 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.026 02:31:29 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:05.026 02:31:29 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:05.285 02:31:29 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:05.851 02:31:30 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.851 02:31:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.851 02:31:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:06.109 [2024-11-27 02:31:30.515722] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:06.109 02:31:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:06.367 02:31:30 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:06.625 [2024-11-27 02:31:31.021054] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:06.625 [2024-11-27 02:31:31.021296] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:06.625 02:31:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:06.883 malloc0 00:20:06.883 02:31:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:07.141 02:31:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:07.419 02:31:31 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:07.419 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.409 Initializing NVMe Controllers 00:20:17.409 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:17.409 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:17.410 Initialization complete. Launching workers. 00:20:17.410 ======================================================== 00:20:17.410 Latency(us) 00:20:17.410 Device Information : IOPS MiB/s Average min max 00:20:17.410 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7735.48 30.22 8276.24 1094.62 8991.61 00:20:17.410 ======================================================== 00:20:17.410 Total : 7735.48 30.22 8276.24 1094.62 8991.61 00:20:17.410 00:20:17.410 02:31:41 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:17.410 02:31:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.410 02:31:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.410 02:31:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:17.410 02:31:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:17.410 02:31:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.410 02:31:41 -- target/tls.sh@28 -- # bdevperf_pid=2097225 00:20:17.410 02:31:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.410 02:31:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.410 02:31:41 -- target/tls.sh@31 -- # waitforlisten 2097225 /var/tmp/bdevperf.sock 00:20:17.410 02:31:41 -- common/autotest_common.sh@829 -- # '[' -z 2097225 ']' 00:20:17.410 02:31:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.410 02:31:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:17.410 02:31:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.410 02:31:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:17.410 02:31:41 -- common/autotest_common.sh@10 -- # set +x 00:20:17.410 [2024-11-27 02:31:41.957713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:17.410 [2024-11-27 02:31:41.957799] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2097225 ] 00:20:17.410 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.410 [2024-11-27 02:31:42.018762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.669 [2024-11-27 02:31:42.102702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:18.609 02:31:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:18.609 02:31:42 -- common/autotest_common.sh@862 -- # return 0 00:20:18.609 02:31:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:18.609 [2024-11-27 02:31:43.169613] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:18.609 TLSTESTn1 00:20:18.870 02:31:43 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:18.870 Running I/O for 10 seconds... 00:20:28.888 00:20:28.888 Latency(us) 00:20:28.888 [2024-11-27T01:31:53.523Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.888 [2024-11-27T01:31:53.523Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:28.888 Verification LBA range: start 0x0 length 0x2000 00:20:28.888 TLSTESTn1 : 10.03 4546.15 17.76 0.00 0.00 28099.09 7718.68 45632.47 00:20:28.888 [2024-11-27T01:31:53.523Z] =================================================================================================================== 00:20:28.888 [2024-11-27T01:31:53.523Z] Total : 4546.15 17.76 0.00 0.00 28099.09 7718.68 45632.47 00:20:28.888 0 00:20:28.888 02:31:53 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:28.888 02:31:53 -- target/tls.sh@45 -- # killprocess 2097225 00:20:28.888 02:31:53 -- common/autotest_common.sh@936 -- # '[' -z 2097225 ']' 00:20:28.888 02:31:53 -- common/autotest_common.sh@940 -- # kill -0 2097225 00:20:28.888 02:31:53 -- common/autotest_common.sh@941 -- # uname 00:20:28.888 02:31:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:28.888 02:31:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2097225 00:20:28.888 02:31:53 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:28.888 02:31:53 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:28.888 02:31:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2097225' 00:20:28.888 killing process with pid 2097225 00:20:28.888 02:31:53 -- common/autotest_common.sh@955 -- # kill 2097225 00:20:28.888 Received shutdown signal, test time was about 10.000000 seconds 00:20:28.888 00:20:28.888 Latency(us) 00:20:28.888 [2024-11-27T01:31:53.523Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.888 [2024-11-27T01:31:53.523Z] =================================================================================================================== 00:20:28.888 [2024-11-27T01:31:53.523Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:28.888 02:31:53 -- common/autotest_common.sh@960 -- # wait 2097225 00:20:29.148 02:31:53 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:29.148 02:31:53 -- common/autotest_common.sh@650 -- # local es=0 00:20:29.148 02:31:53 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:29.148 02:31:53 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:29.148 02:31:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.148 02:31:53 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:29.148 02:31:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:29.148 02:31:53 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:29.148 02:31:53 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:29.148 02:31:53 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:29.148 02:31:53 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:29.148 02:31:53 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:29.148 02:31:53 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:29.148 02:31:53 -- target/tls.sh@28 -- # bdevperf_pid=2098666 00:20:29.148 02:31:53 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:29.148 02:31:53 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:29.148 02:31:53 -- target/tls.sh@31 -- # waitforlisten 2098666 /var/tmp/bdevperf.sock 00:20:29.148 02:31:53 -- common/autotest_common.sh@829 -- # '[' -z 2098666 ']' 00:20:29.148 02:31:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:29.148 02:31:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:29.148 02:31:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:29.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:29.148 02:31:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:29.148 02:31:53 -- common/autotest_common.sh@10 -- # set +x 00:20:29.148 [2024-11-27 02:31:53.736403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:29.148 [2024-11-27 02:31:53.736485] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2098666 ] 00:20:29.148 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.407 [2024-11-27 02:31:53.793535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:29.407 [2024-11-27 02:31:53.872923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.345 02:31:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:30.345 02:31:54 -- common/autotest_common.sh@862 -- # return 0 00:20:30.345 02:31:54 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:30.345 [2024-11-27 02:31:54.939537] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:30.346 [2024-11-27 02:31:54.950703] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:30.346 [2024-11-27 02:31:54.951471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14cb840 (107): Transport endpoint is not connected 00:20:30.346 [2024-11-27 02:31:54.952463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14cb840 (9): Bad file descriptor 00:20:30.346 [2024-11-27 02:31:54.953463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:30.346 [2024-11-27 02:31:54.953483] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:30.346 [2024-11-27 02:31:54.953512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:30.346 request: 00:20:30.346 { 00:20:30.346 "name": "TLSTEST", 00:20:30.346 "trtype": "tcp", 00:20:30.346 "traddr": "10.0.0.2", 00:20:30.346 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:30.346 "adrfam": "ipv4", 00:20:30.346 "trsvcid": "4420", 00:20:30.346 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.346 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:30.346 "method": "bdev_nvme_attach_controller", 00:20:30.346 "req_id": 1 00:20:30.346 } 00:20:30.346 Got JSON-RPC error response 00:20:30.346 response: 00:20:30.346 { 00:20:30.346 "code": -32602, 00:20:30.346 "message": "Invalid parameters" 00:20:30.346 } 00:20:30.346 02:31:54 -- target/tls.sh@36 -- # killprocess 2098666 00:20:30.346 02:31:54 -- common/autotest_common.sh@936 -- # '[' -z 2098666 ']' 00:20:30.346 02:31:54 -- common/autotest_common.sh@940 -- # kill -0 2098666 00:20:30.346 02:31:54 -- common/autotest_common.sh@941 -- # uname 00:20:30.346 02:31:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.346 02:31:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2098666 00:20:30.604 02:31:55 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:30.604 02:31:55 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:30.604 02:31:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2098666' 00:20:30.604 killing process with pid 2098666 00:20:30.604 02:31:55 -- common/autotest_common.sh@955 -- # kill 2098666 00:20:30.604 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.604 00:20:30.604 Latency(us) 00:20:30.604 [2024-11-27T01:31:55.239Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.604 [2024-11-27T01:31:55.239Z] =================================================================================================================== 00:20:30.604 [2024-11-27T01:31:55.239Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:30.604 02:31:55 -- common/autotest_common.sh@960 -- # wait 2098666 00:20:30.604 02:31:55 -- target/tls.sh@37 -- # return 1 00:20:30.604 02:31:55 -- common/autotest_common.sh@653 -- # es=1 00:20:30.604 02:31:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:30.604 02:31:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:30.604 02:31:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:30.604 02:31:55 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:30.604 02:31:55 -- common/autotest_common.sh@650 -- # local es=0 00:20:30.604 02:31:55 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:30.604 02:31:55 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:30.604 02:31:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.604 02:31:55 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:30.605 02:31:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.605 02:31:55 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:30.605 02:31:55 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:30.605 02:31:55 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:30.605 02:31:55 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:30.605 02:31:55 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:30.863 02:31:55 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:30.863 02:31:55 -- target/tls.sh@28 -- # bdevperf_pid=2098815 00:20:30.863 02:31:55 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:30.863 02:31:55 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:30.863 02:31:55 -- target/tls.sh@31 -- # waitforlisten 2098815 /var/tmp/bdevperf.sock 00:20:30.863 02:31:55 -- common/autotest_common.sh@829 -- # '[' -z 2098815 ']' 00:20:30.863 02:31:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:30.863 02:31:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:30.863 02:31:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:30.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:30.863 02:31:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:30.863 02:31:55 -- common/autotest_common.sh@10 -- # set +x 00:20:30.863 [2024-11-27 02:31:55.281138] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:30.863 [2024-11-27 02:31:55.281219] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2098815 ] 00:20:30.863 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.863 [2024-11-27 02:31:55.344081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.863 [2024-11-27 02:31:55.425653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:31.121 02:31:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:31.121 02:31:55 -- common/autotest_common.sh@862 -- # return 0 00:20:31.121 02:31:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.380 [2024-11-27 02:31:55.791914] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:31.380 [2024-11-27 02:31:55.802767] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:31.380 [2024-11-27 02:31:55.802797] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:31.380 [2024-11-27 02:31:55.802854] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:31.380 [2024-11-27 02:31:55.803650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2470840 (107): Transport endpoint is not connected 00:20:31.380 [2024-11-27 02:31:55.804642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2470840 (9): Bad file descriptor 00:20:31.380 [2024-11-27 02:31:55.805641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:31.380 [2024-11-27 02:31:55.805662] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:31.380 [2024-11-27 02:31:55.805691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:31.380 request: 00:20:31.380 { 00:20:31.380 "name": "TLSTEST", 00:20:31.380 "trtype": "tcp", 00:20:31.380 "traddr": "10.0.0.2", 00:20:31.380 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:31.380 "adrfam": "ipv4", 00:20:31.380 "trsvcid": "4420", 00:20:31.380 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.380 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:31.380 "method": "bdev_nvme_attach_controller", 00:20:31.380 "req_id": 1 00:20:31.380 } 00:20:31.380 Got JSON-RPC error response 00:20:31.380 response: 00:20:31.380 { 00:20:31.380 "code": -32602, 00:20:31.380 "message": "Invalid parameters" 00:20:31.380 } 00:20:31.380 02:31:55 -- target/tls.sh@36 -- # killprocess 2098815 00:20:31.380 02:31:55 -- common/autotest_common.sh@936 -- # '[' -z 2098815 ']' 00:20:31.380 02:31:55 -- common/autotest_common.sh@940 -- # kill -0 2098815 00:20:31.380 02:31:55 -- common/autotest_common.sh@941 -- # uname 00:20:31.380 02:31:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:31.380 02:31:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2098815 00:20:31.381 02:31:55 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:31.381 02:31:55 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:31.381 02:31:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2098815' 00:20:31.381 killing process with pid 2098815 00:20:31.381 02:31:55 -- common/autotest_common.sh@955 -- # kill 2098815 00:20:31.381 Received shutdown signal, test time was about 10.000000 seconds 00:20:31.381 00:20:31.381 Latency(us) 00:20:31.381 [2024-11-27T01:31:56.016Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:31.381 [2024-11-27T01:31:56.016Z] =================================================================================================================== 00:20:31.381 [2024-11-27T01:31:56.016Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:31.381 02:31:55 -- common/autotest_common.sh@960 -- # wait 2098815 00:20:31.639 02:31:56 -- target/tls.sh@37 -- # return 1 00:20:31.639 02:31:56 -- common/autotest_common.sh@653 -- # es=1 00:20:31.639 02:31:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:31.639 02:31:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:31.639 02:31:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:31.639 02:31:56 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.639 02:31:56 -- common/autotest_common.sh@650 -- # local es=0 00:20:31.639 02:31:56 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.639 02:31:56 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:31.639 02:31:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:31.639 02:31:56 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:31.639 02:31:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:31.639 02:31:56 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.639 02:31:56 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:31.639 02:31:56 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:31.639 02:31:56 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:31.639 02:31:56 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:31.639 02:31:56 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:31.639 02:31:56 -- target/tls.sh@28 -- # bdevperf_pid=2098958 00:20:31.639 02:31:56 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:31.639 02:31:56 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:31.639 02:31:56 -- target/tls.sh@31 -- # waitforlisten 2098958 /var/tmp/bdevperf.sock 00:20:31.639 02:31:56 -- common/autotest_common.sh@829 -- # '[' -z 2098958 ']' 00:20:31.639 02:31:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:31.639 02:31:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:31.639 02:31:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:31.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:31.639 02:31:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:31.639 02:31:56 -- common/autotest_common.sh@10 -- # set +x 00:20:31.639 [2024-11-27 02:31:56.130684] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:31.639 [2024-11-27 02:31:56.130762] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2098958 ] 00:20:31.639 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.639 [2024-11-27 02:31:56.188057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.639 [2024-11-27 02:31:56.269153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:32.574 02:31:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.574 02:31:57 -- common/autotest_common.sh@862 -- # return 0 00:20:32.574 02:31:57 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:32.833 [2024-11-27 02:31:57.322273] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:32.833 [2024-11-27 02:31:57.327520] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:32.833 [2024-11-27 02:31:57.327560] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:32.833 [2024-11-27 02:31:57.327604] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:32.833 [2024-11-27 02:31:57.328074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231a840 (107): Transport endpoint is not connected 00:20:32.833 [2024-11-27 02:31:57.329061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x231a840 (9): Bad file descriptor 00:20:32.833 [2024-11-27 02:31:57.330061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:32.833 [2024-11-27 02:31:57.330081] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:32.833 [2024-11-27 02:31:57.330112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:32.833 request: 00:20:32.833 { 00:20:32.833 "name": "TLSTEST", 00:20:32.833 "trtype": "tcp", 00:20:32.833 "traddr": "10.0.0.2", 00:20:32.833 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:32.833 "adrfam": "ipv4", 00:20:32.833 "trsvcid": "4420", 00:20:32.833 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:32.833 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:32.833 "method": "bdev_nvme_attach_controller", 00:20:32.833 "req_id": 1 00:20:32.833 } 00:20:32.833 Got JSON-RPC error response 00:20:32.833 response: 00:20:32.833 { 00:20:32.833 "code": -32602, 00:20:32.833 "message": "Invalid parameters" 00:20:32.833 } 00:20:32.834 02:31:57 -- target/tls.sh@36 -- # killprocess 2098958 00:20:32.834 02:31:57 -- common/autotest_common.sh@936 -- # '[' -z 2098958 ']' 00:20:32.834 02:31:57 -- common/autotest_common.sh@940 -- # kill -0 2098958 00:20:32.834 02:31:57 -- common/autotest_common.sh@941 -- # uname 00:20:32.834 02:31:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:32.834 02:31:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2098958 00:20:32.834 02:31:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:32.834 02:31:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:32.834 02:31:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2098958' 00:20:32.834 killing process with pid 2098958 00:20:32.834 02:31:57 -- common/autotest_common.sh@955 -- # kill 2098958 00:20:32.834 Received shutdown signal, test time was about 10.000000 seconds 00:20:32.834 00:20:32.834 Latency(us) 00:20:32.834 [2024-11-27T01:31:57.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.834 [2024-11-27T01:31:57.469Z] =================================================================================================================== 00:20:32.834 [2024-11-27T01:31:57.469Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:32.834 02:31:57 -- common/autotest_common.sh@960 -- # wait 2098958 00:20:33.092 02:31:57 -- target/tls.sh@37 -- # return 1 00:20:33.092 02:31:57 -- common/autotest_common.sh@653 -- # es=1 00:20:33.092 02:31:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:33.092 02:31:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:33.092 02:31:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:33.092 02:31:57 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:33.092 02:31:57 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.092 02:31:57 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:33.092 02:31:57 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.092 02:31:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.092 02:31:57 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.092 02:31:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.092 02:31:57 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:33.092 02:31:57 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.092 02:31:57 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.092 02:31:57 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.092 02:31:57 -- target/tls.sh@23 -- # psk= 00:20:33.092 02:31:57 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.092 02:31:57 -- target/tls.sh@28 -- # bdevperf_pid=2099113 00:20:33.092 02:31:57 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.092 02:31:57 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.092 02:31:57 -- target/tls.sh@31 -- # waitforlisten 2099113 /var/tmp/bdevperf.sock 00:20:33.092 02:31:57 -- common/autotest_common.sh@829 -- # '[' -z 2099113 ']' 00:20:33.092 02:31:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.092 02:31:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.092 02:31:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.092 02:31:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.092 02:31:57 -- common/autotest_common.sh@10 -- # set +x 00:20:33.092 [2024-11-27 02:31:57.659379] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:33.092 [2024-11-27 02:31:57.659457] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2099113 ] 00:20:33.092 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.092 [2024-11-27 02:31:57.716801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.352 [2024-11-27 02:31:57.801349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.290 02:31:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.290 02:31:58 -- common/autotest_common.sh@862 -- # return 0 00:20:34.290 02:31:58 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:34.552 [2024-11-27 02:31:58.940960] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:34.552 [2024-11-27 02:31:58.943075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e4bdd0 (9): Bad file descriptor 00:20:34.552 [2024-11-27 02:31:58.944071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:34.552 [2024-11-27 02:31:58.944091] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:34.552 [2024-11-27 02:31:58.944120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:34.552 request: 00:20:34.552 { 00:20:34.552 "name": "TLSTEST", 00:20:34.552 "trtype": "tcp", 00:20:34.552 "traddr": "10.0.0.2", 00:20:34.552 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:34.552 "adrfam": "ipv4", 00:20:34.552 "trsvcid": "4420", 00:20:34.552 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:34.552 "method": "bdev_nvme_attach_controller", 00:20:34.552 "req_id": 1 00:20:34.552 } 00:20:34.552 Got JSON-RPC error response 00:20:34.552 response: 00:20:34.552 { 00:20:34.552 "code": -32602, 00:20:34.552 "message": "Invalid parameters" 00:20:34.552 } 00:20:34.552 02:31:58 -- target/tls.sh@36 -- # killprocess 2099113 00:20:34.552 02:31:58 -- common/autotest_common.sh@936 -- # '[' -z 2099113 ']' 00:20:34.552 02:31:58 -- common/autotest_common.sh@940 -- # kill -0 2099113 00:20:34.552 02:31:58 -- common/autotest_common.sh@941 -- # uname 00:20:34.552 02:31:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.552 02:31:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2099113 00:20:34.552 02:31:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:34.552 02:31:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:34.552 02:31:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2099113' 00:20:34.552 killing process with pid 2099113 00:20:34.552 02:31:59 -- common/autotest_common.sh@955 -- # kill 2099113 00:20:34.552 Received shutdown signal, test time was about 10.000000 seconds 00:20:34.552 00:20:34.552 Latency(us) 00:20:34.552 [2024-11-27T01:31:59.187Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.552 [2024-11-27T01:31:59.187Z] =================================================================================================================== 00:20:34.552 [2024-11-27T01:31:59.187Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:34.552 02:31:59 -- common/autotest_common.sh@960 -- # wait 2099113 00:20:34.871 02:31:59 -- target/tls.sh@37 -- # return 1 00:20:34.871 02:31:59 -- common/autotest_common.sh@653 -- # es=1 00:20:34.871 02:31:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:34.871 02:31:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:34.871 02:31:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:34.871 02:31:59 -- target/tls.sh@167 -- # killprocess 2095339 00:20:34.871 02:31:59 -- common/autotest_common.sh@936 -- # '[' -z 2095339 ']' 00:20:34.871 02:31:59 -- common/autotest_common.sh@940 -- # kill -0 2095339 00:20:34.871 02:31:59 -- common/autotest_common.sh@941 -- # uname 00:20:34.871 02:31:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.871 02:31:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2095339 00:20:34.871 02:31:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:34.871 02:31:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:34.871 02:31:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2095339' 00:20:34.871 killing process with pid 2095339 00:20:34.871 02:31:59 -- common/autotest_common.sh@955 -- # kill 2095339 00:20:34.871 02:31:59 -- common/autotest_common.sh@960 -- # wait 2095339 00:20:35.136 02:31:59 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:35.136 02:31:59 -- target/tls.sh@49 -- # local key hash crc 00:20:35.136 02:31:59 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:35.136 02:31:59 -- target/tls.sh@51 -- # hash=02 00:20:35.136 02:31:59 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:35.136 02:31:59 -- target/tls.sh@52 -- # gzip -1 -c 00:20:35.136 02:31:59 -- target/tls.sh@52 -- # tail -c8 00:20:35.136 02:31:59 -- target/tls.sh@52 -- # head -c 4 00:20:35.136 02:31:59 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:35.136 02:31:59 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:35.136 02:31:59 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:35.136 02:31:59 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:35.136 02:31:59 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:35.136 02:31:59 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.136 02:31:59 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:35.136 02:31:59 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.136 02:31:59 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:35.136 02:31:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.136 02:31:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:35.136 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:20:35.136 02:31:59 -- nvmf/common.sh@469 -- # nvmfpid=2099401 00:20:35.136 02:31:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:35.136 02:31:59 -- nvmf/common.sh@470 -- # waitforlisten 2099401 00:20:35.136 02:31:59 -- common/autotest_common.sh@829 -- # '[' -z 2099401 ']' 00:20:35.136 02:31:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.136 02:31:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.136 02:31:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.136 02:31:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.136 02:31:59 -- common/autotest_common.sh@10 -- # set +x 00:20:35.136 [2024-11-27 02:31:59.568360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:35.136 [2024-11-27 02:31:59.568451] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.136 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.136 [2024-11-27 02:31:59.636582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.136 [2024-11-27 02:31:59.724222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.136 [2024-11-27 02:31:59.724383] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.136 [2024-11-27 02:31:59.724403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.136 [2024-11-27 02:31:59.724417] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.136 [2024-11-27 02:31:59.724457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.073 02:32:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.073 02:32:00 -- common/autotest_common.sh@862 -- # return 0 00:20:36.073 02:32:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.073 02:32:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:36.073 02:32:00 -- common/autotest_common.sh@10 -- # set +x 00:20:36.073 02:32:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.073 02:32:00 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.073 02:32:00 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.073 02:32:00 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:36.331 [2024-11-27 02:32:00.782398] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.331 02:32:00 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:36.589 02:32:01 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:36.848 [2024-11-27 02:32:01.283757] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:36.848 [2024-11-27 02:32:01.284030] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.848 02:32:01 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:37.105 malloc0 00:20:37.105 02:32:01 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:37.363 02:32:01 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.622 02:32:02 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.622 02:32:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:37.622 02:32:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:37.622 02:32:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:37.622 02:32:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:37.622 02:32:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:37.622 02:32:02 -- target/tls.sh@28 -- # bdevperf_pid=2099702 00:20:37.622 02:32:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:37.622 02:32:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:37.622 02:32:02 -- target/tls.sh@31 -- # waitforlisten 2099702 /var/tmp/bdevperf.sock 00:20:37.622 02:32:02 -- common/autotest_common.sh@829 -- # '[' -z 2099702 ']' 00:20:37.622 02:32:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:37.622 02:32:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.622 02:32:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:37.622 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:37.622 02:32:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.622 02:32:02 -- common/autotest_common.sh@10 -- # set +x 00:20:37.622 [2024-11-27 02:32:02.094113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:37.622 [2024-11-27 02:32:02.094186] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2099702 ] 00:20:37.622 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.622 [2024-11-27 02:32:02.152845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.622 [2024-11-27 02:32:02.234545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:38.557 02:32:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.557 02:32:03 -- common/autotest_common.sh@862 -- # return 0 00:20:38.557 02:32:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.814 [2024-11-27 02:32:03.261706] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:38.814 TLSTESTn1 00:20:38.814 02:32:03 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:39.073 Running I/O for 10 seconds... 00:20:49.055 00:20:49.055 Latency(us) 00:20:49.055 [2024-11-27T01:32:13.690Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.055 [2024-11-27T01:32:13.690Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:49.055 Verification LBA range: start 0x0 length 0x2000 00:20:49.055 TLSTESTn1 : 10.01 4558.93 17.81 0.00 0.00 28040.68 5000.15 69516.71 00:20:49.055 [2024-11-27T01:32:13.690Z] =================================================================================================================== 00:20:49.055 [2024-11-27T01:32:13.690Z] Total : 4558.93 17.81 0.00 0.00 28040.68 5000.15 69516.71 00:20:49.055 0 00:20:49.055 02:32:13 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:49.055 02:32:13 -- target/tls.sh@45 -- # killprocess 2099702 00:20:49.055 02:32:13 -- common/autotest_common.sh@936 -- # '[' -z 2099702 ']' 00:20:49.055 02:32:13 -- common/autotest_common.sh@940 -- # kill -0 2099702 00:20:49.055 02:32:13 -- common/autotest_common.sh@941 -- # uname 00:20:49.055 02:32:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:49.055 02:32:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2099702 00:20:49.055 02:32:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:49.055 02:32:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:49.055 02:32:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2099702' 00:20:49.055 killing process with pid 2099702 00:20:49.055 02:32:13 -- common/autotest_common.sh@955 -- # kill 2099702 00:20:49.055 Received shutdown signal, test time was about 10.000000 seconds 00:20:49.055 00:20:49.055 Latency(us) 00:20:49.055 [2024-11-27T01:32:13.690Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:49.055 [2024-11-27T01:32:13.690Z] =================================================================================================================== 00:20:49.055 [2024-11-27T01:32:13.690Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:49.055 02:32:13 -- common/autotest_common.sh@960 -- # wait 2099702 00:20:49.313 02:32:13 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.313 02:32:13 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.313 02:32:13 -- common/autotest_common.sh@650 -- # local es=0 00:20:49.313 02:32:13 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.313 02:32:13 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:49.313 02:32:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:49.313 02:32:13 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:49.313 02:32:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:49.313 02:32:13 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:49.313 02:32:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:49.313 02:32:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:49.313 02:32:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:49.313 02:32:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:49.313 02:32:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:49.313 02:32:13 -- target/tls.sh@28 -- # bdevperf_pid=2101167 00:20:49.313 02:32:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:49.313 02:32:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:49.313 02:32:13 -- target/tls.sh@31 -- # waitforlisten 2101167 /var/tmp/bdevperf.sock 00:20:49.313 02:32:13 -- common/autotest_common.sh@829 -- # '[' -z 2101167 ']' 00:20:49.313 02:32:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:49.313 02:32:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:49.313 02:32:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:49.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:49.313 02:32:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:49.313 02:32:13 -- common/autotest_common.sh@10 -- # set +x 00:20:49.313 [2024-11-27 02:32:13.793263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:49.313 [2024-11-27 02:32:13.793340] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2101167 ] 00:20:49.313 EAL: No free 2048 kB hugepages reported on node 1 00:20:49.313 [2024-11-27 02:32:13.852899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:49.313 [2024-11-27 02:32:13.939559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:50.246 02:32:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:50.246 02:32:14 -- common/autotest_common.sh@862 -- # return 0 00:20:50.246 02:32:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.504 [2024-11-27 02:32:15.070606] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:50.504 [2024-11-27 02:32:15.070674] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:50.504 request: 00:20:50.504 { 00:20:50.504 "name": "TLSTEST", 00:20:50.504 "trtype": "tcp", 00:20:50.504 "traddr": "10.0.0.2", 00:20:50.504 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:50.504 "adrfam": "ipv4", 00:20:50.504 "trsvcid": "4420", 00:20:50.504 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:50.504 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:50.504 "method": "bdev_nvme_attach_controller", 00:20:50.504 "req_id": 1 00:20:50.504 } 00:20:50.504 Got JSON-RPC error response 00:20:50.504 response: 00:20:50.504 { 00:20:50.504 "code": -22, 00:20:50.504 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:50.504 } 00:20:50.504 02:32:15 -- target/tls.sh@36 -- # killprocess 2101167 00:20:50.504 02:32:15 -- common/autotest_common.sh@936 -- # '[' -z 2101167 ']' 00:20:50.504 02:32:15 -- common/autotest_common.sh@940 -- # kill -0 2101167 00:20:50.504 02:32:15 -- common/autotest_common.sh@941 -- # uname 00:20:50.504 02:32:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.504 02:32:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2101167 00:20:50.504 02:32:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:50.504 02:32:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:50.504 02:32:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2101167' 00:20:50.504 killing process with pid 2101167 00:20:50.504 02:32:15 -- common/autotest_common.sh@955 -- # kill 2101167 00:20:50.504 Received shutdown signal, test time was about 10.000000 seconds 00:20:50.504 00:20:50.504 Latency(us) 00:20:50.504 [2024-11-27T01:32:15.139Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.504 [2024-11-27T01:32:15.139Z] =================================================================================================================== 00:20:50.504 [2024-11-27T01:32:15.139Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:50.504 02:32:15 -- common/autotest_common.sh@960 -- # wait 2101167 00:20:50.762 02:32:15 -- target/tls.sh@37 -- # return 1 00:20:50.762 02:32:15 -- common/autotest_common.sh@653 -- # es=1 00:20:50.762 02:32:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:50.762 02:32:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:50.762 02:32:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:50.762 02:32:15 -- target/tls.sh@183 -- # killprocess 2099401 00:20:50.762 02:32:15 -- common/autotest_common.sh@936 -- # '[' -z 2099401 ']' 00:20:50.762 02:32:15 -- common/autotest_common.sh@940 -- # kill -0 2099401 00:20:50.762 02:32:15 -- common/autotest_common.sh@941 -- # uname 00:20:50.762 02:32:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.762 02:32:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2099401 00:20:50.762 02:32:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:50.762 02:32:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:50.762 02:32:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2099401' 00:20:50.762 killing process with pid 2099401 00:20:50.762 02:32:15 -- common/autotest_common.sh@955 -- # kill 2099401 00:20:50.762 02:32:15 -- common/autotest_common.sh@960 -- # wait 2099401 00:20:51.020 02:32:15 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:51.020 02:32:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:51.020 02:32:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:51.020 02:32:15 -- common/autotest_common.sh@10 -- # set +x 00:20:51.020 02:32:15 -- nvmf/common.sh@469 -- # nvmfpid=2101355 00:20:51.020 02:32:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:51.020 02:32:15 -- nvmf/common.sh@470 -- # waitforlisten 2101355 00:20:51.020 02:32:15 -- common/autotest_common.sh@829 -- # '[' -z 2101355 ']' 00:20:51.020 02:32:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:51.020 02:32:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:51.020 02:32:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:51.020 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:51.020 02:32:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:51.020 02:32:15 -- common/autotest_common.sh@10 -- # set +x 00:20:51.020 [2024-11-27 02:32:15.638777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:51.020 [2024-11-27 02:32:15.638869] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:51.277 EAL: No free 2048 kB hugepages reported on node 1 00:20:51.277 [2024-11-27 02:32:15.706823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:51.278 [2024-11-27 02:32:15.792145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:51.278 [2024-11-27 02:32:15.792322] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:51.278 [2024-11-27 02:32:15.792342] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:51.278 [2024-11-27 02:32:15.792357] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:51.278 [2024-11-27 02:32:15.792389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:52.210 02:32:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:52.210 02:32:16 -- common/autotest_common.sh@862 -- # return 0 00:20:52.210 02:32:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:52.210 02:32:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:52.210 02:32:16 -- common/autotest_common.sh@10 -- # set +x 00:20:52.210 02:32:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:52.210 02:32:16 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.210 02:32:16 -- common/autotest_common.sh@650 -- # local es=0 00:20:52.210 02:32:16 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.210 02:32:16 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:52.210 02:32:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.210 02:32:16 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:52.210 02:32:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.210 02:32:16 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.210 02:32:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.210 02:32:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:52.469 [2024-11-27 02:32:16.898313] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:52.469 02:32:16 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:52.727 02:32:17 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:52.984 [2024-11-27 02:32:17.475897] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:52.984 [2024-11-27 02:32:17.476156] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:52.984 02:32:17 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:53.242 malloc0 00:20:53.242 02:32:17 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:53.500 02:32:18 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.758 [2024-11-27 02:32:18.286614] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:53.758 [2024-11-27 02:32:18.286654] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:53.758 [2024-11-27 02:32:18.286678] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:53.758 request: 00:20:53.758 { 00:20:53.758 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:53.758 "host": "nqn.2016-06.io.spdk:host1", 00:20:53.758 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:53.758 "method": "nvmf_subsystem_add_host", 00:20:53.758 "req_id": 1 00:20:53.758 } 00:20:53.758 Got JSON-RPC error response 00:20:53.758 response: 00:20:53.758 { 00:20:53.758 "code": -32603, 00:20:53.758 "message": "Internal error" 00:20:53.758 } 00:20:53.758 02:32:18 -- common/autotest_common.sh@653 -- # es=1 00:20:53.758 02:32:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:53.758 02:32:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:53.758 02:32:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:53.758 02:32:18 -- target/tls.sh@189 -- # killprocess 2101355 00:20:53.758 02:32:18 -- common/autotest_common.sh@936 -- # '[' -z 2101355 ']' 00:20:53.758 02:32:18 -- common/autotest_common.sh@940 -- # kill -0 2101355 00:20:53.758 02:32:18 -- common/autotest_common.sh@941 -- # uname 00:20:53.758 02:32:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:53.758 02:32:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2101355 00:20:53.758 02:32:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:53.758 02:32:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:53.758 02:32:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2101355' 00:20:53.758 killing process with pid 2101355 00:20:53.758 02:32:18 -- common/autotest_common.sh@955 -- # kill 2101355 00:20:53.758 02:32:18 -- common/autotest_common.sh@960 -- # wait 2101355 00:20:54.016 02:32:18 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.016 02:32:18 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:54.016 02:32:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:54.016 02:32:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:54.016 02:32:18 -- common/autotest_common.sh@10 -- # set +x 00:20:54.016 02:32:18 -- nvmf/common.sh@469 -- # nvmfpid=2101788 00:20:54.016 02:32:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:54.016 02:32:18 -- nvmf/common.sh@470 -- # waitforlisten 2101788 00:20:54.016 02:32:18 -- common/autotest_common.sh@829 -- # '[' -z 2101788 ']' 00:20:54.016 02:32:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:54.016 02:32:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:54.016 02:32:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:54.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:54.016 02:32:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:54.016 02:32:18 -- common/autotest_common.sh@10 -- # set +x 00:20:54.016 [2024-11-27 02:32:18.609656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:54.016 [2024-11-27 02:32:18.609735] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:54.016 EAL: No free 2048 kB hugepages reported on node 1 00:20:54.275 [2024-11-27 02:32:18.674800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:54.275 [2024-11-27 02:32:18.763470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:54.275 [2024-11-27 02:32:18.763682] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:54.275 [2024-11-27 02:32:18.763701] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:54.275 [2024-11-27 02:32:18.763714] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:54.275 [2024-11-27 02:32:18.763754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:55.207 02:32:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:55.207 02:32:19 -- common/autotest_common.sh@862 -- # return 0 00:20:55.207 02:32:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:55.207 02:32:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:55.207 02:32:19 -- common/autotest_common.sh@10 -- # set +x 00:20:55.207 02:32:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:55.207 02:32:19 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.207 02:32:19 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.207 02:32:19 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:55.466 [2024-11-27 02:32:19.886276] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:55.466 02:32:19 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:55.725 02:32:20 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:55.983 [2024-11-27 02:32:20.419763] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:55.983 [2024-11-27 02:32:20.420054] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:55.984 02:32:20 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:56.242 malloc0 00:20:56.242 02:32:20 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:56.501 02:32:20 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.759 02:32:21 -- target/tls.sh@197 -- # bdevperf_pid=2102096 00:20:56.759 02:32:21 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:56.759 02:32:21 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:56.759 02:32:21 -- target/tls.sh@200 -- # waitforlisten 2102096 /var/tmp/bdevperf.sock 00:20:56.759 02:32:21 -- common/autotest_common.sh@829 -- # '[' -z 2102096 ']' 00:20:56.759 02:32:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.759 02:32:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.759 02:32:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.759 02:32:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.759 02:32:21 -- common/autotest_common.sh@10 -- # set +x 00:20:56.759 [2024-11-27 02:32:21.260798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:56.759 [2024-11-27 02:32:21.260888] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2102096 ] 00:20:56.759 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.759 [2024-11-27 02:32:21.318941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:57.017 [2024-11-27 02:32:21.405096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:57.950 02:32:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:57.950 02:32:22 -- common/autotest_common.sh@862 -- # return 0 00:20:57.950 02:32:22 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.950 [2024-11-27 02:32:22.556875] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:58.209 TLSTESTn1 00:20:58.209 02:32:22 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:58.468 02:32:22 -- target/tls.sh@205 -- # tgtconf='{ 00:20:58.468 "subsystems": [ 00:20:58.468 { 00:20:58.468 "subsystem": "iobuf", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "iobuf_set_options", 00:20:58.468 "params": { 00:20:58.468 "small_pool_count": 8192, 00:20:58.468 "large_pool_count": 1024, 00:20:58.468 "small_bufsize": 8192, 00:20:58.468 "large_bufsize": 135168 00:20:58.468 } 00:20:58.468 } 00:20:58.468 ] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "sock", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "sock_impl_set_options", 00:20:58.468 "params": { 00:20:58.468 "impl_name": "posix", 00:20:58.468 "recv_buf_size": 2097152, 00:20:58.468 "send_buf_size": 2097152, 00:20:58.468 "enable_recv_pipe": true, 00:20:58.468 "enable_quickack": false, 00:20:58.468 "enable_placement_id": 0, 00:20:58.468 "enable_zerocopy_send_server": true, 00:20:58.468 "enable_zerocopy_send_client": false, 00:20:58.468 "zerocopy_threshold": 0, 00:20:58.468 "tls_version": 0, 00:20:58.468 "enable_ktls": false 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "sock_impl_set_options", 00:20:58.468 "params": { 00:20:58.468 "impl_name": "ssl", 00:20:58.468 "recv_buf_size": 4096, 00:20:58.468 "send_buf_size": 4096, 00:20:58.468 "enable_recv_pipe": true, 00:20:58.468 "enable_quickack": false, 00:20:58.468 "enable_placement_id": 0, 00:20:58.468 "enable_zerocopy_send_server": true, 00:20:58.468 "enable_zerocopy_send_client": false, 00:20:58.468 "zerocopy_threshold": 0, 00:20:58.468 "tls_version": 0, 00:20:58.468 "enable_ktls": false 00:20:58.468 } 00:20:58.468 } 00:20:58.468 ] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "vmd", 00:20:58.468 "config": [] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "accel", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "accel_set_options", 00:20:58.468 "params": { 00:20:58.468 "small_cache_size": 128, 00:20:58.468 "large_cache_size": 16, 00:20:58.468 "task_count": 2048, 00:20:58.468 "sequence_count": 2048, 00:20:58.468 "buf_count": 2048 00:20:58.468 } 00:20:58.468 } 00:20:58.468 ] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "bdev", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "bdev_set_options", 00:20:58.468 "params": { 00:20:58.468 "bdev_io_pool_size": 65535, 00:20:58.468 "bdev_io_cache_size": 256, 00:20:58.468 "bdev_auto_examine": true, 00:20:58.468 "iobuf_small_cache_size": 128, 00:20:58.468 "iobuf_large_cache_size": 16 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_raid_set_options", 00:20:58.468 "params": { 00:20:58.468 "process_window_size_kb": 1024 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_iscsi_set_options", 00:20:58.468 "params": { 00:20:58.468 "timeout_sec": 30 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_nvme_set_options", 00:20:58.468 "params": { 00:20:58.468 "action_on_timeout": "none", 00:20:58.468 "timeout_us": 0, 00:20:58.468 "timeout_admin_us": 0, 00:20:58.468 "keep_alive_timeout_ms": 10000, 00:20:58.468 "transport_retry_count": 4, 00:20:58.468 "arbitration_burst": 0, 00:20:58.468 "low_priority_weight": 0, 00:20:58.468 "medium_priority_weight": 0, 00:20:58.468 "high_priority_weight": 0, 00:20:58.468 "nvme_adminq_poll_period_us": 10000, 00:20:58.468 "nvme_ioq_poll_period_us": 0, 00:20:58.468 "io_queue_requests": 0, 00:20:58.468 "delay_cmd_submit": true, 00:20:58.468 "bdev_retry_count": 3, 00:20:58.468 "transport_ack_timeout": 0, 00:20:58.468 "ctrlr_loss_timeout_sec": 0, 00:20:58.468 "reconnect_delay_sec": 0, 00:20:58.468 "fast_io_fail_timeout_sec": 0, 00:20:58.468 "generate_uuids": false, 00:20:58.468 "transport_tos": 0, 00:20:58.468 "io_path_stat": false, 00:20:58.468 "allow_accel_sequence": false 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_nvme_set_hotplug", 00:20:58.468 "params": { 00:20:58.468 "period_us": 100000, 00:20:58.468 "enable": false 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_malloc_create", 00:20:58.468 "params": { 00:20:58.468 "name": "malloc0", 00:20:58.468 "num_blocks": 8192, 00:20:58.468 "block_size": 4096, 00:20:58.468 "physical_block_size": 4096, 00:20:58.468 "uuid": "447058ba-51cc-407f-a4e4-6099b3a7d8db", 00:20:58.468 "optimal_io_boundary": 0 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "bdev_wait_for_examine" 00:20:58.468 } 00:20:58.468 ] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "nbd", 00:20:58.468 "config": [] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "scheduler", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "framework_set_scheduler", 00:20:58.468 "params": { 00:20:58.468 "name": "static" 00:20:58.468 } 00:20:58.468 } 00:20:58.468 ] 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "subsystem": "nvmf", 00:20:58.468 "config": [ 00:20:58.468 { 00:20:58.468 "method": "nvmf_set_config", 00:20:58.468 "params": { 00:20:58.468 "discovery_filter": "match_any", 00:20:58.468 "admin_cmd_passthru": { 00:20:58.468 "identify_ctrlr": false 00:20:58.468 } 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "nvmf_set_max_subsystems", 00:20:58.468 "params": { 00:20:58.468 "max_subsystems": 1024 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "nvmf_set_crdt", 00:20:58.468 "params": { 00:20:58.468 "crdt1": 0, 00:20:58.468 "crdt2": 0, 00:20:58.468 "crdt3": 0 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "nvmf_create_transport", 00:20:58.468 "params": { 00:20:58.468 "trtype": "TCP", 00:20:58.468 "max_queue_depth": 128, 00:20:58.468 "max_io_qpairs_per_ctrlr": 127, 00:20:58.468 "in_capsule_data_size": 4096, 00:20:58.468 "max_io_size": 131072, 00:20:58.468 "io_unit_size": 131072, 00:20:58.468 "max_aq_depth": 128, 00:20:58.468 "num_shared_buffers": 511, 00:20:58.468 "buf_cache_size": 4294967295, 00:20:58.468 "dif_insert_or_strip": false, 00:20:58.468 "zcopy": false, 00:20:58.468 "c2h_success": false, 00:20:58.468 "sock_priority": 0, 00:20:58.468 "abort_timeout_sec": 1 00:20:58.468 } 00:20:58.468 }, 00:20:58.468 { 00:20:58.468 "method": "nvmf_create_subsystem", 00:20:58.468 "params": { 00:20:58.468 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.468 "allow_any_host": false, 00:20:58.469 "serial_number": "SPDK00000000000001", 00:20:58.469 "model_number": "SPDK bdev Controller", 00:20:58.469 "max_namespaces": 10, 00:20:58.469 "min_cntlid": 1, 00:20:58.469 "max_cntlid": 65519, 00:20:58.469 "ana_reporting": false 00:20:58.469 } 00:20:58.469 }, 00:20:58.469 { 00:20:58.469 "method": "nvmf_subsystem_add_host", 00:20:58.469 "params": { 00:20:58.469 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.469 "host": "nqn.2016-06.io.spdk:host1", 00:20:58.469 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:58.469 } 00:20:58.469 }, 00:20:58.469 { 00:20:58.469 "method": "nvmf_subsystem_add_ns", 00:20:58.469 "params": { 00:20:58.469 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.469 "namespace": { 00:20:58.469 "nsid": 1, 00:20:58.469 "bdev_name": "malloc0", 00:20:58.469 "nguid": "447058BA51CC407FA4E46099B3A7D8DB", 00:20:58.469 "uuid": "447058ba-51cc-407f-a4e4-6099b3a7d8db" 00:20:58.469 } 00:20:58.469 } 00:20:58.469 }, 00:20:58.469 { 00:20:58.469 "method": "nvmf_subsystem_add_listener", 00:20:58.469 "params": { 00:20:58.469 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.469 "listen_address": { 00:20:58.469 "trtype": "TCP", 00:20:58.469 "adrfam": "IPv4", 00:20:58.469 "traddr": "10.0.0.2", 00:20:58.469 "trsvcid": "4420" 00:20:58.469 }, 00:20:58.469 "secure_channel": true 00:20:58.469 } 00:20:58.469 } 00:20:58.469 ] 00:20:58.469 } 00:20:58.469 ] 00:20:58.469 }' 00:20:58.469 02:32:22 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:58.727 02:32:23 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:58.727 "subsystems": [ 00:20:58.727 { 00:20:58.727 "subsystem": "iobuf", 00:20:58.727 "config": [ 00:20:58.727 { 00:20:58.727 "method": "iobuf_set_options", 00:20:58.727 "params": { 00:20:58.727 "small_pool_count": 8192, 00:20:58.727 "large_pool_count": 1024, 00:20:58.727 "small_bufsize": 8192, 00:20:58.727 "large_bufsize": 135168 00:20:58.727 } 00:20:58.727 } 00:20:58.727 ] 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "subsystem": "sock", 00:20:58.727 "config": [ 00:20:58.727 { 00:20:58.727 "method": "sock_impl_set_options", 00:20:58.727 "params": { 00:20:58.727 "impl_name": "posix", 00:20:58.727 "recv_buf_size": 2097152, 00:20:58.727 "send_buf_size": 2097152, 00:20:58.727 "enable_recv_pipe": true, 00:20:58.727 "enable_quickack": false, 00:20:58.727 "enable_placement_id": 0, 00:20:58.727 "enable_zerocopy_send_server": true, 00:20:58.727 "enable_zerocopy_send_client": false, 00:20:58.727 "zerocopy_threshold": 0, 00:20:58.727 "tls_version": 0, 00:20:58.727 "enable_ktls": false 00:20:58.727 } 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "method": "sock_impl_set_options", 00:20:58.727 "params": { 00:20:58.727 "impl_name": "ssl", 00:20:58.727 "recv_buf_size": 4096, 00:20:58.727 "send_buf_size": 4096, 00:20:58.727 "enable_recv_pipe": true, 00:20:58.727 "enable_quickack": false, 00:20:58.727 "enable_placement_id": 0, 00:20:58.727 "enable_zerocopy_send_server": true, 00:20:58.727 "enable_zerocopy_send_client": false, 00:20:58.727 "zerocopy_threshold": 0, 00:20:58.727 "tls_version": 0, 00:20:58.727 "enable_ktls": false 00:20:58.727 } 00:20:58.727 } 00:20:58.727 ] 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "subsystem": "vmd", 00:20:58.727 "config": [] 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "subsystem": "accel", 00:20:58.727 "config": [ 00:20:58.727 { 00:20:58.727 "method": "accel_set_options", 00:20:58.727 "params": { 00:20:58.727 "small_cache_size": 128, 00:20:58.727 "large_cache_size": 16, 00:20:58.727 "task_count": 2048, 00:20:58.727 "sequence_count": 2048, 00:20:58.727 "buf_count": 2048 00:20:58.727 } 00:20:58.727 } 00:20:58.727 ] 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "subsystem": "bdev", 00:20:58.727 "config": [ 00:20:58.727 { 00:20:58.727 "method": "bdev_set_options", 00:20:58.727 "params": { 00:20:58.727 "bdev_io_pool_size": 65535, 00:20:58.727 "bdev_io_cache_size": 256, 00:20:58.727 "bdev_auto_examine": true, 00:20:58.727 "iobuf_small_cache_size": 128, 00:20:58.727 "iobuf_large_cache_size": 16 00:20:58.727 } 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "method": "bdev_raid_set_options", 00:20:58.727 "params": { 00:20:58.727 "process_window_size_kb": 1024 00:20:58.727 } 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "method": "bdev_iscsi_set_options", 00:20:58.727 "params": { 00:20:58.727 "timeout_sec": 30 00:20:58.727 } 00:20:58.727 }, 00:20:58.727 { 00:20:58.727 "method": "bdev_nvme_set_options", 00:20:58.727 "params": { 00:20:58.728 "action_on_timeout": "none", 00:20:58.728 "timeout_us": 0, 00:20:58.728 "timeout_admin_us": 0, 00:20:58.728 "keep_alive_timeout_ms": 10000, 00:20:58.728 "transport_retry_count": 4, 00:20:58.728 "arbitration_burst": 0, 00:20:58.728 "low_priority_weight": 0, 00:20:58.728 "medium_priority_weight": 0, 00:20:58.728 "high_priority_weight": 0, 00:20:58.728 "nvme_adminq_poll_period_us": 10000, 00:20:58.728 "nvme_ioq_poll_period_us": 0, 00:20:58.728 "io_queue_requests": 512, 00:20:58.728 "delay_cmd_submit": true, 00:20:58.728 "bdev_retry_count": 3, 00:20:58.728 "transport_ack_timeout": 0, 00:20:58.728 "ctrlr_loss_timeout_sec": 0, 00:20:58.728 "reconnect_delay_sec": 0, 00:20:58.728 "fast_io_fail_timeout_sec": 0, 00:20:58.728 "generate_uuids": false, 00:20:58.728 "transport_tos": 0, 00:20:58.728 "io_path_stat": false, 00:20:58.728 "allow_accel_sequence": false 00:20:58.728 } 00:20:58.728 }, 00:20:58.728 { 00:20:58.728 "method": "bdev_nvme_attach_controller", 00:20:58.728 "params": { 00:20:58.728 "name": "TLSTEST", 00:20:58.728 "trtype": "TCP", 00:20:58.728 "adrfam": "IPv4", 00:20:58.728 "traddr": "10.0.0.2", 00:20:58.728 "trsvcid": "4420", 00:20:58.728 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.728 "prchk_reftag": false, 00:20:58.728 "prchk_guard": false, 00:20:58.728 "ctrlr_loss_timeout_sec": 0, 00:20:58.728 "reconnect_delay_sec": 0, 00:20:58.728 "fast_io_fail_timeout_sec": 0, 00:20:58.728 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:58.728 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:58.728 "hdgst": false, 00:20:58.728 "ddgst": false 00:20:58.728 } 00:20:58.728 }, 00:20:58.728 { 00:20:58.728 "method": "bdev_nvme_set_hotplug", 00:20:58.728 "params": { 00:20:58.728 "period_us": 100000, 00:20:58.728 "enable": false 00:20:58.728 } 00:20:58.728 }, 00:20:58.728 { 00:20:58.728 "method": "bdev_wait_for_examine" 00:20:58.728 } 00:20:58.728 ] 00:20:58.728 }, 00:20:58.728 { 00:20:58.728 "subsystem": "nbd", 00:20:58.728 "config": [] 00:20:58.728 } 00:20:58.728 ] 00:20:58.728 }' 00:20:58.728 02:32:23 -- target/tls.sh@208 -- # killprocess 2102096 00:20:58.728 02:32:23 -- common/autotest_common.sh@936 -- # '[' -z 2102096 ']' 00:20:58.728 02:32:23 -- common/autotest_common.sh@940 -- # kill -0 2102096 00:20:58.728 02:32:23 -- common/autotest_common.sh@941 -- # uname 00:20:58.728 02:32:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.728 02:32:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2102096 00:20:58.728 02:32:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:58.728 02:32:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:58.728 02:32:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2102096' 00:20:58.728 killing process with pid 2102096 00:20:58.728 02:32:23 -- common/autotest_common.sh@955 -- # kill 2102096 00:20:58.728 Received shutdown signal, test time was about 10.000000 seconds 00:20:58.728 00:20:58.728 Latency(us) 00:20:58.728 [2024-11-27T01:32:23.363Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:58.728 [2024-11-27T01:32:23.363Z] =================================================================================================================== 00:20:58.728 [2024-11-27T01:32:23.363Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:58.728 02:32:23 -- common/autotest_common.sh@960 -- # wait 2102096 00:20:58.986 02:32:23 -- target/tls.sh@209 -- # killprocess 2101788 00:20:58.986 02:32:23 -- common/autotest_common.sh@936 -- # '[' -z 2101788 ']' 00:20:58.986 02:32:23 -- common/autotest_common.sh@940 -- # kill -0 2101788 00:20:58.986 02:32:23 -- common/autotest_common.sh@941 -- # uname 00:20:58.986 02:32:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.986 02:32:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2101788 00:20:58.986 02:32:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:58.986 02:32:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:58.986 02:32:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2101788' 00:20:58.986 killing process with pid 2101788 00:20:58.986 02:32:23 -- common/autotest_common.sh@955 -- # kill 2101788 00:20:58.986 02:32:23 -- common/autotest_common.sh@960 -- # wait 2101788 00:20:59.245 02:32:23 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:59.245 02:32:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:59.245 02:32:23 -- target/tls.sh@212 -- # echo '{ 00:20:59.245 "subsystems": [ 00:20:59.245 { 00:20:59.245 "subsystem": "iobuf", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "iobuf_set_options", 00:20:59.245 "params": { 00:20:59.245 "small_pool_count": 8192, 00:20:59.245 "large_pool_count": 1024, 00:20:59.245 "small_bufsize": 8192, 00:20:59.245 "large_bufsize": 135168 00:20:59.245 } 00:20:59.245 } 00:20:59.245 ] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "sock", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "sock_impl_set_options", 00:20:59.245 "params": { 00:20:59.245 "impl_name": "posix", 00:20:59.245 "recv_buf_size": 2097152, 00:20:59.245 "send_buf_size": 2097152, 00:20:59.245 "enable_recv_pipe": true, 00:20:59.245 "enable_quickack": false, 00:20:59.245 "enable_placement_id": 0, 00:20:59.245 "enable_zerocopy_send_server": true, 00:20:59.245 "enable_zerocopy_send_client": false, 00:20:59.245 "zerocopy_threshold": 0, 00:20:59.245 "tls_version": 0, 00:20:59.245 "enable_ktls": false 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "sock_impl_set_options", 00:20:59.245 "params": { 00:20:59.245 "impl_name": "ssl", 00:20:59.245 "recv_buf_size": 4096, 00:20:59.245 "send_buf_size": 4096, 00:20:59.245 "enable_recv_pipe": true, 00:20:59.245 "enable_quickack": false, 00:20:59.245 "enable_placement_id": 0, 00:20:59.245 "enable_zerocopy_send_server": true, 00:20:59.245 "enable_zerocopy_send_client": false, 00:20:59.245 "zerocopy_threshold": 0, 00:20:59.245 "tls_version": 0, 00:20:59.245 "enable_ktls": false 00:20:59.245 } 00:20:59.245 } 00:20:59.245 ] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "vmd", 00:20:59.245 "config": [] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "accel", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "accel_set_options", 00:20:59.245 "params": { 00:20:59.245 "small_cache_size": 128, 00:20:59.245 "large_cache_size": 16, 00:20:59.245 "task_count": 2048, 00:20:59.245 "sequence_count": 2048, 00:20:59.245 "buf_count": 2048 00:20:59.245 } 00:20:59.245 } 00:20:59.245 ] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "bdev", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "bdev_set_options", 00:20:59.245 "params": { 00:20:59.245 "bdev_io_pool_size": 65535, 00:20:59.245 "bdev_io_cache_size": 256, 00:20:59.245 "bdev_auto_examine": true, 00:20:59.245 "iobuf_small_cache_size": 128, 00:20:59.245 "iobuf_large_cache_size": 16 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_raid_set_options", 00:20:59.245 "params": { 00:20:59.245 "process_window_size_kb": 1024 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_iscsi_set_options", 00:20:59.245 "params": { 00:20:59.245 "timeout_sec": 30 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_nvme_set_options", 00:20:59.245 "params": { 00:20:59.245 "action_on_timeout": "none", 00:20:59.245 "timeout_us": 0, 00:20:59.245 "timeout_admin_us": 0, 00:20:59.245 "keep_alive_timeout_ms": 10000, 00:20:59.245 "transport_retry_count": 4, 00:20:59.245 "arbitration_burst": 0, 00:20:59.245 "low_priority_weight": 0, 00:20:59.245 "medium_priority_weight": 0, 00:20:59.245 "high_priority_weight": 0, 00:20:59.245 "nvme_adminq_poll_period_us": 10000, 00:20:59.245 "nvme_ioq_poll_period_us": 0, 00:20:59.245 "io_queue_requests": 0, 00:20:59.245 "delay_cmd_submit": true, 00:20:59.245 "bdev_retry_count": 3, 00:20:59.245 "transport_ack_timeout": 0, 00:20:59.245 "ctrlr_loss_timeout_sec": 0, 00:20:59.245 "reconnect_delay_sec": 0, 00:20:59.245 "fast_io_fail_timeout_sec": 0, 00:20:59.245 "generate_uuids": false, 00:20:59.245 "transport_tos": 0, 00:20:59.245 "io_path_stat": false, 00:20:59.245 "allow_accel_sequence": false 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_nvme_set_hotplug", 00:20:59.245 "params": { 00:20:59.245 "period_us": 100000, 00:20:59.245 "enable": false 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_malloc_create", 00:20:59.245 "params": { 00:20:59.245 "name": "malloc0", 00:20:59.245 "num_blocks": 8192, 00:20:59.245 "block_size": 4096, 00:20:59.245 "physical_block_size": 4096, 00:20:59.245 "uuid": "447058ba-51cc-407f-a4e4-6099b3a7d8db", 00:20:59.245 "optimal_io_boundary": 0 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "bdev_wait_for_examine" 00:20:59.245 } 00:20:59.245 ] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "nbd", 00:20:59.245 "config": [] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "sch 02:32:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:59.245 eduler", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "framework_set_scheduler", 00:20:59.245 "params": { 00:20:59.245 "name": "static" 00:20:59.245 } 00:20:59.245 } 00:20:59.245 ] 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "subsystem": "nvmf", 00:20:59.245 "config": [ 00:20:59.245 { 00:20:59.245 "method": "nvmf_set_config", 00:20:59.245 "params": { 00:20:59.245 "discovery_filter": "match_any", 00:20:59.245 "admin_cmd_passthru": { 00:20:59.245 "identify_ctrlr": false 00:20:59.245 } 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "nvmf_set_max_subsystems", 00:20:59.245 "params": { 00:20:59.245 "max_subsystems": 1024 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "nvmf_set_crdt", 00:20:59.245 "params": { 00:20:59.245 "crdt1": 0, 00:20:59.245 "crdt2": 0, 00:20:59.245 "crdt3": 0 00:20:59.245 } 00:20:59.245 }, 00:20:59.245 { 00:20:59.245 "method": "nvmf_create_transport", 00:20:59.245 "params": { 00:20:59.245 "trtype": "TCP", 00:20:59.245 "max_queue_depth": 128, 00:20:59.245 "max_io_qpairs_per_ctrlr": 127, 00:20:59.245 "in_capsule_data_size": 4096, 00:20:59.245 "max_io_size": 131072, 00:20:59.245 "io_unit_size": 131072, 00:20:59.245 "max_aq_depth": 128, 00:20:59.246 "num_shared_buffers": 511, 00:20:59.246 "buf_cache_size": 4294967295, 00:20:59.246 "dif_insert_or_strip": false, 00:20:59.246 "zcopy": false, 00:20:59.246 "c2h_success": false, 00:20:59.246 "sock_priority": 0, 00:20:59.246 "abort_timeout_sec": 1 00:20:59.246 } 00:20:59.246 }, 00:20:59.246 { 00:20:59.246 "method": "nvmf_create_subsystem", 00:20:59.246 "params": { 00:20:59.246 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.246 "allow_any_host": false, 00:20:59.246 "serial_number": "SPDK00000000000001", 00:20:59.246 "model_number": "SPDK bdev Controller", 00:20:59.246 "max_namespaces": 10, 00:20:59.246 "min_cntlid": 1, 00:20:59.246 "max_cntlid": 65519, 00:20:59.246 "ana_reporting": false 00:20:59.246 } 00:20:59.246 }, 00:20:59.246 { 00:20:59.246 "method": "nvmf_subsystem_add_host", 00:20:59.246 "params": { 00:20:59.246 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.246 "host": "nqn.2016-06.io.spdk:host1", 00:20:59.246 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:59.246 } 00:20:59.246 }, 00:20:59.246 { 00:20:59.246 "method": "nvmf_subsystem_add_ns", 00:20:59.246 "params": { 00:20:59.246 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.246 "namespace": { 00:20:59.246 "nsid": 1, 00:20:59.246 "bdev_name": "malloc0", 00:20:59.246 "nguid": "447058BA51CC407FA4E46099B3A7D8DB", 00:20:59.246 "uuid": "447058ba-51cc-407f-a4e4-6099b3a7d8db" 00:20:59.246 } 00:20:59.246 } 00:20:59.246 }, 00:20:59.246 { 00:20:59.246 "method": "nvmf_subsystem_add_listener", 00:20:59.246 "params": { 00:20:59.246 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.246 "listen_address": { 00:20:59.246 "trtype": "TCP", 00:20:59.246 "adrfam": "IPv4", 00:20:59.246 "traddr": "10.0.0.2", 00:20:59.246 "trsvcid": "4420" 00:20:59.246 }, 00:20:59.246 "secure_channel": true 00:20:59.246 } 00:20:59.246 } 00:20:59.246 ] 00:20:59.246 } 00:20:59.246 ] 00:20:59.246 }' 00:20:59.246 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:20:59.246 02:32:23 -- nvmf/common.sh@469 -- # nvmfpid=2102402 00:20:59.246 02:32:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:59.246 02:32:23 -- nvmf/common.sh@470 -- # waitforlisten 2102402 00:20:59.246 02:32:23 -- common/autotest_common.sh@829 -- # '[' -z 2102402 ']' 00:20:59.246 02:32:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:59.246 02:32:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:59.246 02:32:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:59.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:59.246 02:32:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:59.246 02:32:23 -- common/autotest_common.sh@10 -- # set +x 00:20:59.504 [2024-11-27 02:32:23.885156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:59.504 [2024-11-27 02:32:23.885259] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.504 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.504 [2024-11-27 02:32:23.956682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.504 [2024-11-27 02:32:24.045006] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:59.504 [2024-11-27 02:32:24.045173] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:59.504 [2024-11-27 02:32:24.045192] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:59.504 [2024-11-27 02:32:24.045205] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:59.504 [2024-11-27 02:32:24.045252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:59.763 [2024-11-27 02:32:24.272961] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:59.763 [2024-11-27 02:32:24.304987] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:59.763 [2024-11-27 02:32:24.305251] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:00.329 02:32:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:00.329 02:32:24 -- common/autotest_common.sh@862 -- # return 0 00:21:00.330 02:32:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:00.330 02:32:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:00.330 02:32:24 -- common/autotest_common.sh@10 -- # set +x 00:21:00.330 02:32:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.330 02:32:24 -- target/tls.sh@216 -- # bdevperf_pid=2102541 00:21:00.330 02:32:24 -- target/tls.sh@217 -- # waitforlisten 2102541 /var/tmp/bdevperf.sock 00:21:00.330 02:32:24 -- common/autotest_common.sh@829 -- # '[' -z 2102541 ']' 00:21:00.330 02:32:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:00.330 02:32:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.330 02:32:24 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:00.330 02:32:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:00.330 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:00.330 02:32:24 -- target/tls.sh@213 -- # echo '{ 00:21:00.330 "subsystems": [ 00:21:00.330 { 00:21:00.330 "subsystem": "iobuf", 00:21:00.330 "config": [ 00:21:00.330 { 00:21:00.330 "method": "iobuf_set_options", 00:21:00.330 "params": { 00:21:00.330 "small_pool_count": 8192, 00:21:00.330 "large_pool_count": 1024, 00:21:00.330 "small_bufsize": 8192, 00:21:00.330 "large_bufsize": 135168 00:21:00.330 } 00:21:00.330 } 00:21:00.330 ] 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "subsystem": "sock", 00:21:00.330 "config": [ 00:21:00.330 { 00:21:00.330 "method": "sock_impl_set_options", 00:21:00.330 "params": { 00:21:00.330 "impl_name": "posix", 00:21:00.330 "recv_buf_size": 2097152, 00:21:00.330 "send_buf_size": 2097152, 00:21:00.330 "enable_recv_pipe": true, 00:21:00.330 "enable_quickack": false, 00:21:00.330 "enable_placement_id": 0, 00:21:00.330 "enable_zerocopy_send_server": true, 00:21:00.330 "enable_zerocopy_send_client": false, 00:21:00.330 "zerocopy_threshold": 0, 00:21:00.330 "tls_version": 0, 00:21:00.330 "enable_ktls": false 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "sock_impl_set_options", 00:21:00.330 "params": { 00:21:00.330 "impl_name": "ssl", 00:21:00.330 "recv_buf_size": 4096, 00:21:00.330 "send_buf_size": 4096, 00:21:00.330 "enable_recv_pipe": true, 00:21:00.330 "enable_quickack": false, 00:21:00.330 "enable_placement_id": 0, 00:21:00.330 "enable_zerocopy_send_server": true, 00:21:00.330 "enable_zerocopy_send_client": false, 00:21:00.330 "zerocopy_threshold": 0, 00:21:00.330 "tls_version": 0, 00:21:00.330 "enable_ktls": false 00:21:00.330 } 00:21:00.330 } 00:21:00.330 ] 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "subsystem": "vmd", 00:21:00.330 "config": [] 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "subsystem": "accel", 00:21:00.330 "config": [ 00:21:00.330 { 00:21:00.330 "method": "accel_set_options", 00:21:00.330 "params": { 00:21:00.330 "small_cache_size": 128, 00:21:00.330 "large_cache_size": 16, 00:21:00.330 "task_count": 2048, 00:21:00.330 "sequence_count": 2048, 00:21:00.330 "buf_count": 2048 00:21:00.330 } 00:21:00.330 } 00:21:00.330 ] 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "subsystem": "bdev", 00:21:00.330 "config": [ 00:21:00.330 { 00:21:00.330 "method": "bdev_set_options", 00:21:00.330 "params": { 00:21:00.330 "bdev_io_pool_size": 65535, 00:21:00.330 "bdev_io_cache_size": 256, 00:21:00.330 "bdev_auto_examine": true, 00:21:00.330 "iobuf_small_cache_size": 128, 00:21:00.330 "iobuf_large_cache_size": 16 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_raid_set_options", 00:21:00.330 "params": { 00:21:00.330 "process_window_size_kb": 1024 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_iscsi_set_options", 00:21:00.330 "params": { 00:21:00.330 "timeout_sec": 30 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_nvme_set_options", 00:21:00.330 "params": { 00:21:00.330 "action_on_timeout": "none", 00:21:00.330 "timeout_us": 0, 00:21:00.330 "timeout_admin_us": 0, 00:21:00.330 "keep_alive_timeout_ms": 10000, 00:21:00.330 "transport_retry_count": 4, 00:21:00.330 "arbitration_burst": 0, 00:21:00.330 "low_priority_weight": 0, 00:21:00.330 "medium_priority_weight": 0, 00:21:00.330 "high_priority_weight": 0, 00:21:00.330 "nvme_adminq_poll_period_us": 10000, 00:21:00.330 "nvme_ioq_poll_period_us": 0, 00:21:00.330 "io_queue_requests": 512, 00:21:00.330 "delay_cmd_submit": true, 00:21:00.330 "bdev_retry_count": 3, 00:21:00.330 "transport_ack_timeout": 0, 00:21:00.330 "ctrlr_loss_timeout_sec": 0, 00:21:00.330 "reconnect_delay_sec": 0, 00:21:00.330 "fast_io_fail_timeout_sec": 0, 00:21:00.330 "generate_uuids": false, 00:21:00.330 "transport_tos": 0, 00:21:00.330 "io_path_stat": false, 00:21:00.330 "allow_accel_sequence": false 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_nvme_attach_controller", 00:21:00.330 "params": { 00:21:00.330 "name": "TLSTEST", 00:21:00.330 "trtype": "TCP", 00:21:00.330 "adrfam": "IPv4", 00:21:00.330 "traddr": "10.0.0.2", 00:21:00.330 "trsvcid": "4420", 00:21:00.330 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.330 "prchk_reftag": false, 00:21:00.330 "prchk_guard": false, 00:21:00.330 "ctrlr_loss_timeout_sec": 0, 00:21:00.330 "reconnect_delay_sec": 0, 00:21:00.330 "fast_io_fail_timeout_sec": 0, 00:21:00.330 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:00.330 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:00.330 "hdgst": false, 00:21:00.330 "ddgst": false 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_nvme_set_hotplug", 00:21:00.330 "params": { 00:21:00.330 "period_us": 100000, 00:21:00.330 "enable": false 00:21:00.330 } 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "method": "bdev_wait_for_examine" 00:21:00.330 } 00:21:00.330 ] 00:21:00.330 }, 00:21:00.330 { 00:21:00.330 "subsystem": "nbd", 00:21:00.330 "config": [] 00:21:00.330 } 00:21:00.330 ] 00:21:00.330 }' 00:21:00.330 02:32:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.330 02:32:24 -- common/autotest_common.sh@10 -- # set +x 00:21:00.330 [2024-11-27 02:32:24.891278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:00.330 [2024-11-27 02:32:24.891354] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2102541 ] 00:21:00.330 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.330 [2024-11-27 02:32:24.949006] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.589 [2024-11-27 02:32:25.034796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:00.589 [2024-11-27 02:32:25.191844] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:01.578 02:32:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.578 02:32:25 -- common/autotest_common.sh@862 -- # return 0 00:21:01.578 02:32:25 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:01.578 Running I/O for 10 seconds... 00:21:11.566 00:21:11.566 Latency(us) 00:21:11.566 [2024-11-27T01:32:36.202Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:11.567 [2024-11-27T01:32:36.202Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:11.567 Verification LBA range: start 0x0 length 0x2000 00:21:11.567 TLSTESTn1 : 10.02 4540.36 17.74 0.00 0.00 28148.87 5291.43 46020.84 00:21:11.567 [2024-11-27T01:32:36.202Z] =================================================================================================================== 00:21:11.567 [2024-11-27T01:32:36.202Z] Total : 4540.36 17.74 0.00 0.00 28148.87 5291.43 46020.84 00:21:11.567 0 00:21:11.567 02:32:36 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:11.567 02:32:36 -- target/tls.sh@223 -- # killprocess 2102541 00:21:11.567 02:32:36 -- common/autotest_common.sh@936 -- # '[' -z 2102541 ']' 00:21:11.567 02:32:36 -- common/autotest_common.sh@940 -- # kill -0 2102541 00:21:11.567 02:32:36 -- common/autotest_common.sh@941 -- # uname 00:21:11.567 02:32:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:11.567 02:32:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2102541 00:21:11.567 02:32:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:11.567 02:32:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:11.567 02:32:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2102541' 00:21:11.567 killing process with pid 2102541 00:21:11.567 02:32:36 -- common/autotest_common.sh@955 -- # kill 2102541 00:21:11.567 Received shutdown signal, test time was about 10.000000 seconds 00:21:11.567 00:21:11.567 Latency(us) 00:21:11.567 [2024-11-27T01:32:36.202Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:11.567 [2024-11-27T01:32:36.202Z] =================================================================================================================== 00:21:11.567 [2024-11-27T01:32:36.202Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:11.567 02:32:36 -- common/autotest_common.sh@960 -- # wait 2102541 00:21:11.824 02:32:36 -- target/tls.sh@224 -- # killprocess 2102402 00:21:11.824 02:32:36 -- common/autotest_common.sh@936 -- # '[' -z 2102402 ']' 00:21:11.824 02:32:36 -- common/autotest_common.sh@940 -- # kill -0 2102402 00:21:11.824 02:32:36 -- common/autotest_common.sh@941 -- # uname 00:21:11.824 02:32:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:11.824 02:32:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2102402 00:21:11.824 02:32:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:11.824 02:32:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:11.824 02:32:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2102402' 00:21:11.824 killing process with pid 2102402 00:21:11.824 02:32:36 -- common/autotest_common.sh@955 -- # kill 2102402 00:21:11.824 02:32:36 -- common/autotest_common.sh@960 -- # wait 2102402 00:21:12.083 02:32:36 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:12.083 02:32:36 -- target/tls.sh@227 -- # cleanup 00:21:12.083 02:32:36 -- target/tls.sh@15 -- # process_shm --id 0 00:21:12.083 02:32:36 -- common/autotest_common.sh@806 -- # type=--id 00:21:12.083 02:32:36 -- common/autotest_common.sh@807 -- # id=0 00:21:12.083 02:32:36 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:12.083 02:32:36 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:12.083 02:32:36 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:12.083 02:32:36 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:12.083 02:32:36 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:12.083 02:32:36 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:12.083 nvmf_trace.0 00:21:12.083 02:32:36 -- common/autotest_common.sh@821 -- # return 0 00:21:12.083 02:32:36 -- target/tls.sh@16 -- # killprocess 2102541 00:21:12.083 02:32:36 -- common/autotest_common.sh@936 -- # '[' -z 2102541 ']' 00:21:12.083 02:32:36 -- common/autotest_common.sh@940 -- # kill -0 2102541 00:21:12.083 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2102541) - No such process 00:21:12.083 02:32:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2102541 is not found' 00:21:12.083 Process with pid 2102541 is not found 00:21:12.083 02:32:36 -- target/tls.sh@17 -- # nvmftestfini 00:21:12.083 02:32:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:12.083 02:32:36 -- nvmf/common.sh@116 -- # sync 00:21:12.083 02:32:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:12.083 02:32:36 -- nvmf/common.sh@119 -- # set +e 00:21:12.083 02:32:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:12.083 02:32:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:12.083 rmmod nvme_tcp 00:21:12.083 rmmod nvme_fabrics 00:21:12.083 rmmod nvme_keyring 00:21:12.342 02:32:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:12.342 02:32:36 -- nvmf/common.sh@123 -- # set -e 00:21:12.342 02:32:36 -- nvmf/common.sh@124 -- # return 0 00:21:12.342 02:32:36 -- nvmf/common.sh@477 -- # '[' -n 2102402 ']' 00:21:12.342 02:32:36 -- nvmf/common.sh@478 -- # killprocess 2102402 00:21:12.342 02:32:36 -- common/autotest_common.sh@936 -- # '[' -z 2102402 ']' 00:21:12.342 02:32:36 -- common/autotest_common.sh@940 -- # kill -0 2102402 00:21:12.342 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2102402) - No such process 00:21:12.342 02:32:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2102402 is not found' 00:21:12.342 Process with pid 2102402 is not found 00:21:12.342 02:32:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:12.342 02:32:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:12.342 02:32:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:12.342 02:32:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:12.342 02:32:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:12.342 02:32:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:12.342 02:32:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:12.342 02:32:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:14.241 02:32:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:14.242 02:32:38 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:14.242 00:21:14.242 real 1m14.719s 00:21:14.242 user 2m2.452s 00:21:14.242 sys 0m22.184s 00:21:14.242 02:32:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:14.242 02:32:38 -- common/autotest_common.sh@10 -- # set +x 00:21:14.242 ************************************ 00:21:14.242 END TEST nvmf_tls 00:21:14.242 ************************************ 00:21:14.242 02:32:38 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:14.242 02:32:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:14.242 02:32:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:14.242 02:32:38 -- common/autotest_common.sh@10 -- # set +x 00:21:14.242 ************************************ 00:21:14.242 START TEST nvmf_fips 00:21:14.242 ************************************ 00:21:14.242 02:32:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:14.242 * Looking for test storage... 00:21:14.242 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:14.242 02:32:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:14.242 02:32:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:14.242 02:32:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:14.501 02:32:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:14.501 02:32:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:14.501 02:32:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:14.501 02:32:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:14.501 02:32:38 -- scripts/common.sh@335 -- # IFS=.-: 00:21:14.501 02:32:38 -- scripts/common.sh@335 -- # read -ra ver1 00:21:14.501 02:32:38 -- scripts/common.sh@336 -- # IFS=.-: 00:21:14.501 02:32:38 -- scripts/common.sh@336 -- # read -ra ver2 00:21:14.501 02:32:38 -- scripts/common.sh@337 -- # local 'op=<' 00:21:14.501 02:32:38 -- scripts/common.sh@339 -- # ver1_l=2 00:21:14.501 02:32:38 -- scripts/common.sh@340 -- # ver2_l=1 00:21:14.501 02:32:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:14.501 02:32:38 -- scripts/common.sh@343 -- # case "$op" in 00:21:14.501 02:32:38 -- scripts/common.sh@344 -- # : 1 00:21:14.501 02:32:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:14.501 02:32:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:14.501 02:32:38 -- scripts/common.sh@364 -- # decimal 1 00:21:14.501 02:32:38 -- scripts/common.sh@352 -- # local d=1 00:21:14.501 02:32:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:14.501 02:32:38 -- scripts/common.sh@354 -- # echo 1 00:21:14.501 02:32:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:14.501 02:32:38 -- scripts/common.sh@365 -- # decimal 2 00:21:14.501 02:32:38 -- scripts/common.sh@352 -- # local d=2 00:21:14.501 02:32:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:14.501 02:32:38 -- scripts/common.sh@354 -- # echo 2 00:21:14.501 02:32:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:14.501 02:32:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:14.501 02:32:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:14.501 02:32:38 -- scripts/common.sh@367 -- # return 0 00:21:14.501 02:32:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:14.501 02:32:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:14.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:14.501 --rc genhtml_branch_coverage=1 00:21:14.501 --rc genhtml_function_coverage=1 00:21:14.501 --rc genhtml_legend=1 00:21:14.501 --rc geninfo_all_blocks=1 00:21:14.501 --rc geninfo_unexecuted_blocks=1 00:21:14.501 00:21:14.501 ' 00:21:14.501 02:32:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:14.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:14.501 --rc genhtml_branch_coverage=1 00:21:14.501 --rc genhtml_function_coverage=1 00:21:14.501 --rc genhtml_legend=1 00:21:14.501 --rc geninfo_all_blocks=1 00:21:14.501 --rc geninfo_unexecuted_blocks=1 00:21:14.501 00:21:14.501 ' 00:21:14.501 02:32:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:14.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:14.501 --rc genhtml_branch_coverage=1 00:21:14.501 --rc genhtml_function_coverage=1 00:21:14.501 --rc genhtml_legend=1 00:21:14.501 --rc geninfo_all_blocks=1 00:21:14.501 --rc geninfo_unexecuted_blocks=1 00:21:14.501 00:21:14.501 ' 00:21:14.501 02:32:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:14.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:14.501 --rc genhtml_branch_coverage=1 00:21:14.501 --rc genhtml_function_coverage=1 00:21:14.501 --rc genhtml_legend=1 00:21:14.501 --rc geninfo_all_blocks=1 00:21:14.501 --rc geninfo_unexecuted_blocks=1 00:21:14.501 00:21:14.501 ' 00:21:14.501 02:32:38 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:14.501 02:32:38 -- nvmf/common.sh@7 -- # uname -s 00:21:14.501 02:32:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:14.501 02:32:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:14.501 02:32:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:14.501 02:32:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:14.501 02:32:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:14.501 02:32:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:14.501 02:32:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:14.501 02:32:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:14.501 02:32:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:14.501 02:32:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:14.501 02:32:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:14.501 02:32:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:14.501 02:32:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:14.501 02:32:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:14.501 02:32:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:14.501 02:32:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:14.501 02:32:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:14.501 02:32:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:14.501 02:32:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:14.501 02:32:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:14.501 02:32:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:14.501 02:32:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:14.501 02:32:38 -- paths/export.sh@5 -- # export PATH 00:21:14.501 02:32:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:14.501 02:32:38 -- nvmf/common.sh@46 -- # : 0 00:21:14.501 02:32:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:14.501 02:32:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:14.501 02:32:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:14.501 02:32:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:14.501 02:32:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:14.501 02:32:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:14.501 02:32:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:14.501 02:32:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:14.501 02:32:38 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:14.501 02:32:38 -- fips/fips.sh@89 -- # check_openssl_version 00:21:14.501 02:32:38 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:14.501 02:32:38 -- fips/fips.sh@85 -- # openssl version 00:21:14.501 02:32:38 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:14.501 02:32:38 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:14.501 02:32:38 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:14.501 02:32:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:14.501 02:32:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:14.501 02:32:38 -- scripts/common.sh@335 -- # IFS=.-: 00:21:14.501 02:32:38 -- scripts/common.sh@335 -- # read -ra ver1 00:21:14.501 02:32:38 -- scripts/common.sh@336 -- # IFS=.-: 00:21:14.501 02:32:38 -- scripts/common.sh@336 -- # read -ra ver2 00:21:14.501 02:32:38 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:14.501 02:32:38 -- scripts/common.sh@339 -- # ver1_l=3 00:21:14.501 02:32:38 -- scripts/common.sh@340 -- # ver2_l=3 00:21:14.501 02:32:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:14.501 02:32:38 -- scripts/common.sh@343 -- # case "$op" in 00:21:14.501 02:32:38 -- scripts/common.sh@347 -- # : 1 00:21:14.501 02:32:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:14.502 02:32:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:14.502 02:32:38 -- scripts/common.sh@364 -- # decimal 3 00:21:14.502 02:32:38 -- scripts/common.sh@352 -- # local d=3 00:21:14.502 02:32:38 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:14.502 02:32:38 -- scripts/common.sh@354 -- # echo 3 00:21:14.502 02:32:38 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:14.502 02:32:38 -- scripts/common.sh@365 -- # decimal 3 00:21:14.502 02:32:38 -- scripts/common.sh@352 -- # local d=3 00:21:14.502 02:32:38 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:14.502 02:32:38 -- scripts/common.sh@354 -- # echo 3 00:21:14.502 02:32:38 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:14.502 02:32:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:14.502 02:32:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:14.502 02:32:38 -- scripts/common.sh@363 -- # (( v++ )) 00:21:14.502 02:32:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:14.502 02:32:38 -- scripts/common.sh@364 -- # decimal 1 00:21:14.502 02:32:38 -- scripts/common.sh@352 -- # local d=1 00:21:14.502 02:32:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:14.502 02:32:38 -- scripts/common.sh@354 -- # echo 1 00:21:14.502 02:32:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:14.502 02:32:38 -- scripts/common.sh@365 -- # decimal 0 00:21:14.502 02:32:38 -- scripts/common.sh@352 -- # local d=0 00:21:14.502 02:32:38 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:14.502 02:32:38 -- scripts/common.sh@354 -- # echo 0 00:21:14.502 02:32:38 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:14.502 02:32:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:14.502 02:32:38 -- scripts/common.sh@366 -- # return 0 00:21:14.502 02:32:38 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:14.502 02:32:38 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:14.502 02:32:38 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:14.502 02:32:38 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:14.502 02:32:38 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:14.502 02:32:38 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:14.502 02:32:38 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:14.502 02:32:38 -- fips/fips.sh@113 -- # build_openssl_config 00:21:14.502 02:32:38 -- fips/fips.sh@37 -- # cat 00:21:14.502 02:32:38 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:14.502 02:32:38 -- fips/fips.sh@58 -- # cat - 00:21:14.502 02:32:38 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:14.502 02:32:38 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:14.502 02:32:38 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:14.502 02:32:38 -- fips/fips.sh@116 -- # openssl list -providers 00:21:14.502 02:32:38 -- fips/fips.sh@116 -- # grep name 00:21:14.502 02:32:39 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:14.502 02:32:39 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:14.502 02:32:39 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:14.502 02:32:39 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:14.502 02:32:39 -- fips/fips.sh@127 -- # : 00:21:14.502 02:32:39 -- common/autotest_common.sh@650 -- # local es=0 00:21:14.502 02:32:39 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:14.502 02:32:39 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:14.502 02:32:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:14.502 02:32:39 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:14.502 02:32:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:14.502 02:32:39 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:14.502 02:32:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:14.502 02:32:39 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:14.502 02:32:39 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:14.502 02:32:39 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:14.502 Error setting digest 00:21:14.502 40C28713DF7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:14.502 40C28713DF7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:14.502 02:32:39 -- common/autotest_common.sh@653 -- # es=1 00:21:14.502 02:32:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:14.502 02:32:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:14.502 02:32:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:14.502 02:32:39 -- fips/fips.sh@130 -- # nvmftestinit 00:21:14.502 02:32:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:14.502 02:32:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:14.502 02:32:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:14.502 02:32:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:14.502 02:32:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:14.502 02:32:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:14.502 02:32:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:14.502 02:32:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:14.502 02:32:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:14.502 02:32:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:14.502 02:32:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:14.502 02:32:39 -- common/autotest_common.sh@10 -- # set +x 00:21:17.034 02:32:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:17.034 02:32:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:17.034 02:32:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:17.034 02:32:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:17.034 02:32:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:17.034 02:32:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:17.034 02:32:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:17.034 02:32:41 -- nvmf/common.sh@294 -- # net_devs=() 00:21:17.034 02:32:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:17.034 02:32:41 -- nvmf/common.sh@295 -- # e810=() 00:21:17.034 02:32:41 -- nvmf/common.sh@295 -- # local -ga e810 00:21:17.034 02:32:41 -- nvmf/common.sh@296 -- # x722=() 00:21:17.034 02:32:41 -- nvmf/common.sh@296 -- # local -ga x722 00:21:17.034 02:32:41 -- nvmf/common.sh@297 -- # mlx=() 00:21:17.034 02:32:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:17.034 02:32:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:17.034 02:32:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.034 02:32:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:17.034 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:17.034 02:32:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.034 02:32:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:17.034 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:17.034 02:32:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.034 02:32:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.034 02:32:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.034 02:32:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:17.034 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:17.034 02:32:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.034 02:32:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.034 02:32:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.034 02:32:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:17.034 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:17.034 02:32:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:17.034 02:32:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:17.034 02:32:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:17.034 02:32:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:17.034 02:32:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:17.034 02:32:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:17.034 02:32:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:17.034 02:32:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:17.034 02:32:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:17.034 02:32:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:17.034 02:32:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:17.034 02:32:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:17.034 02:32:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:17.034 02:32:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:17.034 02:32:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:17.034 02:32:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:17.034 02:32:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:17.034 02:32:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:17.034 02:32:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:17.034 02:32:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:17.034 02:32:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:17.034 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:17.034 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:21:17.034 00:21:17.034 --- 10.0.0.2 ping statistics --- 00:21:17.034 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.034 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:21:17.034 02:32:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:17.034 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:17.034 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:21:17.034 00:21:17.034 --- 10.0.0.1 ping statistics --- 00:21:17.034 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.034 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:21:17.034 02:32:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:17.034 02:32:41 -- nvmf/common.sh@410 -- # return 0 00:21:17.034 02:32:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:17.034 02:32:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:17.034 02:32:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:17.034 02:32:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:17.034 02:32:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:17.034 02:32:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:17.034 02:32:41 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:17.034 02:32:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:17.034 02:32:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:17.034 02:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:17.034 02:32:41 -- nvmf/common.sh@469 -- # nvmfpid=2106002 00:21:17.034 02:32:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:17.034 02:32:41 -- nvmf/common.sh@470 -- # waitforlisten 2106002 00:21:17.035 02:32:41 -- common/autotest_common.sh@829 -- # '[' -z 2106002 ']' 00:21:17.035 02:32:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:17.035 02:32:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:17.035 02:32:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:17.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:17.035 02:32:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:17.035 02:32:41 -- common/autotest_common.sh@10 -- # set +x 00:21:17.035 [2024-11-27 02:32:41.356616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:17.035 [2024-11-27 02:32:41.356703] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:17.035 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.035 [2024-11-27 02:32:41.421142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.035 [2024-11-27 02:32:41.507109] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:17.035 [2024-11-27 02:32:41.507275] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:17.035 [2024-11-27 02:32:41.507300] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:17.035 [2024-11-27 02:32:41.507312] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:17.035 [2024-11-27 02:32:41.507339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:17.969 02:32:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:17.969 02:32:42 -- common/autotest_common.sh@862 -- # return 0 00:21:17.969 02:32:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:17.969 02:32:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:17.970 02:32:42 -- common/autotest_common.sh@10 -- # set +x 00:21:17.970 02:32:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:17.970 02:32:42 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:17.970 02:32:42 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:17.970 02:32:42 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:17.970 02:32:42 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:17.970 02:32:42 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:17.970 02:32:42 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:17.970 02:32:42 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:17.970 02:32:42 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:18.228 [2024-11-27 02:32:42.613364] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:18.228 [2024-11-27 02:32:42.629351] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:18.228 [2024-11-27 02:32:42.629585] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:18.228 malloc0 00:21:18.228 02:32:42 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:18.228 02:32:42 -- fips/fips.sh@147 -- # bdevperf_pid=2106166 00:21:18.228 02:32:42 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:18.228 02:32:42 -- fips/fips.sh@148 -- # waitforlisten 2106166 /var/tmp/bdevperf.sock 00:21:18.228 02:32:42 -- common/autotest_common.sh@829 -- # '[' -z 2106166 ']' 00:21:18.228 02:32:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:18.228 02:32:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:18.228 02:32:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:18.228 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:18.228 02:32:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:18.228 02:32:42 -- common/autotest_common.sh@10 -- # set +x 00:21:18.228 [2024-11-27 02:32:42.748876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:18.228 [2024-11-27 02:32:42.748960] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2106166 ] 00:21:18.228 EAL: No free 2048 kB hugepages reported on node 1 00:21:18.228 [2024-11-27 02:32:42.805898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:18.487 [2024-11-27 02:32:42.888117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:19.420 02:32:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:19.420 02:32:43 -- common/autotest_common.sh@862 -- # return 0 00:21:19.420 02:32:43 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:19.420 [2024-11-27 02:32:43.960417] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:19.420 TLSTESTn1 00:21:19.678 02:32:44 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:19.678 Running I/O for 10 seconds... 00:21:29.639 00:21:29.639 Latency(us) 00:21:29.639 [2024-11-27T01:32:54.274Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:29.639 [2024-11-27T01:32:54.274Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:29.639 Verification LBA range: start 0x0 length 0x2000 00:21:29.639 TLSTESTn1 : 10.02 4446.34 17.37 0.00 0.00 28749.04 4369.07 46797.56 00:21:29.639 [2024-11-27T01:32:54.274Z] =================================================================================================================== 00:21:29.639 [2024-11-27T01:32:54.274Z] Total : 4446.34 17.37 0.00 0.00 28749.04 4369.07 46797.56 00:21:29.639 0 00:21:29.639 02:32:54 -- fips/fips.sh@1 -- # cleanup 00:21:29.639 02:32:54 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:29.639 02:32:54 -- common/autotest_common.sh@806 -- # type=--id 00:21:29.639 02:32:54 -- common/autotest_common.sh@807 -- # id=0 00:21:29.639 02:32:54 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:29.639 02:32:54 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:29.639 02:32:54 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:29.639 02:32:54 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:29.639 02:32:54 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:29.639 02:32:54 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:29.639 nvmf_trace.0 00:21:29.898 02:32:54 -- common/autotest_common.sh@821 -- # return 0 00:21:29.898 02:32:54 -- fips/fips.sh@16 -- # killprocess 2106166 00:21:29.898 02:32:54 -- common/autotest_common.sh@936 -- # '[' -z 2106166 ']' 00:21:29.898 02:32:54 -- common/autotest_common.sh@940 -- # kill -0 2106166 00:21:29.898 02:32:54 -- common/autotest_common.sh@941 -- # uname 00:21:29.898 02:32:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:29.898 02:32:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2106166 00:21:29.898 02:32:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:29.898 02:32:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:29.898 02:32:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2106166' 00:21:29.898 killing process with pid 2106166 00:21:29.898 02:32:54 -- common/autotest_common.sh@955 -- # kill 2106166 00:21:29.898 Received shutdown signal, test time was about 10.000000 seconds 00:21:29.898 00:21:29.898 Latency(us) 00:21:29.898 [2024-11-27T01:32:54.533Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:29.898 [2024-11-27T01:32:54.533Z] =================================================================================================================== 00:21:29.898 [2024-11-27T01:32:54.533Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:29.898 02:32:54 -- common/autotest_common.sh@960 -- # wait 2106166 00:21:30.155 02:32:54 -- fips/fips.sh@17 -- # nvmftestfini 00:21:30.155 02:32:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:30.155 02:32:54 -- nvmf/common.sh@116 -- # sync 00:21:30.155 02:32:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:30.155 02:32:54 -- nvmf/common.sh@119 -- # set +e 00:21:30.155 02:32:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:30.155 02:32:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:30.155 rmmod nvme_tcp 00:21:30.155 rmmod nvme_fabrics 00:21:30.155 rmmod nvme_keyring 00:21:30.155 02:32:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:30.155 02:32:54 -- nvmf/common.sh@123 -- # set -e 00:21:30.155 02:32:54 -- nvmf/common.sh@124 -- # return 0 00:21:30.155 02:32:54 -- nvmf/common.sh@477 -- # '[' -n 2106002 ']' 00:21:30.155 02:32:54 -- nvmf/common.sh@478 -- # killprocess 2106002 00:21:30.155 02:32:54 -- common/autotest_common.sh@936 -- # '[' -z 2106002 ']' 00:21:30.155 02:32:54 -- common/autotest_common.sh@940 -- # kill -0 2106002 00:21:30.155 02:32:54 -- common/autotest_common.sh@941 -- # uname 00:21:30.155 02:32:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.155 02:32:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2106002 00:21:30.155 02:32:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:30.155 02:32:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:30.155 02:32:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2106002' 00:21:30.155 killing process with pid 2106002 00:21:30.155 02:32:54 -- common/autotest_common.sh@955 -- # kill 2106002 00:21:30.155 02:32:54 -- common/autotest_common.sh@960 -- # wait 2106002 00:21:30.413 02:32:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:30.413 02:32:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:30.413 02:32:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:30.413 02:32:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:30.413 02:32:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:30.413 02:32:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.413 02:32:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.413 02:32:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.942 02:32:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:32.942 02:32:56 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:32.942 00:21:32.942 real 0m18.165s 00:21:32.942 user 0m23.514s 00:21:32.942 sys 0m6.026s 00:21:32.942 02:32:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:32.942 02:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:32.942 ************************************ 00:21:32.942 END TEST nvmf_fips 00:21:32.942 ************************************ 00:21:32.942 02:32:56 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:32.942 02:32:56 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:32.942 02:32:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:32.942 02:32:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:32.942 02:32:56 -- common/autotest_common.sh@10 -- # set +x 00:21:32.942 ************************************ 00:21:32.942 START TEST nvmf_fuzz 00:21:32.942 ************************************ 00:21:32.942 02:32:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:32.942 * Looking for test storage... 00:21:32.942 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:32.942 02:32:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:32.942 02:32:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:32.942 02:32:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:32.942 02:32:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:32.942 02:32:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:32.942 02:32:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:32.942 02:32:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:32.942 02:32:57 -- scripts/common.sh@335 -- # IFS=.-: 00:21:32.942 02:32:57 -- scripts/common.sh@335 -- # read -ra ver1 00:21:32.942 02:32:57 -- scripts/common.sh@336 -- # IFS=.-: 00:21:32.942 02:32:57 -- scripts/common.sh@336 -- # read -ra ver2 00:21:32.942 02:32:57 -- scripts/common.sh@337 -- # local 'op=<' 00:21:32.942 02:32:57 -- scripts/common.sh@339 -- # ver1_l=2 00:21:32.942 02:32:57 -- scripts/common.sh@340 -- # ver2_l=1 00:21:32.942 02:32:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:32.942 02:32:57 -- scripts/common.sh@343 -- # case "$op" in 00:21:32.942 02:32:57 -- scripts/common.sh@344 -- # : 1 00:21:32.942 02:32:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:32.942 02:32:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:32.942 02:32:57 -- scripts/common.sh@364 -- # decimal 1 00:21:32.942 02:32:57 -- scripts/common.sh@352 -- # local d=1 00:21:32.942 02:32:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:32.942 02:32:57 -- scripts/common.sh@354 -- # echo 1 00:21:32.942 02:32:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:32.942 02:32:57 -- scripts/common.sh@365 -- # decimal 2 00:21:32.942 02:32:57 -- scripts/common.sh@352 -- # local d=2 00:21:32.942 02:32:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:32.942 02:32:57 -- scripts/common.sh@354 -- # echo 2 00:21:32.942 02:32:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:32.942 02:32:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:32.942 02:32:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:32.942 02:32:57 -- scripts/common.sh@367 -- # return 0 00:21:32.942 02:32:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:32.942 02:32:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:32.942 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.942 --rc genhtml_branch_coverage=1 00:21:32.942 --rc genhtml_function_coverage=1 00:21:32.942 --rc genhtml_legend=1 00:21:32.943 --rc geninfo_all_blocks=1 00:21:32.943 --rc geninfo_unexecuted_blocks=1 00:21:32.943 00:21:32.943 ' 00:21:32.943 02:32:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:32.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.943 --rc genhtml_branch_coverage=1 00:21:32.943 --rc genhtml_function_coverage=1 00:21:32.943 --rc genhtml_legend=1 00:21:32.943 --rc geninfo_all_blocks=1 00:21:32.943 --rc geninfo_unexecuted_blocks=1 00:21:32.943 00:21:32.943 ' 00:21:32.943 02:32:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:32.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.943 --rc genhtml_branch_coverage=1 00:21:32.943 --rc genhtml_function_coverage=1 00:21:32.943 --rc genhtml_legend=1 00:21:32.943 --rc geninfo_all_blocks=1 00:21:32.943 --rc geninfo_unexecuted_blocks=1 00:21:32.943 00:21:32.943 ' 00:21:32.943 02:32:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:32.943 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.943 --rc genhtml_branch_coverage=1 00:21:32.943 --rc genhtml_function_coverage=1 00:21:32.943 --rc genhtml_legend=1 00:21:32.943 --rc geninfo_all_blocks=1 00:21:32.943 --rc geninfo_unexecuted_blocks=1 00:21:32.943 00:21:32.943 ' 00:21:32.943 02:32:57 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:32.943 02:32:57 -- nvmf/common.sh@7 -- # uname -s 00:21:32.943 02:32:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.943 02:32:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.943 02:32:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.943 02:32:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.943 02:32:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.943 02:32:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.943 02:32:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.943 02:32:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.943 02:32:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.943 02:32:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.943 02:32:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.943 02:32:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.943 02:32:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.943 02:32:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.943 02:32:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:32.943 02:32:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:32.943 02:32:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.943 02:32:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.943 02:32:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.943 02:32:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.943 02:32:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.943 02:32:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.943 02:32:57 -- paths/export.sh@5 -- # export PATH 00:21:32.943 02:32:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.943 02:32:57 -- nvmf/common.sh@46 -- # : 0 00:21:32.943 02:32:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:32.943 02:32:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:32.943 02:32:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:32.943 02:32:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.943 02:32:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.943 02:32:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:32.943 02:32:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:32.943 02:32:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:32.943 02:32:57 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:32.943 02:32:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:32.943 02:32:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:32.943 02:32:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:32.943 02:32:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:32.943 02:32:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:32.943 02:32:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:32.943 02:32:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:32.943 02:32:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.943 02:32:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:32.943 02:32:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:32.943 02:32:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:32.943 02:32:57 -- common/autotest_common.sh@10 -- # set +x 00:21:34.844 02:32:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:34.844 02:32:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:34.844 02:32:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:34.844 02:32:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:34.844 02:32:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:34.844 02:32:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:34.844 02:32:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:34.844 02:32:59 -- nvmf/common.sh@294 -- # net_devs=() 00:21:34.844 02:32:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:34.844 02:32:59 -- nvmf/common.sh@295 -- # e810=() 00:21:34.844 02:32:59 -- nvmf/common.sh@295 -- # local -ga e810 00:21:34.844 02:32:59 -- nvmf/common.sh@296 -- # x722=() 00:21:34.844 02:32:59 -- nvmf/common.sh@296 -- # local -ga x722 00:21:34.844 02:32:59 -- nvmf/common.sh@297 -- # mlx=() 00:21:34.844 02:32:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:34.844 02:32:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:34.844 02:32:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.844 02:32:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:34.844 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:34.844 02:32:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.844 02:32:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:34.844 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:34.844 02:32:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.844 02:32:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.844 02:32:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.844 02:32:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:34.844 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:34.844 02:32:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.844 02:32:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.844 02:32:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.844 02:32:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:34.844 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:34.844 02:32:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:34.844 02:32:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:34.844 02:32:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:34.844 02:32:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:34.844 02:32:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:34.844 02:32:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:34.844 02:32:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:34.844 02:32:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:34.844 02:32:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:34.844 02:32:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:34.844 02:32:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:34.844 02:32:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:34.844 02:32:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:34.844 02:32:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:34.844 02:32:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:34.844 02:32:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:34.844 02:32:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:34.844 02:32:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:34.844 02:32:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:34.844 02:32:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:34.844 02:32:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:34.844 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:34.844 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:21:34.844 00:21:34.844 --- 10.0.0.2 ping statistics --- 00:21:34.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.844 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:21:34.844 02:32:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:34.844 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:34.844 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:21:34.844 00:21:34.844 --- 10.0.0.1 ping statistics --- 00:21:34.844 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.844 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:21:34.844 02:32:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:34.844 02:32:59 -- nvmf/common.sh@410 -- # return 0 00:21:34.844 02:32:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:34.844 02:32:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:34.844 02:32:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:34.844 02:32:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:34.844 02:32:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:34.844 02:32:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:34.844 02:32:59 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2109606 00:21:34.844 02:32:59 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:34.844 02:32:59 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:34.844 02:32:59 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2109606 00:21:34.844 02:32:59 -- common/autotest_common.sh@829 -- # '[' -z 2109606 ']' 00:21:34.844 02:32:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:34.844 02:32:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:34.844 02:32:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:34.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:34.844 02:32:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:34.844 02:32:59 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 02:33:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:36.220 02:33:00 -- common/autotest_common.sh@862 -- # return 0 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:36.220 02:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.220 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 02:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:36.220 02:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.220 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 Malloc0 00:21:36.220 02:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:36.220 02:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.220 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 02:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:36.220 02:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.220 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 02:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:36.220 02:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.220 02:33:00 -- common/autotest_common.sh@10 -- # set +x 00:21:36.220 02:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:36.220 02:33:00 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:08.300 Fuzzing completed. Shutting down the fuzz application 00:22:08.300 00:22:08.300 Dumping successful admin opcodes: 00:22:08.300 8, 9, 10, 24, 00:22:08.300 Dumping successful io opcodes: 00:22:08.300 0, 9, 00:22:08.300 NS: 0x200003aeff00 I/O qp, Total commands completed: 479254, total successful commands: 2773, random_seed: 4032277440 00:22:08.300 NS: 0x200003aeff00 admin qp, Total commands completed: 57504, total successful commands: 461, random_seed: 3052618304 00:22:08.300 02:33:30 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:08.300 Fuzzing completed. Shutting down the fuzz application 00:22:08.301 00:22:08.301 Dumping successful admin opcodes: 00:22:08.301 24, 00:22:08.301 Dumping successful io opcodes: 00:22:08.301 00:22:08.301 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3086337638 00:22:08.301 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3086498370 00:22:08.301 02:33:32 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:08.301 02:33:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.301 02:33:32 -- common/autotest_common.sh@10 -- # set +x 00:22:08.301 02:33:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.301 02:33:32 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:08.301 02:33:32 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:08.301 02:33:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:08.301 02:33:32 -- nvmf/common.sh@116 -- # sync 00:22:08.301 02:33:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:08.301 02:33:32 -- nvmf/common.sh@119 -- # set +e 00:22:08.301 02:33:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:08.301 02:33:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:08.301 rmmod nvme_tcp 00:22:08.301 rmmod nvme_fabrics 00:22:08.301 rmmod nvme_keyring 00:22:08.301 02:33:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:08.301 02:33:32 -- nvmf/common.sh@123 -- # set -e 00:22:08.301 02:33:32 -- nvmf/common.sh@124 -- # return 0 00:22:08.301 02:33:32 -- nvmf/common.sh@477 -- # '[' -n 2109606 ']' 00:22:08.301 02:33:32 -- nvmf/common.sh@478 -- # killprocess 2109606 00:22:08.301 02:33:32 -- common/autotest_common.sh@936 -- # '[' -z 2109606 ']' 00:22:08.301 02:33:32 -- common/autotest_common.sh@940 -- # kill -0 2109606 00:22:08.301 02:33:32 -- common/autotest_common.sh@941 -- # uname 00:22:08.301 02:33:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:08.301 02:33:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2109606 00:22:08.301 02:33:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:08.301 02:33:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:08.301 02:33:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2109606' 00:22:08.301 killing process with pid 2109606 00:22:08.301 02:33:32 -- common/autotest_common.sh@955 -- # kill 2109606 00:22:08.301 02:33:32 -- common/autotest_common.sh@960 -- # wait 2109606 00:22:08.301 02:33:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:08.301 02:33:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:08.301 02:33:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:08.301 02:33:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:08.301 02:33:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:08.301 02:33:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:08.301 02:33:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:08.301 02:33:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:10.208 02:33:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:10.209 02:33:34 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:10.209 00:22:10.209 real 0m37.646s 00:22:10.209 user 0m51.929s 00:22:10.209 sys 0m14.620s 00:22:10.209 02:33:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:10.209 02:33:34 -- common/autotest_common.sh@10 -- # set +x 00:22:10.209 ************************************ 00:22:10.209 END TEST nvmf_fuzz 00:22:10.209 ************************************ 00:22:10.209 02:33:34 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:10.209 02:33:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:10.209 02:33:34 -- common/autotest_common.sh@10 -- # set +x 00:22:10.209 ************************************ 00:22:10.209 START TEST nvmf_multiconnection 00:22:10.209 ************************************ 00:22:10.209 02:33:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:10.209 * Looking for test storage... 00:22:10.209 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:10.209 02:33:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:10.209 02:33:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:10.209 02:33:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:10.209 02:33:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:10.209 02:33:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:10.209 02:33:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:10.209 02:33:34 -- scripts/common.sh@335 -- # IFS=.-: 00:22:10.209 02:33:34 -- scripts/common.sh@335 -- # read -ra ver1 00:22:10.209 02:33:34 -- scripts/common.sh@336 -- # IFS=.-: 00:22:10.209 02:33:34 -- scripts/common.sh@336 -- # read -ra ver2 00:22:10.209 02:33:34 -- scripts/common.sh@337 -- # local 'op=<' 00:22:10.209 02:33:34 -- scripts/common.sh@339 -- # ver1_l=2 00:22:10.209 02:33:34 -- scripts/common.sh@340 -- # ver2_l=1 00:22:10.209 02:33:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:10.209 02:33:34 -- scripts/common.sh@343 -- # case "$op" in 00:22:10.209 02:33:34 -- scripts/common.sh@344 -- # : 1 00:22:10.209 02:33:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:10.209 02:33:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:10.209 02:33:34 -- scripts/common.sh@364 -- # decimal 1 00:22:10.209 02:33:34 -- scripts/common.sh@352 -- # local d=1 00:22:10.209 02:33:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:10.209 02:33:34 -- scripts/common.sh@354 -- # echo 1 00:22:10.209 02:33:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:10.209 02:33:34 -- scripts/common.sh@365 -- # decimal 2 00:22:10.209 02:33:34 -- scripts/common.sh@352 -- # local d=2 00:22:10.209 02:33:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:10.209 02:33:34 -- scripts/common.sh@354 -- # echo 2 00:22:10.209 02:33:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:10.209 02:33:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:10.209 02:33:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:10.209 02:33:34 -- scripts/common.sh@367 -- # return 0 00:22:10.209 02:33:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:10.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:10.209 --rc genhtml_branch_coverage=1 00:22:10.209 --rc genhtml_function_coverage=1 00:22:10.209 --rc genhtml_legend=1 00:22:10.209 --rc geninfo_all_blocks=1 00:22:10.209 --rc geninfo_unexecuted_blocks=1 00:22:10.209 00:22:10.209 ' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:10.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:10.209 --rc genhtml_branch_coverage=1 00:22:10.209 --rc genhtml_function_coverage=1 00:22:10.209 --rc genhtml_legend=1 00:22:10.209 --rc geninfo_all_blocks=1 00:22:10.209 --rc geninfo_unexecuted_blocks=1 00:22:10.209 00:22:10.209 ' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:10.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:10.209 --rc genhtml_branch_coverage=1 00:22:10.209 --rc genhtml_function_coverage=1 00:22:10.209 --rc genhtml_legend=1 00:22:10.209 --rc geninfo_all_blocks=1 00:22:10.209 --rc geninfo_unexecuted_blocks=1 00:22:10.209 00:22:10.209 ' 00:22:10.209 02:33:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:10.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:10.209 --rc genhtml_branch_coverage=1 00:22:10.209 --rc genhtml_function_coverage=1 00:22:10.209 --rc genhtml_legend=1 00:22:10.209 --rc geninfo_all_blocks=1 00:22:10.209 --rc geninfo_unexecuted_blocks=1 00:22:10.209 00:22:10.209 ' 00:22:10.209 02:33:34 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:10.209 02:33:34 -- nvmf/common.sh@7 -- # uname -s 00:22:10.209 02:33:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:10.209 02:33:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:10.209 02:33:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:10.209 02:33:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:10.209 02:33:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:10.209 02:33:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:10.209 02:33:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:10.209 02:33:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:10.209 02:33:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:10.209 02:33:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:10.209 02:33:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:10.209 02:33:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:10.209 02:33:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:10.209 02:33:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:10.209 02:33:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:10.209 02:33:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:10.209 02:33:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:10.209 02:33:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:10.209 02:33:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:10.209 02:33:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.209 02:33:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.209 02:33:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.209 02:33:34 -- paths/export.sh@5 -- # export PATH 00:22:10.209 02:33:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.209 02:33:34 -- nvmf/common.sh@46 -- # : 0 00:22:10.209 02:33:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:10.209 02:33:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:10.209 02:33:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:10.209 02:33:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:10.209 02:33:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:10.209 02:33:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:10.209 02:33:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:10.209 02:33:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:10.209 02:33:34 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:10.209 02:33:34 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:10.209 02:33:34 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:10.209 02:33:34 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:10.209 02:33:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:10.209 02:33:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:10.209 02:33:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:10.209 02:33:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:10.209 02:33:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:10.209 02:33:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:10.209 02:33:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:10.209 02:33:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:10.209 02:33:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:10.209 02:33:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:10.209 02:33:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:10.209 02:33:34 -- common/autotest_common.sh@10 -- # set +x 00:22:12.740 02:33:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:12.740 02:33:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:12.740 02:33:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:12.740 02:33:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:12.740 02:33:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:12.740 02:33:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:12.740 02:33:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:12.740 02:33:36 -- nvmf/common.sh@294 -- # net_devs=() 00:22:12.740 02:33:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:12.740 02:33:36 -- nvmf/common.sh@295 -- # e810=() 00:22:12.740 02:33:36 -- nvmf/common.sh@295 -- # local -ga e810 00:22:12.740 02:33:36 -- nvmf/common.sh@296 -- # x722=() 00:22:12.740 02:33:36 -- nvmf/common.sh@296 -- # local -ga x722 00:22:12.740 02:33:36 -- nvmf/common.sh@297 -- # mlx=() 00:22:12.740 02:33:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:12.740 02:33:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:12.740 02:33:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:12.740 02:33:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:12.740 02:33:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:12.740 02:33:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:12.740 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:12.740 02:33:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:12.740 02:33:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:12.740 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:12.740 02:33:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:12.740 02:33:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:12.740 02:33:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:12.740 02:33:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:12.740 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:12.740 02:33:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:12.740 02:33:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:12.740 02:33:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:12.740 02:33:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:12.740 02:33:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:12.740 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:12.740 02:33:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:12.740 02:33:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:12.740 02:33:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:12.740 02:33:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:12.740 02:33:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:12.740 02:33:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:12.740 02:33:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:12.740 02:33:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:12.740 02:33:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:12.740 02:33:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:12.740 02:33:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:12.740 02:33:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:12.741 02:33:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:12.741 02:33:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:12.741 02:33:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:12.741 02:33:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:12.741 02:33:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:12.741 02:33:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:12.741 02:33:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:12.741 02:33:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:12.741 02:33:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:12.741 02:33:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:12.741 02:33:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:12.741 02:33:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:12.741 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:12.741 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:22:12.741 00:22:12.741 --- 10.0.0.2 ping statistics --- 00:22:12.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:12.741 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:22:12.741 02:33:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:12.741 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:12.741 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:22:12.741 00:22:12.741 --- 10.0.0.1 ping statistics --- 00:22:12.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:12.741 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:22:12.741 02:33:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:12.741 02:33:36 -- nvmf/common.sh@410 -- # return 0 00:22:12.741 02:33:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:12.741 02:33:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:12.741 02:33:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:12.741 02:33:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:12.741 02:33:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:12.741 02:33:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:12.741 02:33:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:12.741 02:33:36 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:12.741 02:33:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:12.741 02:33:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:12.741 02:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:12.741 02:33:36 -- nvmf/common.sh@469 -- # nvmfpid=2116113 00:22:12.741 02:33:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:12.741 02:33:36 -- nvmf/common.sh@470 -- # waitforlisten 2116113 00:22:12.741 02:33:36 -- common/autotest_common.sh@829 -- # '[' -z 2116113 ']' 00:22:12.741 02:33:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:12.741 02:33:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:12.741 02:33:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:12.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:12.741 02:33:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:12.741 02:33:36 -- common/autotest_common.sh@10 -- # set +x 00:22:12.741 [2024-11-27 02:33:37.019570] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:12.741 [2024-11-27 02:33:37.019658] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:12.741 EAL: No free 2048 kB hugepages reported on node 1 00:22:12.741 [2024-11-27 02:33:37.094244] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:12.741 [2024-11-27 02:33:37.188216] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:12.741 [2024-11-27 02:33:37.188380] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:12.741 [2024-11-27 02:33:37.188398] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:12.741 [2024-11-27 02:33:37.188413] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:12.741 [2024-11-27 02:33:37.188477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:12.741 [2024-11-27 02:33:37.188598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:12.741 [2024-11-27 02:33:37.188568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:12.741 [2024-11-27 02:33:37.188602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:13.675 02:33:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:13.675 02:33:37 -- common/autotest_common.sh@862 -- # return 0 00:22:13.675 02:33:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:13.675 02:33:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:13.675 02:33:37 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:13.675 02:33:37 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:13.675 02:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:37 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 [2024-11-27 02:33:37.997104] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.675 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 Malloc1 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 [2024-11-27 02:33:38.052294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.675 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 Malloc2 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.675 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 Malloc3 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.675 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 Malloc4 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:13.675 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.675 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.675 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.675 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.676 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 Malloc5 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.676 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 Malloc6 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.676 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.676 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.676 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:13.676 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.676 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 Malloc7 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.934 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 Malloc8 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:13.934 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.934 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.934 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.934 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.934 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 Malloc9 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.935 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 Malloc10 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.935 02:33:38 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 Malloc11 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:13.935 02:33:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.935 02:33:38 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 02:33:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.935 02:33:38 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:13.935 02:33:38 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.935 02:33:38 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:14.501 02:33:39 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:14.501 02:33:39 -- common/autotest_common.sh@1187 -- # local i=0 00:22:14.501 02:33:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.501 02:33:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:14.501 02:33:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:17.041 02:33:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:17.041 02:33:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:17.041 02:33:41 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:17.041 02:33:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:17.041 02:33:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:17.041 02:33:41 -- common/autotest_common.sh@1197 -- # return 0 00:22:17.041 02:33:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.041 02:33:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:17.300 02:33:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:17.300 02:33:41 -- common/autotest_common.sh@1187 -- # local i=0 00:22:17.300 02:33:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:17.300 02:33:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:17.300 02:33:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:19.199 02:33:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:19.199 02:33:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:19.199 02:33:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:19.457 02:33:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:19.457 02:33:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:19.457 02:33:43 -- common/autotest_common.sh@1197 -- # return 0 00:22:19.457 02:33:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.457 02:33:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:20.023 02:33:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:20.023 02:33:44 -- common/autotest_common.sh@1187 -- # local i=0 00:22:20.023 02:33:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.023 02:33:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:20.023 02:33:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:21.922 02:33:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:21.922 02:33:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:21.922 02:33:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:21.922 02:33:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:21.922 02:33:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.922 02:33:46 -- common/autotest_common.sh@1197 -- # return 0 00:22:21.922 02:33:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:21.922 02:33:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:22.856 02:33:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:22.856 02:33:47 -- common/autotest_common.sh@1187 -- # local i=0 00:22:22.856 02:33:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:22.856 02:33:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:22.856 02:33:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.759 02:33:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.759 02:33:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.759 02:33:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:24.759 02:33:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.759 02:33:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.759 02:33:49 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.759 02:33:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.759 02:33:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:25.325 02:33:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:25.326 02:33:49 -- common/autotest_common.sh@1187 -- # local i=0 00:22:25.326 02:33:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:25.326 02:33:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:25.326 02:33:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:27.854 02:33:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:27.854 02:33:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:27.854 02:33:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:27.854 02:33:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:27.854 02:33:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:27.854 02:33:51 -- common/autotest_common.sh@1197 -- # return 0 00:22:27.854 02:33:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:27.854 02:33:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:28.113 02:33:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:28.113 02:33:52 -- common/autotest_common.sh@1187 -- # local i=0 00:22:28.113 02:33:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:28.113 02:33:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:28.113 02:33:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:30.685 02:33:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:30.685 02:33:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:30.685 02:33:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:30.685 02:33:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:30.685 02:33:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:30.685 02:33:54 -- common/autotest_common.sh@1197 -- # return 0 00:22:30.685 02:33:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:30.685 02:33:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:31.335 02:33:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:31.335 02:33:55 -- common/autotest_common.sh@1187 -- # local i=0 00:22:31.335 02:33:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:31.335 02:33:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:31.335 02:33:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:33.232 02:33:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:33.233 02:33:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:33.233 02:33:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:33.233 02:33:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:33.233 02:33:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:33.233 02:33:57 -- common/autotest_common.sh@1197 -- # return 0 00:22:33.233 02:33:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:33.233 02:33:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:33.798 02:33:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:33.798 02:33:58 -- common/autotest_common.sh@1187 -- # local i=0 00:22:33.798 02:33:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:33.798 02:33:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:33.798 02:33:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:36.324 02:34:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:36.324 02:34:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:36.324 02:34:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:36.324 02:34:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:36.324 02:34:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:36.324 02:34:00 -- common/autotest_common.sh@1197 -- # return 0 00:22:36.324 02:34:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:36.324 02:34:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:36.889 02:34:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:36.889 02:34:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:36.889 02:34:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:36.889 02:34:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:36.889 02:34:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:38.788 02:34:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:38.788 02:34:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:38.788 02:34:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:38.788 02:34:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:38.788 02:34:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:38.788 02:34:03 -- common/autotest_common.sh@1197 -- # return 0 00:22:38.788 02:34:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:38.788 02:34:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:39.734 02:34:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:39.734 02:34:04 -- common/autotest_common.sh@1187 -- # local i=0 00:22:39.734 02:34:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:39.734 02:34:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:39.734 02:34:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:41.633 02:34:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:41.633 02:34:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:41.633 02:34:06 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:41.633 02:34:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:41.633 02:34:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:41.633 02:34:06 -- common/autotest_common.sh@1197 -- # return 0 00:22:41.633 02:34:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:41.633 02:34:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:42.567 02:34:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:42.567 02:34:07 -- common/autotest_common.sh@1187 -- # local i=0 00:22:42.567 02:34:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:42.567 02:34:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:42.567 02:34:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:44.468 02:34:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:44.468 02:34:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:44.468 02:34:09 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:44.468 02:34:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:44.468 02:34:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:44.468 02:34:09 -- common/autotest_common.sh@1197 -- # return 0 00:22:44.468 02:34:09 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:44.727 [global] 00:22:44.727 thread=1 00:22:44.727 invalidate=1 00:22:44.727 rw=read 00:22:44.727 time_based=1 00:22:44.727 runtime=10 00:22:44.727 ioengine=libaio 00:22:44.727 direct=1 00:22:44.727 bs=262144 00:22:44.727 iodepth=64 00:22:44.727 norandommap=1 00:22:44.727 numjobs=1 00:22:44.727 00:22:44.727 [job0] 00:22:44.727 filename=/dev/nvme0n1 00:22:44.727 [job1] 00:22:44.727 filename=/dev/nvme10n1 00:22:44.727 [job2] 00:22:44.727 filename=/dev/nvme1n1 00:22:44.727 [job3] 00:22:44.727 filename=/dev/nvme2n1 00:22:44.727 [job4] 00:22:44.727 filename=/dev/nvme3n1 00:22:44.727 [job5] 00:22:44.727 filename=/dev/nvme4n1 00:22:44.727 [job6] 00:22:44.727 filename=/dev/nvme5n1 00:22:44.727 [job7] 00:22:44.727 filename=/dev/nvme6n1 00:22:44.727 [job8] 00:22:44.727 filename=/dev/nvme7n1 00:22:44.727 [job9] 00:22:44.727 filename=/dev/nvme8n1 00:22:44.727 [job10] 00:22:44.727 filename=/dev/nvme9n1 00:22:44.727 Could not set queue depth (nvme0n1) 00:22:44.727 Could not set queue depth (nvme10n1) 00:22:44.727 Could not set queue depth (nvme1n1) 00:22:44.727 Could not set queue depth (nvme2n1) 00:22:44.727 Could not set queue depth (nvme3n1) 00:22:44.727 Could not set queue depth (nvme4n1) 00:22:44.728 Could not set queue depth (nvme5n1) 00:22:44.728 Could not set queue depth (nvme6n1) 00:22:44.728 Could not set queue depth (nvme7n1) 00:22:44.728 Could not set queue depth (nvme8n1) 00:22:44.728 Could not set queue depth (nvme9n1) 00:22:44.987 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:44.987 fio-3.35 00:22:44.987 Starting 11 threads 00:22:57.190 00:22:57.190 job0: (groupid=0, jobs=1): err= 0: pid=2120499: Wed Nov 27 02:34:19 2024 00:22:57.190 read: IOPS=681, BW=170MiB/s (179MB/s)(1725MiB/10115msec) 00:22:57.190 slat (usec): min=9, max=98056, avg=976.85, stdev=4043.00 00:22:57.190 clat (usec): min=1810, max=246229, avg=92776.11, stdev=47299.12 00:22:57.190 lat (usec): min=1833, max=322673, avg=93752.96, stdev=47918.18 00:22:57.190 clat percentiles (msec): 00:22:57.190 | 1.00th=[ 11], 5.00th=[ 27], 10.00th=[ 35], 20.00th=[ 52], 00:22:57.190 | 30.00th=[ 62], 40.00th=[ 73], 50.00th=[ 87], 60.00th=[ 103], 00:22:57.190 | 70.00th=[ 115], 80.00th=[ 133], 90.00th=[ 163], 95.00th=[ 180], 00:22:57.190 | 99.00th=[ 207], 99.50th=[ 228], 99.90th=[ 247], 99.95th=[ 247], 00:22:57.190 | 99.99th=[ 247] 00:22:57.190 bw ( KiB/s): min=94208, max=286781, per=8.96%, avg=174970.65, stdev=57946.70, samples=20 00:22:57.190 iops : min= 368, max= 1120, avg=683.45, stdev=226.32, samples=20 00:22:57.190 lat (msec) : 2=0.09%, 4=0.13%, 10=0.75%, 20=2.38%, 50=15.89% 00:22:57.190 lat (msec) : 100=38.37%, 250=42.39% 00:22:57.190 cpu : usr=0.37%, sys=2.06%, ctx=1490, majf=0, minf=4097 00:22:57.190 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.190 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.190 issued rwts: total=6898,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.190 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.190 job1: (groupid=0, jobs=1): err= 0: pid=2120515: Wed Nov 27 02:34:19 2024 00:22:57.190 read: IOPS=678, BW=170MiB/s (178MB/s)(1717MiB/10113msec) 00:22:57.190 slat (usec): min=9, max=113675, avg=886.62, stdev=4741.03 00:22:57.190 clat (msec): min=2, max=260, avg=93.31, stdev=55.59 00:22:57.190 lat (msec): min=2, max=276, avg=94.20, stdev=56.21 00:22:57.190 clat percentiles (msec): 00:22:57.190 | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 18], 20.00th=[ 43], 00:22:57.190 | 30.00th=[ 64], 40.00th=[ 78], 50.00th=[ 87], 60.00th=[ 100], 00:22:57.190 | 70.00th=[ 115], 80.00th=[ 144], 90.00th=[ 176], 95.00th=[ 194], 00:22:57.190 | 99.00th=[ 228], 99.50th=[ 232], 99.90th=[ 243], 99.95th=[ 245], 00:22:57.190 | 99.99th=[ 262] 00:22:57.190 bw ( KiB/s): min=84992, max=335872, per=8.91%, avg=174093.35, stdev=68247.69, samples=20 00:22:57.190 iops : min= 332, max= 1312, avg=680.05, stdev=266.59, samples=20 00:22:57.190 lat (msec) : 4=0.66%, 10=4.79%, 20=5.96%, 50=11.27%, 100=37.87% 00:22:57.190 lat (msec) : 250=39.44%, 500=0.01% 00:22:57.190 cpu : usr=0.34%, sys=1.75%, ctx=1587, majf=0, minf=4097 00:22:57.190 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.190 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.190 issued rwts: total=6866,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.190 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.190 job2: (groupid=0, jobs=1): err= 0: pid=2120539: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=589, BW=147MiB/s (154MB/s)(1482MiB/10059msec) 00:22:57.191 slat (usec): min=8, max=166473, avg=1491.31, stdev=6040.65 00:22:57.191 clat (usec): min=569, max=340337, avg=107051.51, stdev=57035.53 00:22:57.191 lat (usec): min=586, max=390010, avg=108542.82, stdev=58036.89 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 44], 00:22:57.191 | 30.00th=[ 81], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 124], 00:22:57.191 | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 180], 95.00th=[ 190], 00:22:57.191 | 99.00th=[ 241], 99.50th=[ 262], 99.90th=[ 275], 99.95th=[ 275], 00:22:57.191 | 99.99th=[ 342] 00:22:57.191 bw ( KiB/s): min=91136, max=371712, per=7.68%, avg=150095.65, stdev=64950.98, samples=20 00:22:57.191 iops : min= 356, max= 1452, avg=586.30, stdev=253.72, samples=20 00:22:57.191 lat (usec) : 750=0.05%, 1000=0.02% 00:22:57.191 lat (msec) : 2=0.12%, 4=0.86%, 10=1.91%, 20=2.24%, 50=17.92% 00:22:57.191 lat (msec) : 100=19.22%, 250=57.06%, 500=0.61% 00:22:57.191 cpu : usr=0.34%, sys=1.97%, ctx=1209, majf=0, minf=4097 00:22:57.191 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:22:57.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.191 issued rwts: total=5927,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.191 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.191 job3: (groupid=0, jobs=1): err= 0: pid=2120561: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=606, BW=152MiB/s (159MB/s)(1527MiB/10066msec) 00:22:57.191 slat (usec): min=10, max=78722, avg=1411.04, stdev=4786.21 00:22:57.191 clat (usec): min=1964, max=247539, avg=103983.33, stdev=52398.94 00:22:57.191 lat (usec): min=1987, max=264081, avg=105394.37, stdev=53286.51 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 12], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 50], 00:22:57.191 | 30.00th=[ 65], 40.00th=[ 89], 50.00th=[ 104], 60.00th=[ 121], 00:22:57.191 | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 174], 95.00th=[ 184], 00:22:57.191 | 99.00th=[ 220], 99.50th=[ 228], 99.90th=[ 236], 99.95th=[ 239], 00:22:57.191 | 99.99th=[ 249] 00:22:57.191 bw ( KiB/s): min=87552, max=404992, per=7.92%, avg=154720.55, stdev=73532.85, samples=20 00:22:57.191 iops : min= 342, max= 1582, avg=604.35, stdev=287.23, samples=20 00:22:57.191 lat (msec) : 2=0.02%, 4=0.23%, 10=0.70%, 20=1.44%, 50=18.07% 00:22:57.191 lat (msec) : 100=26.46%, 250=53.08% 00:22:57.191 cpu : usr=0.35%, sys=2.28%, ctx=1210, majf=0, minf=4097 00:22:57.191 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:57.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.191 issued rwts: total=6108,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.191 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.191 job4: (groupid=0, jobs=1): err= 0: pid=2120573: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=722, BW=181MiB/s (189MB/s)(1818MiB/10065msec) 00:22:57.191 slat (usec): min=9, max=160955, avg=824.28, stdev=4917.86 00:22:57.191 clat (usec): min=568, max=335428, avg=87662.51, stdev=55906.82 00:22:57.191 lat (usec): min=604, max=335602, avg=88486.79, stdev=56617.56 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 18], 20.00th=[ 37], 00:22:57.191 | 30.00th=[ 55], 40.00th=[ 65], 50.00th=[ 80], 60.00th=[ 96], 00:22:57.191 | 70.00th=[ 113], 80.00th=[ 134], 90.00th=[ 167], 95.00th=[ 188], 00:22:57.191 | 99.00th=[ 245], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 284], 00:22:57.191 | 99.99th=[ 334] 00:22:57.191 bw ( KiB/s): min=56832, max=330752, per=9.44%, avg=184532.05, stdev=63797.74, samples=20 00:22:57.191 iops : min= 222, max= 1292, avg=720.75, stdev=249.17, samples=20 00:22:57.191 lat (usec) : 750=0.11%, 1000=0.15% 00:22:57.191 lat (msec) : 2=0.58%, 4=0.71%, 10=4.26%, 20=5.25%, 50=15.45% 00:22:57.191 lat (msec) : 100=35.51%, 250=37.22%, 500=0.74% 00:22:57.191 cpu : usr=0.27%, sys=2.10%, ctx=1708, majf=0, minf=4097 00:22:57.191 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:57.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.191 issued rwts: total=7273,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.191 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.191 job5: (groupid=0, jobs=1): err= 0: pid=2120618: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=786, BW=197MiB/s (206MB/s)(1991MiB/10117msec) 00:22:57.191 slat (usec): min=9, max=116553, avg=1070.00, stdev=4584.06 00:22:57.191 clat (usec): min=1080, max=292428, avg=80196.05, stdev=53738.31 00:22:57.191 lat (usec): min=1102, max=292500, avg=81266.05, stdev=54464.00 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 17], 20.00th=[ 32], 00:22:57.191 | 30.00th=[ 39], 40.00th=[ 59], 50.00th=[ 74], 60.00th=[ 89], 00:22:57.191 | 70.00th=[ 106], 80.00th=[ 123], 90.00th=[ 161], 95.00th=[ 184], 00:22:57.191 | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 271], 99.95th=[ 279], 00:22:57.191 | 99.99th=[ 292] 00:22:57.191 bw ( KiB/s): min=93696, max=376320, per=10.35%, avg=202149.75, stdev=88542.28, samples=20 00:22:57.191 iops : min= 366, max= 1470, avg=789.60, stdev=345.89, samples=20 00:22:57.191 lat (msec) : 2=0.08%, 4=1.75%, 10=4.36%, 20=5.45%, 50=24.43% 00:22:57.191 lat (msec) : 100=31.36%, 250=32.15%, 500=0.43% 00:22:57.191 cpu : usr=0.56%, sys=2.60%, ctx=1536, majf=0, minf=4097 00:22:57.191 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.191 issued rwts: total=7962,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.191 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.191 job6: (groupid=0, jobs=1): err= 0: pid=2120637: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=1181, BW=295MiB/s (310MB/s)(2973MiB/10065msec) 00:22:57.191 slat (usec): min=8, max=46475, avg=762.29, stdev=2621.46 00:22:57.191 clat (usec): min=1996, max=192811, avg=53370.72, stdev=27200.79 00:22:57.191 lat (msec): min=2, max=194, avg=54.13, stdev=27.58 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 27], 20.00th=[ 29], 00:22:57.191 | 30.00th=[ 32], 40.00th=[ 40], 50.00th=[ 51], 60.00th=[ 59], 00:22:57.191 | 70.00th=[ 68], 80.00th=[ 79], 90.00th=[ 90], 95.00th=[ 103], 00:22:57.191 | 99.00th=[ 125], 99.50th=[ 132], 99.90th=[ 178], 99.95th=[ 192], 00:22:57.191 | 99.99th=[ 192] 00:22:57.191 bw ( KiB/s): min=160256, max=532992, per=15.50%, avg=302769.90, stdev=110881.35, samples=20 00:22:57.191 iops : min= 626, max= 2082, avg=1182.65, stdev=433.15, samples=20 00:22:57.191 lat (msec) : 2=0.01%, 4=0.35%, 10=1.61%, 20=3.43%, 50=44.45% 00:22:57.191 lat (msec) : 100=44.42%, 250=5.72% 00:22:57.191 cpu : usr=0.61%, sys=3.80%, ctx=1921, majf=0, minf=4098 00:22:57.191 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:22:57.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.191 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.191 issued rwts: total=11892,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.191 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.191 job7: (groupid=0, jobs=1): err= 0: pid=2120646: Wed Nov 27 02:34:19 2024 00:22:57.191 read: IOPS=543, BW=136MiB/s (142MB/s)(1375MiB/10115msec) 00:22:57.191 slat (usec): min=13, max=104546, avg=1770.73, stdev=5446.95 00:22:57.191 clat (msec): min=7, max=281, avg=115.89, stdev=49.33 00:22:57.191 lat (msec): min=7, max=281, avg=117.66, stdev=50.13 00:22:57.191 clat percentiles (msec): 00:22:57.191 | 1.00th=[ 32], 5.00th=[ 37], 10.00th=[ 50], 20.00th=[ 73], 00:22:57.191 | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 126], 00:22:57.191 | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 184], 95.00th=[ 197], 00:22:57.191 | 99.00th=[ 232], 99.50th=[ 239], 99.90th=[ 253], 99.95th=[ 279], 00:22:57.192 | 99.99th=[ 284] 00:22:57.192 bw ( KiB/s): min=77312, max=264704, per=7.12%, avg=139087.40, stdev=54522.14, samples=20 00:22:57.192 iops : min= 302, max= 1034, avg=543.30, stdev=212.98, samples=20 00:22:57.192 lat (msec) : 10=0.02%, 20=0.24%, 50=9.75%, 100=31.36%, 250=58.49% 00:22:57.192 lat (msec) : 500=0.15% 00:22:57.192 cpu : usr=0.41%, sys=1.99%, ctx=1059, majf=0, minf=4097 00:22:57.192 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:57.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.192 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.192 issued rwts: total=5498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.192 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.192 job8: (groupid=0, jobs=1): err= 0: pid=2120648: Wed Nov 27 02:34:19 2024 00:22:57.192 read: IOPS=771, BW=193MiB/s (202MB/s)(1929MiB/10009msec) 00:22:57.192 slat (usec): min=9, max=88789, avg=1217.22, stdev=4025.93 00:22:57.192 clat (msec): min=4, max=309, avg=81.75, stdev=37.02 00:22:57.192 lat (msec): min=4, max=309, avg=82.96, stdev=37.51 00:22:57.192 clat percentiles (msec): 00:22:57.192 | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 46], 00:22:57.192 | 30.00th=[ 59], 40.00th=[ 70], 50.00th=[ 81], 60.00th=[ 91], 00:22:57.192 | 70.00th=[ 101], 80.00th=[ 110], 90.00th=[ 125], 95.00th=[ 138], 00:22:57.192 | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 271], 99.95th=[ 288], 00:22:57.192 | 99.99th=[ 309] 00:22:57.192 bw ( KiB/s): min=106496, max=367616, per=9.82%, avg=191847.16, stdev=70173.38, samples=19 00:22:57.192 iops : min= 416, max= 1436, avg=749.37, stdev=274.11, samples=19 00:22:57.192 lat (msec) : 10=0.14%, 20=0.14%, 50=23.47%, 100=46.37%, 250=29.77% 00:22:57.192 lat (msec) : 500=0.12% 00:22:57.192 cpu : usr=0.51%, sys=2.54%, ctx=1338, majf=0, minf=4097 00:22:57.192 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.192 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.192 issued rwts: total=7717,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.192 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.192 job9: (groupid=0, jobs=1): err= 0: pid=2120649: Wed Nov 27 02:34:19 2024 00:22:57.192 read: IOPS=593, BW=148MiB/s (156MB/s)(1501MiB/10117msec) 00:22:57.192 slat (usec): min=9, max=112003, avg=1169.02, stdev=5288.83 00:22:57.192 clat (msec): min=4, max=302, avg=106.63, stdev=49.08 00:22:57.192 lat (msec): min=5, max=302, avg=107.80, stdev=49.91 00:22:57.192 clat percentiles (msec): 00:22:57.192 | 1.00th=[ 16], 5.00th=[ 29], 10.00th=[ 42], 20.00th=[ 64], 00:22:57.192 | 30.00th=[ 77], 40.00th=[ 91], 50.00th=[ 105], 60.00th=[ 118], 00:22:57.192 | 70.00th=[ 130], 80.00th=[ 153], 90.00th=[ 174], 95.00th=[ 190], 00:22:57.192 | 99.00th=[ 230], 99.50th=[ 232], 99.90th=[ 253], 99.95th=[ 253], 00:22:57.192 | 99.99th=[ 305] 00:22:57.192 bw ( KiB/s): min=87040, max=231936, per=7.78%, avg=151984.60, stdev=43374.18, samples=20 00:22:57.192 iops : min= 340, max= 906, avg=593.65, stdev=169.43, samples=20 00:22:57.192 lat (msec) : 10=0.30%, 20=1.78%, 50=9.71%, 100=34.34%, 250=53.75% 00:22:57.192 lat (msec) : 500=0.12% 00:22:57.192 cpu : usr=0.40%, sys=1.72%, ctx=1308, majf=0, minf=3721 00:22:57.192 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:57.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.192 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.192 issued rwts: total=6002,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.192 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.192 job10: (groupid=0, jobs=1): err= 0: pid=2120650: Wed Nov 27 02:34:19 2024 00:22:57.192 read: IOPS=501, BW=125MiB/s (131MB/s)(1268MiB/10115msec) 00:22:57.192 slat (usec): min=14, max=128896, avg=1697.86, stdev=5770.28 00:22:57.192 clat (usec): min=1768, max=309457, avg=125818.48, stdev=46231.91 00:22:57.192 lat (usec): min=1790, max=309586, avg=127516.35, stdev=47030.13 00:22:57.192 clat percentiles (msec): 00:22:57.192 | 1.00th=[ 15], 5.00th=[ 54], 10.00th=[ 73], 20.00th=[ 89], 00:22:57.192 | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 125], 60.00th=[ 140], 00:22:57.192 | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 186], 95.00th=[ 197], 00:22:57.192 | 99.00th=[ 232], 99.50th=[ 241], 99.90th=[ 284], 99.95th=[ 300], 00:22:57.192 | 99.99th=[ 309] 00:22:57.192 bw ( KiB/s): min=65024, max=206336, per=6.56%, avg=128233.25, stdev=37552.79, samples=20 00:22:57.192 iops : min= 254, max= 806, avg=500.90, stdev=146.70, samples=20 00:22:57.192 lat (msec) : 2=0.02%, 4=0.61%, 10=0.22%, 20=0.89%, 50=2.72% 00:22:57.192 lat (msec) : 100=28.39%, 250=66.96%, 500=0.20% 00:22:57.192 cpu : usr=0.33%, sys=1.93%, ctx=1091, majf=0, minf=4097 00:22:57.192 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:57.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.192 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.192 issued rwts: total=5073,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.192 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.192 00:22:57.192 Run status group 0 (all jobs): 00:22:57.192 READ: bw=1908MiB/s (2001MB/s), 125MiB/s-295MiB/s (131MB/s-310MB/s), io=18.9GiB (20.2GB), run=10009-10117msec 00:22:57.192 00:22:57.192 Disk stats (read/write): 00:22:57.192 nvme0n1: ios=13586/0, merge=0/0, ticks=1233846/0, in_queue=1233846, util=97.07% 00:22:57.192 nvme10n1: ios=13605/0, merge=0/0, ticks=1241279/0, in_queue=1241279, util=97.30% 00:22:57.192 nvme1n1: ios=11579/0, merge=0/0, ticks=1227561/0, in_queue=1227561, util=97.61% 00:22:57.192 nvme2n1: ios=11999/0, merge=0/0, ticks=1228524/0, in_queue=1228524, util=97.76% 00:22:57.192 nvme3n1: ios=14307/0, merge=0/0, ticks=1236588/0, in_queue=1236588, util=97.84% 00:22:57.192 nvme4n1: ios=15718/0, merge=0/0, ticks=1230924/0, in_queue=1230924, util=98.22% 00:22:57.192 nvme5n1: ios=23575/0, merge=0/0, ticks=1233000/0, in_queue=1233000, util=98.40% 00:22:57.192 nvme6n1: ios=10794/0, merge=0/0, ticks=1225420/0, in_queue=1225420, util=98.52% 00:22:57.192 nvme7n1: ios=15014/0, merge=0/0, ticks=1234724/0, in_queue=1234724, util=98.95% 00:22:57.192 nvme8n1: ios=11823/0, merge=0/0, ticks=1234090/0, in_queue=1234090, util=99.13% 00:22:57.192 nvme9n1: ios=9926/0, merge=0/0, ticks=1227267/0, in_queue=1227267, util=99.26% 00:22:57.192 02:34:19 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:57.192 [global] 00:22:57.192 thread=1 00:22:57.192 invalidate=1 00:22:57.192 rw=randwrite 00:22:57.192 time_based=1 00:22:57.192 runtime=10 00:22:57.192 ioengine=libaio 00:22:57.192 direct=1 00:22:57.192 bs=262144 00:22:57.192 iodepth=64 00:22:57.192 norandommap=1 00:22:57.192 numjobs=1 00:22:57.192 00:22:57.192 [job0] 00:22:57.192 filename=/dev/nvme0n1 00:22:57.192 [job1] 00:22:57.192 filename=/dev/nvme10n1 00:22:57.192 [job2] 00:22:57.192 filename=/dev/nvme1n1 00:22:57.192 [job3] 00:22:57.192 filename=/dev/nvme2n1 00:22:57.192 [job4] 00:22:57.192 filename=/dev/nvme3n1 00:22:57.192 [job5] 00:22:57.192 filename=/dev/nvme4n1 00:22:57.192 [job6] 00:22:57.192 filename=/dev/nvme5n1 00:22:57.192 [job7] 00:22:57.192 filename=/dev/nvme6n1 00:22:57.192 [job8] 00:22:57.192 filename=/dev/nvme7n1 00:22:57.192 [job9] 00:22:57.192 filename=/dev/nvme8n1 00:22:57.192 [job10] 00:22:57.192 filename=/dev/nvme9n1 00:22:57.192 Could not set queue depth (nvme0n1) 00:22:57.192 Could not set queue depth (nvme10n1) 00:22:57.192 Could not set queue depth (nvme1n1) 00:22:57.192 Could not set queue depth (nvme2n1) 00:22:57.192 Could not set queue depth (nvme3n1) 00:22:57.192 Could not set queue depth (nvme4n1) 00:22:57.192 Could not set queue depth (nvme5n1) 00:22:57.192 Could not set queue depth (nvme6n1) 00:22:57.193 Could not set queue depth (nvme7n1) 00:22:57.193 Could not set queue depth (nvme8n1) 00:22:57.193 Could not set queue depth (nvme9n1) 00:22:57.193 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.193 fio-3.35 00:22:57.193 Starting 11 threads 00:23:07.171 00:23:07.171 job0: (groupid=0, jobs=1): err= 0: pid=2121778: Wed Nov 27 02:34:30 2024 00:23:07.171 write: IOPS=439, BW=110MiB/s (115MB/s)(1116MiB/10165msec); 0 zone resets 00:23:07.171 slat (usec): min=25, max=52186, avg=2041.90, stdev=4233.68 00:23:07.171 clat (msec): min=4, max=360, avg=143.65, stdev=52.25 00:23:07.171 lat (msec): min=4, max=360, avg=145.69, stdev=52.95 00:23:07.171 clat percentiles (msec): 00:23:07.171 | 1.00th=[ 20], 5.00th=[ 77], 10.00th=[ 82], 20.00th=[ 87], 00:23:07.171 | 30.00th=[ 115], 40.00th=[ 132], 50.00th=[ 144], 60.00th=[ 159], 00:23:07.171 | 70.00th=[ 178], 80.00th=[ 192], 90.00th=[ 207], 95.00th=[ 215], 00:23:07.171 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], 00:23:07.171 | 99.99th=[ 359] 00:23:07.171 bw ( KiB/s): min=73728, max=192512, per=7.51%, avg=112624.35, stdev=35799.69, samples=20 00:23:07.171 iops : min= 288, max= 752, avg=439.90, stdev=139.88, samples=20 00:23:07.171 lat (msec) : 10=0.13%, 20=0.90%, 50=2.46%, 100=20.35%, 250=74.48% 00:23:07.171 lat (msec) : 500=1.68% 00:23:07.171 cpu : usr=1.32%, sys=1.61%, ctx=1530, majf=0, minf=1 00:23:07.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:07.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.171 issued rwts: total=0,4463,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.171 job1: (groupid=0, jobs=1): err= 0: pid=2121808: Wed Nov 27 02:34:30 2024 00:23:07.171 write: IOPS=496, BW=124MiB/s (130MB/s)(1262MiB/10161msec); 0 zone resets 00:23:07.171 slat (usec): min=23, max=68573, avg=1728.53, stdev=4007.31 00:23:07.171 clat (msec): min=3, max=391, avg=127.06, stdev=62.31 00:23:07.171 lat (msec): min=3, max=391, avg=128.79, stdev=63.04 00:23:07.171 clat percentiles (msec): 00:23:07.171 | 1.00th=[ 22], 5.00th=[ 41], 10.00th=[ 46], 20.00th=[ 77], 00:23:07.171 | 30.00th=[ 84], 40.00th=[ 104], 50.00th=[ 122], 60.00th=[ 142], 00:23:07.171 | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 209], 95.00th=[ 226], 00:23:07.171 | 99.00th=[ 292], 99.50th=[ 330], 99.90th=[ 384], 99.95th=[ 388], 00:23:07.171 | 99.99th=[ 393] 00:23:07.171 bw ( KiB/s): min=67584, max=242176, per=8.51%, avg=127573.05, stdev=53148.49, samples=20 00:23:07.171 iops : min= 264, max= 946, avg=498.30, stdev=207.64, samples=20 00:23:07.171 lat (msec) : 4=0.02%, 10=0.06%, 20=0.63%, 50=11.14%, 100=27.24% 00:23:07.171 lat (msec) : 250=58.43%, 500=2.48% 00:23:07.171 cpu : usr=1.59%, sys=1.72%, ctx=1847, majf=0, minf=1 00:23:07.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.171 issued rwts: total=0,5047,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.171 job2: (groupid=0, jobs=1): err= 0: pid=2121842: Wed Nov 27 02:34:30 2024 00:23:07.171 write: IOPS=455, BW=114MiB/s (119MB/s)(1150MiB/10101msec); 0 zone resets 00:23:07.171 slat (usec): min=20, max=90861, avg=1226.12, stdev=4159.74 00:23:07.171 clat (usec): min=807, max=297335, avg=139279.64, stdev=71436.36 00:23:07.171 lat (usec): min=841, max=302972, avg=140505.75, stdev=72294.74 00:23:07.171 clat percentiles (msec): 00:23:07.171 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 29], 20.00th=[ 60], 00:23:07.171 | 30.00th=[ 91], 40.00th=[ 133], 50.00th=[ 161], 60.00th=[ 176], 00:23:07.171 | 70.00th=[ 190], 80.00th=[ 207], 90.00th=[ 222], 95.00th=[ 230], 00:23:07.171 | 99.00th=[ 259], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 292], 00:23:07.171 | 99.99th=[ 296] 00:23:07.171 bw ( KiB/s): min=65536, max=195072, per=7.74%, avg=116111.90, stdev=33145.18, samples=20 00:23:07.171 iops : min= 256, max= 762, avg=453.50, stdev=129.50, samples=20 00:23:07.171 lat (usec) : 1000=0.09% 00:23:07.171 lat (msec) : 2=0.13%, 4=0.39%, 10=2.09%, 20=4.35%, 50=10.05% 00:23:07.171 lat (msec) : 100=14.94%, 250=66.23%, 500=1.74% 00:23:07.171 cpu : usr=1.38%, sys=1.66%, ctx=3104, majf=0, minf=1 00:23:07.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:23:07.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.171 issued rwts: total=0,4599,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.171 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job3: (groupid=0, jobs=1): err= 0: pid=2121853: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=559, BW=140MiB/s (147MB/s)(1422MiB/10160msec); 0 zone resets 00:23:07.172 slat (usec): min=21, max=39463, avg=1478.33, stdev=3441.85 00:23:07.172 clat (msec): min=2, max=367, avg=112.82, stdev=59.20 00:23:07.172 lat (msec): min=2, max=367, avg=114.30, stdev=60.02 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 14], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 48], 00:23:07.172 | 30.00th=[ 74], 40.00th=[ 91], 50.00th=[ 106], 60.00th=[ 123], 00:23:07.172 | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 192], 95.00th=[ 207], 00:23:07.172 | 99.00th=[ 234], 99.50th=[ 266], 99.90th=[ 330], 99.95th=[ 355], 00:23:07.172 | 99.99th=[ 368] 00:23:07.172 bw ( KiB/s): min=81920, max=332288, per=9.60%, avg=143904.20, stdev=62838.31, samples=20 00:23:07.172 iops : min= 320, max= 1298, avg=562.10, stdev=245.43, samples=20 00:23:07.172 lat (msec) : 4=0.12%, 10=0.56%, 20=1.16%, 50=20.38%, 100=24.09% 00:23:07.172 lat (msec) : 250=53.10%, 500=0.58% 00:23:07.172 cpu : usr=1.75%, sys=1.97%, ctx=2357, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,5686,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job4: (groupid=0, jobs=1): err= 0: pid=2121855: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=467, BW=117MiB/s (123MB/s)(1174MiB/10043msec); 0 zone resets 00:23:07.172 slat (usec): min=25, max=141838, avg=1780.62, stdev=5162.71 00:23:07.172 clat (msec): min=6, max=317, avg=135.03, stdev=60.43 00:23:07.172 lat (msec): min=6, max=317, avg=136.81, stdev=61.27 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 25], 5.00th=[ 43], 10.00th=[ 46], 20.00th=[ 73], 00:23:07.172 | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 150], 00:23:07.172 | 70.00th=[ 171], 80.00th=[ 194], 90.00th=[ 218], 95.00th=[ 230], 00:23:07.172 | 99.00th=[ 253], 99.50th=[ 271], 99.90th=[ 313], 99.95th=[ 317], 00:23:07.172 | 99.99th=[ 317] 00:23:07.172 bw ( KiB/s): min=69632, max=311296, per=7.91%, avg=118557.35, stdev=52020.86, samples=20 00:23:07.172 iops : min= 272, max= 1216, avg=463.05, stdev=203.20, samples=20 00:23:07.172 lat (msec) : 10=0.06%, 20=0.70%, 50=11.80%, 100=15.51%, 250=70.86% 00:23:07.172 lat (msec) : 500=1.06% 00:23:07.172 cpu : usr=1.50%, sys=1.56%, ctx=1892, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,4695,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job5: (groupid=0, jobs=1): err= 0: pid=2121856: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=614, BW=154MiB/s (161MB/s)(1553MiB/10101msec); 0 zone resets 00:23:07.172 slat (usec): min=22, max=233333, avg=1346.31, stdev=4218.56 00:23:07.172 clat (msec): min=2, max=397, avg=102.41, stdev=56.31 00:23:07.172 lat (msec): min=2, max=403, avg=103.76, stdev=57.01 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 17], 5.00th=[ 41], 10.00th=[ 44], 20.00th=[ 48], 00:23:07.172 | 30.00th=[ 57], 40.00th=[ 77], 50.00th=[ 97], 60.00th=[ 114], 00:23:07.172 | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 174], 95.00th=[ 203], 00:23:07.172 | 99.00th=[ 255], 99.50th=[ 338], 99.90th=[ 388], 99.95th=[ 397], 00:23:07.172 | 99.99th=[ 397] 00:23:07.172 bw ( KiB/s): min=75776, max=299520, per=10.50%, avg=157386.75, stdev=66217.64, samples=20 00:23:07.172 iops : min= 296, max= 1170, avg=614.70, stdev=258.69, samples=20 00:23:07.172 lat (msec) : 4=0.10%, 10=0.45%, 20=1.13%, 50=22.73%, 100=26.82% 00:23:07.172 lat (msec) : 250=47.70%, 500=1.08% 00:23:07.172 cpu : usr=2.08%, sys=2.29%, ctx=2396, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,6212,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job6: (groupid=0, jobs=1): err= 0: pid=2121857: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=618, BW=155MiB/s (162MB/s)(1567MiB/10136msec); 0 zone resets 00:23:07.172 slat (usec): min=23, max=89998, avg=1144.42, stdev=3111.55 00:23:07.172 clat (usec): min=1329, max=276392, avg=102291.26, stdev=56012.43 00:23:07.172 lat (usec): min=1418, max=276491, avg=103435.68, stdev=56618.77 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 48], 00:23:07.172 | 30.00th=[ 65], 40.00th=[ 87], 50.00th=[ 100], 60.00th=[ 110], 00:23:07.172 | 70.00th=[ 128], 80.00th=[ 155], 90.00th=[ 184], 95.00th=[ 201], 00:23:07.172 | 99.00th=[ 236], 99.50th=[ 247], 99.90th=[ 262], 99.95th=[ 268], 00:23:07.172 | 99.99th=[ 275] 00:23:07.172 bw ( KiB/s): min=88064, max=329728, per=10.59%, avg=158821.90, stdev=63276.61, samples=20 00:23:07.172 iops : min= 344, max= 1288, avg=620.35, stdev=247.18, samples=20 00:23:07.172 lat (msec) : 2=0.05%, 4=0.34%, 10=1.87%, 20=2.47%, 50=18.12% 00:23:07.172 lat (msec) : 100=27.98%, 250=48.76%, 500=0.41% 00:23:07.172 cpu : usr=2.06%, sys=2.20%, ctx=3240, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,6268,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job7: (groupid=0, jobs=1): err= 0: pid=2121858: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=615, BW=154MiB/s (161MB/s)(1555MiB/10109msec); 0 zone resets 00:23:07.172 slat (usec): min=17, max=62864, avg=1132.17, stdev=2885.75 00:23:07.172 clat (msec): min=2, max=288, avg=102.86, stdev=49.68 00:23:07.172 lat (msec): min=2, max=288, avg=103.99, stdev=50.20 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 16], 5.00th=[ 45], 10.00th=[ 49], 20.00th=[ 52], 00:23:07.172 | 30.00th=[ 71], 40.00th=[ 84], 50.00th=[ 102], 60.00th=[ 110], 00:23:07.172 | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 176], 95.00th=[ 199], 00:23:07.172 | 99.00th=[ 230], 99.50th=[ 234], 99.90th=[ 264], 99.95th=[ 275], 00:23:07.172 | 99.99th=[ 288] 00:23:07.172 bw ( KiB/s): min=73728, max=291328, per=10.51%, avg=157556.10, stdev=56698.07, samples=20 00:23:07.172 iops : min= 288, max= 1138, avg=615.40, stdev=221.45, samples=20 00:23:07.172 lat (msec) : 4=0.03%, 10=0.37%, 20=1.09%, 50=12.77%, 100=34.83% 00:23:07.172 lat (msec) : 250=50.75%, 500=0.16% 00:23:07.172 cpu : usr=1.98%, sys=2.11%, ctx=3049, majf=0, minf=2 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,6219,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job8: (groupid=0, jobs=1): err= 0: pid=2121859: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=538, BW=135MiB/s (141MB/s)(1367MiB/10147msec); 0 zone resets 00:23:07.172 slat (usec): min=22, max=150140, avg=1237.93, stdev=4364.71 00:23:07.172 clat (msec): min=3, max=353, avg=117.41, stdev=60.13 00:23:07.172 lat (msec): min=4, max=353, avg=118.64, stdev=60.96 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 41], 20.00th=[ 67], 00:23:07.172 | 30.00th=[ 86], 40.00th=[ 101], 50.00th=[ 109], 60.00th=[ 122], 00:23:07.172 | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 228], 00:23:07.172 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 317], 99.95th=[ 351], 00:23:07.172 | 99.99th=[ 355] 00:23:07.172 bw ( KiB/s): min=69632, max=248846, per=9.23%, avg=138352.90, stdev=47693.17, samples=20 00:23:07.172 iops : min= 272, max= 972, avg=540.40, stdev=186.28, samples=20 00:23:07.172 lat (msec) : 4=0.02%, 10=0.84%, 20=2.43%, 50=10.26%, 100=26.64% 00:23:07.172 lat (msec) : 250=57.27%, 500=2.54% 00:23:07.172 cpu : usr=1.63%, sys=1.81%, ctx=3086, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,5469,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job9: (groupid=0, jobs=1): err= 0: pid=2121860: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=578, BW=145MiB/s (152MB/s)(1467MiB/10145msec); 0 zone resets 00:23:07.172 slat (usec): min=20, max=64626, avg=1018.32, stdev=3176.13 00:23:07.172 clat (msec): min=2, max=337, avg=109.58, stdev=59.26 00:23:07.172 lat (msec): min=2, max=337, avg=110.59, stdev=59.96 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 9], 5.00th=[ 24], 10.00th=[ 35], 20.00th=[ 58], 00:23:07.172 | 30.00th=[ 80], 40.00th=[ 94], 50.00th=[ 103], 60.00th=[ 113], 00:23:07.172 | 70.00th=[ 134], 80.00th=[ 155], 90.00th=[ 199], 95.00th=[ 222], 00:23:07.172 | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 321], 99.95th=[ 321], 00:23:07.172 | 99.99th=[ 338] 00:23:07.172 bw ( KiB/s): min=72192, max=222720, per=9.91%, avg=148526.85, stdev=41757.71, samples=20 00:23:07.172 iops : min= 282, max= 870, avg=580.15, stdev=163.10, samples=20 00:23:07.172 lat (msec) : 4=0.05%, 10=1.35%, 20=2.66%, 50=11.64%, 100=31.95% 00:23:07.172 lat (msec) : 250=50.00%, 500=2.35% 00:23:07.172 cpu : usr=1.92%, sys=2.15%, ctx=3610, majf=0, minf=1 00:23:07.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:07.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.172 issued rwts: total=0,5866,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.172 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.172 job10: (groupid=0, jobs=1): err= 0: pid=2121861: Wed Nov 27 02:34:30 2024 00:23:07.172 write: IOPS=495, BW=124MiB/s (130MB/s)(1253MiB/10118msec); 0 zone resets 00:23:07.172 slat (usec): min=19, max=143101, avg=1326.84, stdev=4169.94 00:23:07.172 clat (msec): min=2, max=337, avg=127.87, stdev=60.85 00:23:07.172 lat (msec): min=2, max=337, avg=129.19, stdev=61.71 00:23:07.172 clat percentiles (msec): 00:23:07.172 | 1.00th=[ 12], 5.00th=[ 30], 10.00th=[ 43], 20.00th=[ 72], 00:23:07.173 | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 130], 60.00th=[ 146], 00:23:07.173 | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 207], 95.00th=[ 230], 00:23:07.173 | 99.00th=[ 279], 99.50th=[ 300], 99.90th=[ 326], 99.95th=[ 338], 00:23:07.173 | 99.99th=[ 338] 00:23:07.173 bw ( KiB/s): min=65536, max=208896, per=8.44%, avg=126616.55, stdev=39458.02, samples=20 00:23:07.173 iops : min= 256, max= 816, avg=494.55, stdev=154.11, samples=20 00:23:07.173 lat (msec) : 4=0.08%, 10=0.66%, 20=2.10%, 50=9.78%, 100=18.66% 00:23:07.173 lat (msec) : 250=66.15%, 500=2.57% 00:23:07.173 cpu : usr=1.54%, sys=1.93%, ctx=2986, majf=0, minf=1 00:23:07.173 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:07.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.173 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.173 issued rwts: total=0,5010,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.173 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.173 00:23:07.173 Run status group 0 (all jobs): 00:23:07.173 WRITE: bw=1464MiB/s (1535MB/s), 110MiB/s-155MiB/s (115MB/s-162MB/s), io=14.5GiB (15.6GB), run=10043-10165msec 00:23:07.173 00:23:07.173 Disk stats (read/write): 00:23:07.173 nvme0n1: ios=54/8753, merge=0/0, ticks=1016/1205275, in_queue=1206291, util=100.00% 00:23:07.173 nvme10n1: ios=44/9933, merge=0/0, ticks=241/1204800, in_queue=1205041, util=97.93% 00:23:07.173 nvme1n1: ios=44/8975, merge=0/0, ticks=1566/1224843, in_queue=1226409, util=100.00% 00:23:07.173 nvme2n1: ios=0/11200, merge=0/0, ticks=0/1208403, in_queue=1208403, util=97.78% 00:23:07.173 nvme3n1: ios=43/9059, merge=0/0, ticks=1864/1188029, in_queue=1189893, util=100.00% 00:23:07.173 nvme4n1: ios=46/12189, merge=0/0, ticks=1609/1183406, in_queue=1185015, util=100.00% 00:23:07.173 nvme5n1: ios=0/12350, merge=0/0, ticks=0/1219944, in_queue=1219944, util=98.32% 00:23:07.173 nvme6n1: ios=0/12263, merge=0/0, ticks=0/1217851, in_queue=1217851, util=98.48% 00:23:07.173 nvme7n1: ios=43/10761, merge=0/0, ticks=2365/1202177, in_queue=1204542, util=100.00% 00:23:07.173 nvme8n1: ios=36/11560, merge=0/0, ticks=902/1220486, in_queue=1221388, util=100.00% 00:23:07.173 nvme9n1: ios=0/9820, merge=0/0, ticks=0/1218059, in_queue=1218059, util=99.08% 00:23:07.173 02:34:30 -- target/multiconnection.sh@36 -- # sync 00:23:07.173 02:34:30 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:07.173 02:34:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.173 02:34:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:07.173 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:07.173 02:34:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:07.173 02:34:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:07.173 02:34:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.173 02:34:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:07.173 02:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.173 02:34:31 -- common/autotest_common.sh@10 -- # set +x 00:23:07.173 02:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.173 02:34:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.173 02:34:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:07.173 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:07.173 02:34:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:07.173 02:34:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:07.173 02:34:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.173 02:34:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:07.173 02:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.173 02:34:31 -- common/autotest_common.sh@10 -- # set +x 00:23:07.173 02:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.173 02:34:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.173 02:34:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:07.173 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:07.173 02:34:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:07.173 02:34:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:07.173 02:34:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.173 02:34:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:07.173 02:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.173 02:34:31 -- common/autotest_common.sh@10 -- # set +x 00:23:07.173 02:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.173 02:34:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.173 02:34:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:07.173 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:07.173 02:34:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:07.173 02:34:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.173 02:34:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:07.173 02:34:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.173 02:34:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:07.173 02:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.173 02:34:31 -- common/autotest_common.sh@10 -- # set +x 00:23:07.173 02:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.173 02:34:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.173 02:34:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:07.431 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:07.431 02:34:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:07.432 02:34:31 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.432 02:34:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.432 02:34:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:07.432 02:34:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.432 02:34:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:07.432 02:34:31 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.432 02:34:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:07.432 02:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.432 02:34:31 -- common/autotest_common.sh@10 -- # set +x 00:23:07.432 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.432 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.432 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:07.690 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:07.690 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:07.690 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.690 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.690 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:07.690 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.690 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:07.690 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.690 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:07.690 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.690 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:07.690 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.690 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.690 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:07.948 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:07.948 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:07.948 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.948 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.948 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:07.948 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.948 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:07.948 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.948 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:07.948 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.948 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:07.948 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.948 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.948 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:07.948 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:07.948 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:07.948 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.948 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.948 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:07.948 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.948 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:07.948 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.948 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:07.948 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.948 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:07.948 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.948 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.948 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:08.206 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:08.206 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:08.206 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.206 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.206 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:08.206 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.206 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:08.206 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.206 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:08.206 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.206 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:08.206 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.206 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.206 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:08.206 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:08.206 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:08.206 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.206 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.206 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:08.464 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.464 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:08.464 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.464 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:08.464 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.464 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:08.464 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.464 02:34:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.464 02:34:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:08.464 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:08.464 02:34:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:08.464 02:34:32 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.464 02:34:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.464 02:34:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:08.464 02:34:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.464 02:34:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:08.464 02:34:32 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.464 02:34:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:08.464 02:34:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.464 02:34:32 -- common/autotest_common.sh@10 -- # set +x 00:23:08.464 02:34:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.464 02:34:32 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:08.464 02:34:32 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:08.464 02:34:32 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:08.464 02:34:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:08.464 02:34:32 -- nvmf/common.sh@116 -- # sync 00:23:08.464 02:34:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:08.464 02:34:32 -- nvmf/common.sh@119 -- # set +e 00:23:08.464 02:34:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:08.464 02:34:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:08.464 rmmod nvme_tcp 00:23:08.464 rmmod nvme_fabrics 00:23:08.464 rmmod nvme_keyring 00:23:08.464 02:34:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:08.464 02:34:32 -- nvmf/common.sh@123 -- # set -e 00:23:08.464 02:34:32 -- nvmf/common.sh@124 -- # return 0 00:23:08.464 02:34:32 -- nvmf/common.sh@477 -- # '[' -n 2116113 ']' 00:23:08.464 02:34:32 -- nvmf/common.sh@478 -- # killprocess 2116113 00:23:08.464 02:34:32 -- common/autotest_common.sh@936 -- # '[' -z 2116113 ']' 00:23:08.464 02:34:32 -- common/autotest_common.sh@940 -- # kill -0 2116113 00:23:08.464 02:34:32 -- common/autotest_common.sh@941 -- # uname 00:23:08.464 02:34:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:08.464 02:34:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2116113 00:23:08.464 02:34:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:08.464 02:34:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:08.464 02:34:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2116113' 00:23:08.464 killing process with pid 2116113 00:23:08.464 02:34:33 -- common/autotest_common.sh@955 -- # kill 2116113 00:23:08.464 02:34:33 -- common/autotest_common.sh@960 -- # wait 2116113 00:23:09.030 02:34:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:09.030 02:34:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:09.030 02:34:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:09.030 02:34:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:09.030 02:34:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:09.030 02:34:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:09.030 02:34:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:09.030 02:34:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.566 02:34:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:11.566 00:23:11.566 real 1m0.946s 00:23:11.566 user 3m23.747s 00:23:11.566 sys 0m26.619s 00:23:11.566 02:34:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:11.566 02:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:11.566 ************************************ 00:23:11.566 END TEST nvmf_multiconnection 00:23:11.566 ************************************ 00:23:11.566 02:34:35 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:11.566 02:34:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:11.566 02:34:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:11.566 02:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:11.566 ************************************ 00:23:11.566 START TEST nvmf_initiator_timeout 00:23:11.566 ************************************ 00:23:11.566 02:34:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:11.566 * Looking for test storage... 00:23:11.566 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:11.566 02:34:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:11.566 02:34:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:11.566 02:34:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:11.566 02:34:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:11.566 02:34:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:11.566 02:34:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:11.566 02:34:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:11.566 02:34:35 -- scripts/common.sh@335 -- # IFS=.-: 00:23:11.566 02:34:35 -- scripts/common.sh@335 -- # read -ra ver1 00:23:11.566 02:34:35 -- scripts/common.sh@336 -- # IFS=.-: 00:23:11.566 02:34:35 -- scripts/common.sh@336 -- # read -ra ver2 00:23:11.566 02:34:35 -- scripts/common.sh@337 -- # local 'op=<' 00:23:11.566 02:34:35 -- scripts/common.sh@339 -- # ver1_l=2 00:23:11.566 02:34:35 -- scripts/common.sh@340 -- # ver2_l=1 00:23:11.566 02:34:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:11.566 02:34:35 -- scripts/common.sh@343 -- # case "$op" in 00:23:11.566 02:34:35 -- scripts/common.sh@344 -- # : 1 00:23:11.566 02:34:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:11.566 02:34:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:11.566 02:34:35 -- scripts/common.sh@364 -- # decimal 1 00:23:11.566 02:34:35 -- scripts/common.sh@352 -- # local d=1 00:23:11.566 02:34:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:11.566 02:34:35 -- scripts/common.sh@354 -- # echo 1 00:23:11.566 02:34:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:11.566 02:34:35 -- scripts/common.sh@365 -- # decimal 2 00:23:11.566 02:34:35 -- scripts/common.sh@352 -- # local d=2 00:23:11.566 02:34:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:11.566 02:34:35 -- scripts/common.sh@354 -- # echo 2 00:23:11.566 02:34:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:11.566 02:34:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:11.566 02:34:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:11.566 02:34:35 -- scripts/common.sh@367 -- # return 0 00:23:11.566 02:34:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:11.566 02:34:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:11.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.566 --rc genhtml_branch_coverage=1 00:23:11.566 --rc genhtml_function_coverage=1 00:23:11.566 --rc genhtml_legend=1 00:23:11.566 --rc geninfo_all_blocks=1 00:23:11.566 --rc geninfo_unexecuted_blocks=1 00:23:11.566 00:23:11.566 ' 00:23:11.566 02:34:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:11.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.566 --rc genhtml_branch_coverage=1 00:23:11.566 --rc genhtml_function_coverage=1 00:23:11.566 --rc genhtml_legend=1 00:23:11.566 --rc geninfo_all_blocks=1 00:23:11.566 --rc geninfo_unexecuted_blocks=1 00:23:11.566 00:23:11.566 ' 00:23:11.566 02:34:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:11.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.567 --rc genhtml_branch_coverage=1 00:23:11.567 --rc genhtml_function_coverage=1 00:23:11.567 --rc genhtml_legend=1 00:23:11.567 --rc geninfo_all_blocks=1 00:23:11.567 --rc geninfo_unexecuted_blocks=1 00:23:11.567 00:23:11.567 ' 00:23:11.567 02:34:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:11.567 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.567 --rc genhtml_branch_coverage=1 00:23:11.567 --rc genhtml_function_coverage=1 00:23:11.567 --rc genhtml_legend=1 00:23:11.567 --rc geninfo_all_blocks=1 00:23:11.567 --rc geninfo_unexecuted_blocks=1 00:23:11.567 00:23:11.567 ' 00:23:11.567 02:34:35 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:11.567 02:34:35 -- nvmf/common.sh@7 -- # uname -s 00:23:11.567 02:34:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:11.567 02:34:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:11.567 02:34:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:11.567 02:34:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:11.567 02:34:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:11.567 02:34:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:11.567 02:34:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:11.567 02:34:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:11.567 02:34:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:11.567 02:34:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:11.567 02:34:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.567 02:34:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.567 02:34:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:11.567 02:34:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:11.567 02:34:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:11.567 02:34:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:11.567 02:34:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:11.567 02:34:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:11.567 02:34:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:11.567 02:34:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.567 02:34:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.567 02:34:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.567 02:34:35 -- paths/export.sh@5 -- # export PATH 00:23:11.567 02:34:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.567 02:34:35 -- nvmf/common.sh@46 -- # : 0 00:23:11.567 02:34:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:11.567 02:34:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:11.567 02:34:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:11.567 02:34:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:11.567 02:34:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:11.567 02:34:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:11.567 02:34:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:11.567 02:34:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:11.567 02:34:35 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:11.567 02:34:35 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:11.567 02:34:35 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:11.567 02:34:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:11.567 02:34:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:11.567 02:34:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:11.567 02:34:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:11.567 02:34:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:11.567 02:34:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.567 02:34:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.567 02:34:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.567 02:34:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:11.567 02:34:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:11.567 02:34:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:11.567 02:34:35 -- common/autotest_common.sh@10 -- # set +x 00:23:13.468 02:34:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:13.468 02:34:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:13.468 02:34:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:13.468 02:34:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:13.468 02:34:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:13.468 02:34:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:13.468 02:34:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:13.468 02:34:37 -- nvmf/common.sh@294 -- # net_devs=() 00:23:13.468 02:34:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:13.468 02:34:37 -- nvmf/common.sh@295 -- # e810=() 00:23:13.468 02:34:37 -- nvmf/common.sh@295 -- # local -ga e810 00:23:13.468 02:34:37 -- nvmf/common.sh@296 -- # x722=() 00:23:13.468 02:34:37 -- nvmf/common.sh@296 -- # local -ga x722 00:23:13.468 02:34:37 -- nvmf/common.sh@297 -- # mlx=() 00:23:13.468 02:34:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:13.468 02:34:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:13.468 02:34:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:13.468 02:34:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:13.468 02:34:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:13.468 02:34:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.468 02:34:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:13.468 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:13.468 02:34:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.468 02:34:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:13.468 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:13.468 02:34:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:13.468 02:34:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:13.468 02:34:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.468 02:34:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.468 02:34:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.468 02:34:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.468 02:34:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:13.468 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:13.468 02:34:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.468 02:34:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.468 02:34:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.468 02:34:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.468 02:34:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.468 02:34:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:13.469 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:13.469 02:34:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.469 02:34:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:13.469 02:34:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:13.469 02:34:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:13.469 02:34:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:13.469 02:34:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:13.469 02:34:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:13.469 02:34:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:13.469 02:34:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:13.469 02:34:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:13.469 02:34:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:13.469 02:34:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:13.469 02:34:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:13.469 02:34:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:13.469 02:34:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:13.469 02:34:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:13.469 02:34:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:13.469 02:34:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:13.469 02:34:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:13.469 02:34:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:13.469 02:34:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:13.469 02:34:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:13.469 02:34:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:13.469 02:34:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:13.469 02:34:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:13.469 02:34:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:13.469 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:13.469 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.348 ms 00:23:13.469 00:23:13.469 --- 10.0.0.2 ping statistics --- 00:23:13.469 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.469 rtt min/avg/max/mdev = 0.348/0.348/0.348/0.000 ms 00:23:13.469 02:34:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:13.469 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:13.469 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:23:13.469 00:23:13.469 --- 10.0.0.1 ping statistics --- 00:23:13.469 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.469 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:23:13.469 02:34:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:13.469 02:34:37 -- nvmf/common.sh@410 -- # return 0 00:23:13.469 02:34:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:13.469 02:34:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:13.469 02:34:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:13.469 02:34:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:13.469 02:34:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:13.469 02:34:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:13.469 02:34:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:13.469 02:34:38 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:13.469 02:34:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:13.469 02:34:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:13.469 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.469 02:34:38 -- nvmf/common.sh@469 -- # nvmfpid=2125244 00:23:13.469 02:34:38 -- nvmf/common.sh@470 -- # waitforlisten 2125244 00:23:13.469 02:34:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:13.469 02:34:38 -- common/autotest_common.sh@829 -- # '[' -z 2125244 ']' 00:23:13.469 02:34:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:13.469 02:34:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:13.469 02:34:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:13.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:13.469 02:34:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:13.469 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.469 [2024-11-27 02:34:38.062709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:13.469 [2024-11-27 02:34:38.062800] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:13.469 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.727 [2024-11-27 02:34:38.160022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:13.727 [2024-11-27 02:34:38.261588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:13.727 [2024-11-27 02:34:38.261790] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:13.727 [2024-11-27 02:34:38.261819] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:13.727 [2024-11-27 02:34:38.261844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:13.727 [2024-11-27 02:34:38.261923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:13.727 [2024-11-27 02:34:38.261954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:13.727 [2024-11-27 02:34:38.262020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:13.727 [2024-11-27 02:34:38.262028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:13.985 02:34:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:13.985 02:34:38 -- common/autotest_common.sh@862 -- # return 0 00:23:13.985 02:34:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:13.985 02:34:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:13.985 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.985 02:34:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:13.985 02:34:38 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:13.985 02:34:38 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:13.985 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.985 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.985 Malloc0 00:23:13.985 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.985 02:34:38 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:13.985 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.985 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.985 Delay0 00:23:13.985 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.985 02:34:38 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:13.985 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.985 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.985 [2024-11-27 02:34:38.497115] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:13.986 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.986 02:34:38 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:13.986 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.986 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.986 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.986 02:34:38 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:13.986 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.986 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.986 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.986 02:34:38 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:13.986 02:34:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.986 02:34:38 -- common/autotest_common.sh@10 -- # set +x 00:23:13.986 [2024-11-27 02:34:38.525392] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:13.986 02:34:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.986 02:34:38 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:14.918 02:34:39 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:14.918 02:34:39 -- common/autotest_common.sh@1187 -- # local i=0 00:23:14.918 02:34:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:14.918 02:34:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:14.918 02:34:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:16.919 02:34:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:16.919 02:34:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:16.919 02:34:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:16.919 02:34:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:16.919 02:34:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:16.919 02:34:41 -- common/autotest_common.sh@1197 -- # return 0 00:23:16.919 02:34:41 -- target/initiator_timeout.sh@35 -- # fio_pid=2125680 00:23:16.919 02:34:41 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:16.919 02:34:41 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:16.919 [global] 00:23:16.919 thread=1 00:23:16.919 invalidate=1 00:23:16.919 rw=write 00:23:16.919 time_based=1 00:23:16.919 runtime=60 00:23:16.919 ioengine=libaio 00:23:16.919 direct=1 00:23:16.919 bs=4096 00:23:16.919 iodepth=1 00:23:16.919 norandommap=0 00:23:16.919 numjobs=1 00:23:16.919 00:23:16.919 verify_dump=1 00:23:16.919 verify_backlog=512 00:23:16.919 verify_state_save=0 00:23:16.919 do_verify=1 00:23:16.919 verify=crc32c-intel 00:23:16.919 [job0] 00:23:16.919 filename=/dev/nvme0n1 00:23:16.919 Could not set queue depth (nvme0n1) 00:23:16.919 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:16.919 fio-3.35 00:23:16.919 Starting 1 thread 00:23:20.197 02:34:44 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:20.197 02:34:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.197 02:34:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.197 true 00:23:20.197 02:34:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.197 02:34:44 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:20.197 02:34:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.197 02:34:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.197 true 00:23:20.197 02:34:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.197 02:34:44 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:20.197 02:34:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.197 02:34:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.197 true 00:23:20.197 02:34:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.197 02:34:44 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:20.197 02:34:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.197 02:34:44 -- common/autotest_common.sh@10 -- # set +x 00:23:20.197 true 00:23:20.197 02:34:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.197 02:34:44 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:22.722 02:34:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.722 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:23:22.722 true 00:23:22.722 02:34:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:22.722 02:34:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.722 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:23:22.722 true 00:23:22.722 02:34:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:22.722 02:34:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.722 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:23:22.722 true 00:23:22.722 02:34:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:22.722 02:34:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:22.722 02:34:47 -- common/autotest_common.sh@10 -- # set +x 00:23:22.722 true 00:23:22.722 02:34:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:22.722 02:34:47 -- target/initiator_timeout.sh@54 -- # wait 2125680 00:24:18.934 00:24:18.934 job0: (groupid=0, jobs=1): err= 0: pid=2125754: Wed Nov 27 02:35:41 2024 00:24:18.934 read: IOPS=60, BW=242KiB/s (248kB/s)(14.2MiB/60032msec) 00:24:18.934 slat (nsec): min=4154, max=69650, avg=14391.46, stdev=11366.90 00:24:18.934 clat (usec): min=194, max=40903k, avg=16235.72, stdev=678467.01 00:24:18.934 lat (usec): min=198, max=40903k, avg=16250.11, stdev=678467.09 00:24:18.934 clat percentiles (usec): 00:24:18.934 | 1.00th=[ 202], 5.00th=[ 208], 10.00th=[ 215], 00:24:18.934 | 20.00th=[ 223], 30.00th=[ 241], 40.00th=[ 258], 00:24:18.934 | 50.00th=[ 289], 60.00th=[ 314], 70.00th=[ 379], 00:24:18.934 | 80.00th=[ 465], 90.00th=[ 41157], 95.00th=[ 41157], 00:24:18.934 | 99.00th=[ 41157], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:18.934 | 99.95th=[ 44827], 99.99th=[17112761] 00:24:18.934 write: IOPS=68, BW=273KiB/s (279kB/s)(16.0MiB/60032msec); 0 zone resets 00:24:18.934 slat (usec): min=5, max=31363, avg=25.23, stdev=523.06 00:24:18.934 clat (usec): min=157, max=528, avg=202.48, stdev=41.50 00:24:18.934 lat (usec): min=163, max=31648, avg=227.71, stdev=526.61 00:24:18.934 clat percentiles (usec): 00:24:18.934 | 1.00th=[ 161], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 178], 00:24:18.934 | 30.00th=[ 184], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 198], 00:24:18.934 | 70.00th=[ 204], 80.00th=[ 212], 90.00th=[ 241], 95.00th=[ 281], 00:24:18.934 | 99.00th=[ 396], 99.50th=[ 441], 99.90th=[ 478], 99.95th=[ 486], 00:24:18.934 | 99.99th=[ 529] 00:24:18.934 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=5461.33, stdev=2115.17, samples=6 00:24:18.934 iops : min= 1024, max= 2048, avg=1365.33, stdev=528.79, samples=6 00:24:18.934 lat (usec) : 250=65.86%, 500=27.54%, 750=1.18% 00:24:18.934 lat (msec) : 50=5.41%, >=2000=0.01% 00:24:18.934 cpu : usr=0.10%, sys=0.18%, ctx=7735, majf=0, minf=1 00:24:18.934 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:18.934 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:18.934 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:18.934 issued rwts: total=3635,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:18.934 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:18.934 00:24:18.934 Run status group 0 (all jobs): 00:24:18.934 READ: bw=242KiB/s (248kB/s), 242KiB/s-242KiB/s (248kB/s-248kB/s), io=14.2MiB (14.9MB), run=60032-60032msec 00:24:18.934 WRITE: bw=273KiB/s (279kB/s), 273KiB/s-273KiB/s (279kB/s-279kB/s), io=16.0MiB (16.8MB), run=60032-60032msec 00:24:18.934 00:24:18.934 Disk stats (read/write): 00:24:18.934 nvme0n1: ios=3659/4096, merge=0/0, ticks=19220/803, in_queue=20023, util=99.68% 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:18.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:18.934 02:35:41 -- common/autotest_common.sh@1208 -- # local i=0 00:24:18.934 02:35:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:18.934 02:35:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:18.934 02:35:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:18.934 02:35:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:18.934 02:35:41 -- common/autotest_common.sh@1220 -- # return 0 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:18.934 nvmf hotplug test: fio successful as expected 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:18.934 02:35:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:18.934 02:35:41 -- common/autotest_common.sh@10 -- # set +x 00:24:18.934 02:35:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:18.934 02:35:41 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:18.934 02:35:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:18.934 02:35:41 -- nvmf/common.sh@116 -- # sync 00:24:18.934 02:35:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:18.934 02:35:41 -- nvmf/common.sh@119 -- # set +e 00:24:18.934 02:35:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:18.934 02:35:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:18.934 rmmod nvme_tcp 00:24:18.934 rmmod nvme_fabrics 00:24:18.934 rmmod nvme_keyring 00:24:18.934 02:35:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:18.934 02:35:41 -- nvmf/common.sh@123 -- # set -e 00:24:18.934 02:35:41 -- nvmf/common.sh@124 -- # return 0 00:24:18.934 02:35:41 -- nvmf/common.sh@477 -- # '[' -n 2125244 ']' 00:24:18.934 02:35:41 -- nvmf/common.sh@478 -- # killprocess 2125244 00:24:18.934 02:35:41 -- common/autotest_common.sh@936 -- # '[' -z 2125244 ']' 00:24:18.934 02:35:41 -- common/autotest_common.sh@940 -- # kill -0 2125244 00:24:18.934 02:35:41 -- common/autotest_common.sh@941 -- # uname 00:24:18.934 02:35:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:18.934 02:35:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2125244 00:24:18.934 02:35:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:18.934 02:35:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:18.934 02:35:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2125244' 00:24:18.934 killing process with pid 2125244 00:24:18.935 02:35:41 -- common/autotest_common.sh@955 -- # kill 2125244 00:24:18.935 02:35:41 -- common/autotest_common.sh@960 -- # wait 2125244 00:24:18.935 02:35:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:18.935 02:35:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:18.935 02:35:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:18.935 02:35:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:18.935 02:35:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:18.935 02:35:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:18.935 02:35:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:18.935 02:35:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:19.874 02:35:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:19.874 00:24:19.874 real 1m8.522s 00:24:19.874 user 4m11.254s 00:24:19.874 sys 0m7.153s 00:24:19.874 02:35:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:19.874 02:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:19.874 ************************************ 00:24:19.874 END TEST nvmf_initiator_timeout 00:24:19.874 ************************************ 00:24:19.874 02:35:44 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:19.874 02:35:44 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:19.874 02:35:44 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:19.874 02:35:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:19.874 02:35:44 -- common/autotest_common.sh@10 -- # set +x 00:24:21.778 02:35:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:21.778 02:35:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:21.778 02:35:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:21.778 02:35:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:21.778 02:35:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:21.778 02:35:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:21.778 02:35:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:21.778 02:35:46 -- nvmf/common.sh@294 -- # net_devs=() 00:24:21.778 02:35:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:21.778 02:35:46 -- nvmf/common.sh@295 -- # e810=() 00:24:21.778 02:35:46 -- nvmf/common.sh@295 -- # local -ga e810 00:24:21.778 02:35:46 -- nvmf/common.sh@296 -- # x722=() 00:24:21.778 02:35:46 -- nvmf/common.sh@296 -- # local -ga x722 00:24:21.778 02:35:46 -- nvmf/common.sh@297 -- # mlx=() 00:24:21.778 02:35:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:21.778 02:35:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:21.778 02:35:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:21.779 02:35:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:21.779 02:35:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:21.779 02:35:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:21.779 02:35:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:21.779 02:35:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:21.779 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:21.779 02:35:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:21.779 02:35:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:21.779 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:21.779 02:35:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:21.779 02:35:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:21.779 02:35:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:21.779 02:35:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:21.779 02:35:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:21.779 02:35:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:21.779 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:21.779 02:35:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:21.779 02:35:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:21.779 02:35:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:21.779 02:35:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:21.779 02:35:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:21.779 02:35:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:21.779 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:21.779 02:35:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:21.779 02:35:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:21.779 02:35:46 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:21.779 02:35:46 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:21.779 02:35:46 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:21.779 02:35:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:21.779 02:35:46 -- common/autotest_common.sh@10 -- # set +x 00:24:21.779 ************************************ 00:24:21.779 START TEST nvmf_perf_adq 00:24:21.779 ************************************ 00:24:21.779 02:35:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:21.779 * Looking for test storage... 00:24:21.779 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:21.779 02:35:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:21.779 02:35:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:21.779 02:35:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:21.779 02:35:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:21.779 02:35:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:21.779 02:35:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:21.779 02:35:46 -- scripts/common.sh@335 -- # IFS=.-: 00:24:21.779 02:35:46 -- scripts/common.sh@335 -- # read -ra ver1 00:24:21.779 02:35:46 -- scripts/common.sh@336 -- # IFS=.-: 00:24:21.779 02:35:46 -- scripts/common.sh@336 -- # read -ra ver2 00:24:21.779 02:35:46 -- scripts/common.sh@337 -- # local 'op=<' 00:24:21.779 02:35:46 -- scripts/common.sh@339 -- # ver1_l=2 00:24:21.779 02:35:46 -- scripts/common.sh@340 -- # ver2_l=1 00:24:21.779 02:35:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:21.779 02:35:46 -- scripts/common.sh@343 -- # case "$op" in 00:24:21.779 02:35:46 -- scripts/common.sh@344 -- # : 1 00:24:21.779 02:35:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:21.779 02:35:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:21.779 02:35:46 -- scripts/common.sh@364 -- # decimal 1 00:24:21.779 02:35:46 -- scripts/common.sh@352 -- # local d=1 00:24:21.779 02:35:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:21.779 02:35:46 -- scripts/common.sh@354 -- # echo 1 00:24:21.779 02:35:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:21.779 02:35:46 -- scripts/common.sh@365 -- # decimal 2 00:24:21.779 02:35:46 -- scripts/common.sh@352 -- # local d=2 00:24:21.779 02:35:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:21.779 02:35:46 -- scripts/common.sh@354 -- # echo 2 00:24:21.779 02:35:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:21.779 02:35:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:21.779 02:35:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:21.779 02:35:46 -- scripts/common.sh@367 -- # return 0 00:24:21.779 02:35:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:21.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.779 --rc genhtml_branch_coverage=1 00:24:21.779 --rc genhtml_function_coverage=1 00:24:21.779 --rc genhtml_legend=1 00:24:21.779 --rc geninfo_all_blocks=1 00:24:21.779 --rc geninfo_unexecuted_blocks=1 00:24:21.779 00:24:21.779 ' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:21.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.779 --rc genhtml_branch_coverage=1 00:24:21.779 --rc genhtml_function_coverage=1 00:24:21.779 --rc genhtml_legend=1 00:24:21.779 --rc geninfo_all_blocks=1 00:24:21.779 --rc geninfo_unexecuted_blocks=1 00:24:21.779 00:24:21.779 ' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:21.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.779 --rc genhtml_branch_coverage=1 00:24:21.779 --rc genhtml_function_coverage=1 00:24:21.779 --rc genhtml_legend=1 00:24:21.779 --rc geninfo_all_blocks=1 00:24:21.779 --rc geninfo_unexecuted_blocks=1 00:24:21.779 00:24:21.779 ' 00:24:21.779 02:35:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:21.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:21.779 --rc genhtml_branch_coverage=1 00:24:21.779 --rc genhtml_function_coverage=1 00:24:21.779 --rc genhtml_legend=1 00:24:21.779 --rc geninfo_all_blocks=1 00:24:21.779 --rc geninfo_unexecuted_blocks=1 00:24:21.779 00:24:21.779 ' 00:24:21.779 02:35:46 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:21.779 02:35:46 -- nvmf/common.sh@7 -- # uname -s 00:24:21.779 02:35:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:21.779 02:35:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:21.779 02:35:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:21.779 02:35:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:21.779 02:35:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:21.779 02:35:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:21.779 02:35:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:21.779 02:35:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:21.779 02:35:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:21.779 02:35:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:21.779 02:35:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.779 02:35:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:21.779 02:35:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:21.779 02:35:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:21.779 02:35:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:21.779 02:35:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:21.779 02:35:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:21.779 02:35:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:21.779 02:35:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:21.779 02:35:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.779 02:35:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.779 02:35:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.779 02:35:46 -- paths/export.sh@5 -- # export PATH 00:24:21.780 02:35:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:21.780 02:35:46 -- nvmf/common.sh@46 -- # : 0 00:24:21.780 02:35:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:21.780 02:35:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:21.780 02:35:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:21.780 02:35:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:21.780 02:35:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:21.780 02:35:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:21.780 02:35:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:21.780 02:35:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:21.780 02:35:46 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:21.780 02:35:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:21.780 02:35:46 -- common/autotest_common.sh@10 -- # set +x 00:24:23.677 02:35:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:23.677 02:35:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:23.677 02:35:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:23.677 02:35:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:23.677 02:35:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:23.677 02:35:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:23.677 02:35:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:23.677 02:35:48 -- nvmf/common.sh@294 -- # net_devs=() 00:24:23.678 02:35:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:23.678 02:35:48 -- nvmf/common.sh@295 -- # e810=() 00:24:23.678 02:35:48 -- nvmf/common.sh@295 -- # local -ga e810 00:24:23.678 02:35:48 -- nvmf/common.sh@296 -- # x722=() 00:24:23.678 02:35:48 -- nvmf/common.sh@296 -- # local -ga x722 00:24:23.678 02:35:48 -- nvmf/common.sh@297 -- # mlx=() 00:24:23.678 02:35:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:23.678 02:35:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:23.678 02:35:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:23.678 02:35:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:23.678 02:35:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:23.678 02:35:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.678 02:35:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:23.678 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:23.678 02:35:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.678 02:35:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:23.678 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:23.678 02:35:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:23.678 02:35:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:23.678 02:35:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.678 02:35:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.678 02:35:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.678 02:35:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.678 02:35:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:23.678 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:23.678 02:35:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.678 02:35:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.678 02:35:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.678 02:35:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.678 02:35:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.678 02:35:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:23.678 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:23.678 02:35:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.678 02:35:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:23.678 02:35:48 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:23.678 02:35:48 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:23.678 02:35:48 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:23.678 02:35:48 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:23.678 02:35:48 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:24.611 02:35:48 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:27.143 02:35:51 -- target/perf_adq.sh@54 -- # sleep 5 00:24:32.410 02:35:56 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:32.410 02:35:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:32.410 02:35:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:32.410 02:35:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:32.410 02:35:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:32.410 02:35:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:32.410 02:35:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:32.410 02:35:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:32.410 02:35:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:32.410 02:35:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:32.410 02:35:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:32.410 02:35:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:32.410 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.410 02:35:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:32.410 02:35:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:32.410 02:35:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:32.410 02:35:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:32.410 02:35:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:32.410 02:35:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:32.410 02:35:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:32.410 02:35:56 -- nvmf/common.sh@294 -- # net_devs=() 00:24:32.410 02:35:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:32.410 02:35:56 -- nvmf/common.sh@295 -- # e810=() 00:24:32.410 02:35:56 -- nvmf/common.sh@295 -- # local -ga e810 00:24:32.410 02:35:56 -- nvmf/common.sh@296 -- # x722=() 00:24:32.410 02:35:56 -- nvmf/common.sh@296 -- # local -ga x722 00:24:32.410 02:35:56 -- nvmf/common.sh@297 -- # mlx=() 00:24:32.410 02:35:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:32.410 02:35:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:32.411 02:35:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:32.411 02:35:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:32.411 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:32.411 02:35:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:32.411 02:35:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:32.411 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:32.411 02:35:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:32.411 02:35:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:32.411 02:35:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:32.411 02:35:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:32.411 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:32.411 02:35:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:32.411 02:35:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:32.411 02:35:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:32.411 02:35:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:32.411 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:32.411 02:35:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:32.411 02:35:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:32.411 02:35:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:32.411 02:35:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:32.411 02:35:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:32.411 02:35:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:32.411 02:35:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:32.411 02:35:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:32.411 02:35:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:32.411 02:35:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:32.411 02:35:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:32.411 02:35:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:32.411 02:35:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:32.411 02:35:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:32.411 02:35:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:32.411 02:35:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:32.411 02:35:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:32.411 02:35:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:32.411 02:35:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:32.411 02:35:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:32.411 02:35:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:32.411 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:32.411 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:24:32.411 00:24:32.411 --- 10.0.0.2 ping statistics --- 00:24:32.411 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:32.411 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:24:32.411 02:35:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:32.411 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:32.411 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:24:32.411 00:24:32.411 --- 10.0.0.1 ping statistics --- 00:24:32.411 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:32.411 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:24:32.411 02:35:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:32.411 02:35:56 -- nvmf/common.sh@410 -- # return 0 00:24:32.411 02:35:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:32.411 02:35:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:32.411 02:35:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:32.411 02:35:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:32.411 02:35:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:32.411 02:35:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:32.411 02:35:56 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:32.411 02:35:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:32.411 02:35:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 02:35:56 -- nvmf/common.sh@469 -- # nvmfpid=2137553 00:24:32.411 02:35:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:32.411 02:35:56 -- nvmf/common.sh@470 -- # waitforlisten 2137553 00:24:32.411 02:35:56 -- common/autotest_common.sh@829 -- # '[' -z 2137553 ']' 00:24:32.411 02:35:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:32.411 02:35:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:32.411 02:35:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:32.411 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:32.411 02:35:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 [2024-11-27 02:35:56.380377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:32.411 [2024-11-27 02:35:56.380450] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:32.411 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.411 [2024-11-27 02:35:56.448853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:32.411 [2024-11-27 02:35:56.542793] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:32.411 [2024-11-27 02:35:56.542949] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:32.411 [2024-11-27 02:35:56.542969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:32.411 [2024-11-27 02:35:56.542983] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:32.411 [2024-11-27 02:35:56.543051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:32.411 [2024-11-27 02:35:56.543108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:32.411 [2024-11-27 02:35:56.543135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:32.411 [2024-11-27 02:35:56.543139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:32.411 02:35:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:32.411 02:35:56 -- common/autotest_common.sh@862 -- # return 0 00:24:32.411 02:35:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:32.411 02:35:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 02:35:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:32.411 02:35:56 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:32.411 02:35:56 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:32.411 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.411 02:35:56 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:32.411 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.411 02:35:56 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:32.411 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.411 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.411 [2024-11-27 02:35:56.722068] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:32.411 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.411 02:35:56 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:32.411 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.412 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.412 Malloc1 00:24:32.412 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.412 02:35:56 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:32.412 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.412 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.412 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.412 02:35:56 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:32.412 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.412 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.412 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.412 02:35:56 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:32.412 02:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:32.412 02:35:56 -- common/autotest_common.sh@10 -- # set +x 00:24:32.412 [2024-11-27 02:35:56.773494] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:32.412 02:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:32.412 02:35:56 -- target/perf_adq.sh@73 -- # perfpid=2137702 00:24:32.412 02:35:56 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:32.412 02:35:56 -- target/perf_adq.sh@74 -- # sleep 2 00:24:32.412 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.313 02:35:58 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:34.313 02:35:58 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:34.314 02:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.314 02:35:58 -- common/autotest_common.sh@10 -- # set +x 00:24:34.314 02:35:58 -- target/perf_adq.sh@76 -- # wc -l 00:24:34.314 02:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.314 02:35:58 -- target/perf_adq.sh@76 -- # count=4 00:24:34.314 02:35:58 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:34.314 02:35:58 -- target/perf_adq.sh@81 -- # wait 2137702 00:24:42.434 Initializing NVMe Controllers 00:24:42.434 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:42.434 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:42.434 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:42.434 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:42.434 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:42.434 Initialization complete. Launching workers. 00:24:42.434 ======================================================== 00:24:42.434 Latency(us) 00:24:42.434 Device Information : IOPS MiB/s Average min max 00:24:42.434 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11544.45 45.10 5545.39 1368.50 9377.85 00:24:42.434 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11373.06 44.43 5628.34 1817.36 8482.68 00:24:42.434 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11138.27 43.51 5746.66 1665.99 9506.14 00:24:42.434 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11105.97 43.38 5774.68 1411.62 46710.60 00:24:42.434 ======================================================== 00:24:42.434 Total : 45161.74 176.41 5672.30 1368.50 46710.60 00:24:42.434 00:24:42.434 02:36:06 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:42.434 02:36:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:42.434 02:36:06 -- nvmf/common.sh@116 -- # sync 00:24:42.434 02:36:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:42.434 02:36:06 -- nvmf/common.sh@119 -- # set +e 00:24:42.434 02:36:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:42.434 02:36:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:42.434 rmmod nvme_tcp 00:24:42.434 rmmod nvme_fabrics 00:24:42.434 rmmod nvme_keyring 00:24:42.434 02:36:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:42.434 02:36:07 -- nvmf/common.sh@123 -- # set -e 00:24:42.434 02:36:07 -- nvmf/common.sh@124 -- # return 0 00:24:42.434 02:36:07 -- nvmf/common.sh@477 -- # '[' -n 2137553 ']' 00:24:42.435 02:36:07 -- nvmf/common.sh@478 -- # killprocess 2137553 00:24:42.435 02:36:07 -- common/autotest_common.sh@936 -- # '[' -z 2137553 ']' 00:24:42.435 02:36:07 -- common/autotest_common.sh@940 -- # kill -0 2137553 00:24:42.435 02:36:07 -- common/autotest_common.sh@941 -- # uname 00:24:42.435 02:36:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:42.435 02:36:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2137553 00:24:42.435 02:36:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:42.435 02:36:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:42.435 02:36:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2137553' 00:24:42.435 killing process with pid 2137553 00:24:42.435 02:36:07 -- common/autotest_common.sh@955 -- # kill 2137553 00:24:42.435 02:36:07 -- common/autotest_common.sh@960 -- # wait 2137553 00:24:42.695 02:36:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:42.695 02:36:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:42.695 02:36:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:42.695 02:36:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:42.695 02:36:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:42.695 02:36:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:42.695 02:36:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:42.695 02:36:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.225 02:36:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:45.225 02:36:09 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:45.225 02:36:09 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:45.483 02:36:09 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:48.021 02:36:12 -- target/perf_adq.sh@54 -- # sleep 5 00:24:53.290 02:36:17 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:53.290 02:36:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:53.290 02:36:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:53.290 02:36:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:53.290 02:36:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:53.290 02:36:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:53.290 02:36:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.290 02:36:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.290 02:36:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.290 02:36:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:53.290 02:36:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:53.290 02:36:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:53.290 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.290 02:36:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:53.290 02:36:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:53.290 02:36:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:53.290 02:36:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:53.290 02:36:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:53.290 02:36:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:53.290 02:36:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:53.290 02:36:17 -- nvmf/common.sh@294 -- # net_devs=() 00:24:53.290 02:36:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:53.290 02:36:17 -- nvmf/common.sh@295 -- # e810=() 00:24:53.290 02:36:17 -- nvmf/common.sh@295 -- # local -ga e810 00:24:53.290 02:36:17 -- nvmf/common.sh@296 -- # x722=() 00:24:53.290 02:36:17 -- nvmf/common.sh@296 -- # local -ga x722 00:24:53.290 02:36:17 -- nvmf/common.sh@297 -- # mlx=() 00:24:53.290 02:36:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:53.290 02:36:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:53.290 02:36:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:53.291 02:36:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:53.291 02:36:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.291 02:36:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:53.291 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:53.291 02:36:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.291 02:36:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:53.291 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:53.291 02:36:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.291 02:36:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.291 02:36:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.291 02:36:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:53.291 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:53.291 02:36:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.291 02:36:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.291 02:36:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.291 02:36:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:53.291 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:53.291 02:36:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:53.291 02:36:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:53.291 02:36:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:53.291 02:36:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:53.291 02:36:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:53.291 02:36:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:53.291 02:36:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:53.291 02:36:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:53.291 02:36:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:53.291 02:36:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:53.291 02:36:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:53.291 02:36:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:53.291 02:36:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:53.291 02:36:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:53.291 02:36:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:53.291 02:36:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:53.291 02:36:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:53.291 02:36:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:53.291 02:36:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:53.291 02:36:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:53.291 02:36:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:53.291 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:53.291 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:24:53.291 00:24:53.291 --- 10.0.0.2 ping statistics --- 00:24:53.291 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.291 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:24:53.291 02:36:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:53.291 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:53.291 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:24:53.291 00:24:53.291 --- 10.0.0.1 ping statistics --- 00:24:53.291 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.291 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:24:53.291 02:36:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:53.291 02:36:17 -- nvmf/common.sh@410 -- # return 0 00:24:53.291 02:36:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:53.291 02:36:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:53.291 02:36:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:53.291 02:36:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:53.291 02:36:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:53.291 02:36:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:53.291 02:36:17 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:53.291 02:36:17 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:53.291 02:36:17 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:53.291 02:36:17 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:53.291 net.core.busy_poll = 1 00:24:53.291 02:36:17 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:53.291 net.core.busy_read = 1 00:24:53.291 02:36:17 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:53.291 02:36:17 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:53.291 02:36:17 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:53.291 02:36:17 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:53.291 02:36:17 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:53.291 02:36:17 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:53.291 02:36:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:53.291 02:36:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:53.291 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.291 02:36:17 -- nvmf/common.sh@469 -- # nvmfpid=2141010 00:24:53.291 02:36:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:53.291 02:36:17 -- nvmf/common.sh@470 -- # waitforlisten 2141010 00:24:53.291 02:36:17 -- common/autotest_common.sh@829 -- # '[' -z 2141010 ']' 00:24:53.291 02:36:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:53.291 02:36:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:53.291 02:36:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:53.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:53.291 02:36:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:53.292 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.292 [2024-11-27 02:36:17.547189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:53.292 [2024-11-27 02:36:17.547273] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:53.292 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.292 [2024-11-27 02:36:17.611009] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:53.292 [2024-11-27 02:36:17.696654] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:53.292 [2024-11-27 02:36:17.696804] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:53.292 [2024-11-27 02:36:17.696822] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:53.292 [2024-11-27 02:36:17.696835] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:53.292 [2024-11-27 02:36:17.696886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:53.292 [2024-11-27 02:36:17.696945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:53.292 [2024-11-27 02:36:17.697011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:53.292 [2024-11-27 02:36:17.697013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:53.292 02:36:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:53.292 02:36:17 -- common/autotest_common.sh@862 -- # return 0 00:24:53.292 02:36:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:53.292 02:36:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:53.292 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.292 02:36:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:53.292 02:36:17 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:53.292 02:36:17 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:53.292 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.292 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.292 02:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.292 02:36:17 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:53.292 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.292 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 02:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:17 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:53.550 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.550 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 [2024-11-27 02:36:17.952094] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:53.550 02:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:17 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:53.550 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.550 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 Malloc1 00:24:53.550 02:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:17 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:53.550 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.550 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 02:36:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:17 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:53.550 02:36:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.550 02:36:17 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 02:36:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:18 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:53.550 02:36:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:53.550 02:36:18 -- common/autotest_common.sh@10 -- # set +x 00:24:53.550 [2024-11-27 02:36:18.004933] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:53.550 02:36:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:53.550 02:36:18 -- target/perf_adq.sh@94 -- # perfpid=2141040 00:24:53.550 02:36:18 -- target/perf_adq.sh@95 -- # sleep 2 00:24:53.550 02:36:18 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:53.550 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.448 02:36:20 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:55.448 02:36:20 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:55.448 02:36:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.448 02:36:20 -- target/perf_adq.sh@97 -- # wc -l 00:24:55.448 02:36:20 -- common/autotest_common.sh@10 -- # set +x 00:24:55.448 02:36:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.448 02:36:20 -- target/perf_adq.sh@97 -- # count=2 00:24:55.448 02:36:20 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:55.448 02:36:20 -- target/perf_adq.sh@103 -- # wait 2141040 00:25:03.590 Initializing NVMe Controllers 00:25:03.590 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:03.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:03.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:03.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:03.590 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:03.590 Initialization complete. Launching workers. 00:25:03.590 ======================================================== 00:25:03.590 Latency(us) 00:25:03.590 Device Information : IOPS MiB/s Average min max 00:25:03.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7778.60 30.39 8230.72 1430.28 55152.59 00:25:03.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7950.00 31.05 8052.37 1400.68 54507.17 00:25:03.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 6528.60 25.50 9805.93 1582.03 53922.23 00:25:03.590 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6382.30 24.93 10030.47 1248.25 53787.91 00:25:03.590 ======================================================== 00:25:03.590 Total : 28639.49 111.87 8941.36 1248.25 55152.59 00:25:03.590 00:25:03.590 02:36:28 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:03.590 02:36:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:03.590 02:36:28 -- nvmf/common.sh@116 -- # sync 00:25:03.590 02:36:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:03.590 02:36:28 -- nvmf/common.sh@119 -- # set +e 00:25:03.590 02:36:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:03.590 02:36:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:03.590 rmmod nvme_tcp 00:25:03.590 rmmod nvme_fabrics 00:25:03.590 rmmod nvme_keyring 00:25:03.590 02:36:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:03.590 02:36:28 -- nvmf/common.sh@123 -- # set -e 00:25:03.590 02:36:28 -- nvmf/common.sh@124 -- # return 0 00:25:03.590 02:36:28 -- nvmf/common.sh@477 -- # '[' -n 2141010 ']' 00:25:03.590 02:36:28 -- nvmf/common.sh@478 -- # killprocess 2141010 00:25:03.590 02:36:28 -- common/autotest_common.sh@936 -- # '[' -z 2141010 ']' 00:25:03.590 02:36:28 -- common/autotest_common.sh@940 -- # kill -0 2141010 00:25:03.590 02:36:28 -- common/autotest_common.sh@941 -- # uname 00:25:03.590 02:36:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:03.590 02:36:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2141010 00:25:03.848 02:36:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:03.848 02:36:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:03.848 02:36:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2141010' 00:25:03.848 killing process with pid 2141010 00:25:03.848 02:36:28 -- common/autotest_common.sh@955 -- # kill 2141010 00:25:03.848 02:36:28 -- common/autotest_common.sh@960 -- # wait 2141010 00:25:04.106 02:36:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:04.106 02:36:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:04.106 02:36:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:04.106 02:36:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:04.106 02:36:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:04.106 02:36:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:04.106 02:36:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:04.106 02:36:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.010 02:36:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:06.010 02:36:30 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:06.010 00:25:06.010 real 0m44.373s 00:25:06.010 user 2m39.378s 00:25:06.010 sys 0m9.371s 00:25:06.010 02:36:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:06.010 02:36:30 -- common/autotest_common.sh@10 -- # set +x 00:25:06.010 ************************************ 00:25:06.010 END TEST nvmf_perf_adq 00:25:06.010 ************************************ 00:25:06.010 02:36:30 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:06.010 02:36:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:06.010 02:36:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.010 02:36:30 -- common/autotest_common.sh@10 -- # set +x 00:25:06.010 ************************************ 00:25:06.010 START TEST nvmf_shutdown 00:25:06.010 ************************************ 00:25:06.010 02:36:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:06.010 * Looking for test storage... 00:25:06.010 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:06.010 02:36:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:06.010 02:36:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:06.010 02:36:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:06.269 02:36:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:06.269 02:36:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:06.269 02:36:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:06.269 02:36:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:06.269 02:36:30 -- scripts/common.sh@335 -- # IFS=.-: 00:25:06.269 02:36:30 -- scripts/common.sh@335 -- # read -ra ver1 00:25:06.269 02:36:30 -- scripts/common.sh@336 -- # IFS=.-: 00:25:06.269 02:36:30 -- scripts/common.sh@336 -- # read -ra ver2 00:25:06.269 02:36:30 -- scripts/common.sh@337 -- # local 'op=<' 00:25:06.269 02:36:30 -- scripts/common.sh@339 -- # ver1_l=2 00:25:06.269 02:36:30 -- scripts/common.sh@340 -- # ver2_l=1 00:25:06.269 02:36:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:06.269 02:36:30 -- scripts/common.sh@343 -- # case "$op" in 00:25:06.269 02:36:30 -- scripts/common.sh@344 -- # : 1 00:25:06.269 02:36:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:06.269 02:36:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:06.269 02:36:30 -- scripts/common.sh@364 -- # decimal 1 00:25:06.269 02:36:30 -- scripts/common.sh@352 -- # local d=1 00:25:06.269 02:36:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:06.269 02:36:30 -- scripts/common.sh@354 -- # echo 1 00:25:06.269 02:36:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:06.269 02:36:30 -- scripts/common.sh@365 -- # decimal 2 00:25:06.269 02:36:30 -- scripts/common.sh@352 -- # local d=2 00:25:06.269 02:36:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:06.269 02:36:30 -- scripts/common.sh@354 -- # echo 2 00:25:06.269 02:36:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:06.269 02:36:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:06.269 02:36:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:06.269 02:36:30 -- scripts/common.sh@367 -- # return 0 00:25:06.269 02:36:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:06.269 02:36:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:06.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:06.269 --rc genhtml_branch_coverage=1 00:25:06.269 --rc genhtml_function_coverage=1 00:25:06.269 --rc genhtml_legend=1 00:25:06.269 --rc geninfo_all_blocks=1 00:25:06.269 --rc geninfo_unexecuted_blocks=1 00:25:06.269 00:25:06.269 ' 00:25:06.269 02:36:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:06.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:06.269 --rc genhtml_branch_coverage=1 00:25:06.269 --rc genhtml_function_coverage=1 00:25:06.269 --rc genhtml_legend=1 00:25:06.269 --rc geninfo_all_blocks=1 00:25:06.269 --rc geninfo_unexecuted_blocks=1 00:25:06.269 00:25:06.269 ' 00:25:06.269 02:36:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:06.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:06.269 --rc genhtml_branch_coverage=1 00:25:06.269 --rc genhtml_function_coverage=1 00:25:06.269 --rc genhtml_legend=1 00:25:06.269 --rc geninfo_all_blocks=1 00:25:06.269 --rc geninfo_unexecuted_blocks=1 00:25:06.269 00:25:06.269 ' 00:25:06.269 02:36:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:06.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:06.269 --rc genhtml_branch_coverage=1 00:25:06.269 --rc genhtml_function_coverage=1 00:25:06.269 --rc genhtml_legend=1 00:25:06.269 --rc geninfo_all_blocks=1 00:25:06.269 --rc geninfo_unexecuted_blocks=1 00:25:06.269 00:25:06.269 ' 00:25:06.269 02:36:30 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:06.269 02:36:30 -- nvmf/common.sh@7 -- # uname -s 00:25:06.269 02:36:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:06.269 02:36:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:06.269 02:36:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:06.269 02:36:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:06.269 02:36:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:06.269 02:36:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:06.269 02:36:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:06.269 02:36:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:06.269 02:36:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:06.269 02:36:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:06.269 02:36:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:06.269 02:36:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:06.269 02:36:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:06.269 02:36:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:06.269 02:36:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:06.269 02:36:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:06.269 02:36:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:06.269 02:36:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:06.269 02:36:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:06.269 02:36:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.269 02:36:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.270 02:36:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.270 02:36:30 -- paths/export.sh@5 -- # export PATH 00:25:06.270 02:36:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:06.270 02:36:30 -- nvmf/common.sh@46 -- # : 0 00:25:06.270 02:36:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:06.270 02:36:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:06.270 02:36:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:06.270 02:36:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:06.270 02:36:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:06.270 02:36:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:06.270 02:36:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:06.270 02:36:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:06.270 02:36:30 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:06.270 02:36:30 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:06.270 02:36:30 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:06.270 02:36:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:06.270 02:36:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:06.270 02:36:30 -- common/autotest_common.sh@10 -- # set +x 00:25:06.270 ************************************ 00:25:06.270 START TEST nvmf_shutdown_tc1 00:25:06.270 ************************************ 00:25:06.270 02:36:30 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:06.270 02:36:30 -- target/shutdown.sh@74 -- # starttarget 00:25:06.270 02:36:30 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:06.270 02:36:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:06.270 02:36:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:06.270 02:36:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:06.270 02:36:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:06.270 02:36:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:06.270 02:36:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.270 02:36:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.270 02:36:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:06.270 02:36:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:06.270 02:36:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:06.270 02:36:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:06.270 02:36:30 -- common/autotest_common.sh@10 -- # set +x 00:25:08.171 02:36:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:08.171 02:36:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:08.171 02:36:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:08.171 02:36:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:08.171 02:36:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:08.171 02:36:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:08.171 02:36:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:08.171 02:36:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:08.171 02:36:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:08.171 02:36:32 -- nvmf/common.sh@295 -- # e810=() 00:25:08.171 02:36:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:08.171 02:36:32 -- nvmf/common.sh@296 -- # x722=() 00:25:08.171 02:36:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:08.171 02:36:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:08.171 02:36:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:08.171 02:36:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:08.171 02:36:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:08.171 02:36:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:08.171 02:36:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:08.171 02:36:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:08.171 02:36:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:08.171 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:08.171 02:36:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:08.171 02:36:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:08.171 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:08.171 02:36:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:08.171 02:36:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:08.172 02:36:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:08.172 02:36:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.172 02:36:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:08.172 02:36:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.172 02:36:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:08.172 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:08.172 02:36:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.172 02:36:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:08.172 02:36:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:08.172 02:36:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:08.172 02:36:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:08.172 02:36:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:08.172 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:08.172 02:36:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:08.172 02:36:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:08.172 02:36:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:08.172 02:36:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:08.172 02:36:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:08.172 02:36:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:08.172 02:36:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:08.172 02:36:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:08.172 02:36:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:08.172 02:36:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:08.172 02:36:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:08.172 02:36:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:08.172 02:36:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:08.172 02:36:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:08.172 02:36:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:08.172 02:36:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:08.172 02:36:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:08.172 02:36:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:08.431 02:36:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:08.431 02:36:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:08.431 02:36:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:08.431 02:36:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:08.431 02:36:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:08.431 02:36:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:08.431 02:36:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:08.431 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:08.431 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:25:08.431 00:25:08.431 --- 10.0.0.2 ping statistics --- 00:25:08.431 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:08.431 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:25:08.431 02:36:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:08.431 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:08.431 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:25:08.431 00:25:08.431 --- 10.0.0.1 ping statistics --- 00:25:08.431 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:08.431 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:25:08.431 02:36:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:08.431 02:36:32 -- nvmf/common.sh@410 -- # return 0 00:25:08.431 02:36:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:08.431 02:36:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:08.431 02:36:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:08.431 02:36:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:08.431 02:36:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:08.431 02:36:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:08.431 02:36:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:08.431 02:36:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:08.431 02:36:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:08.431 02:36:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:08.431 02:36:32 -- common/autotest_common.sh@10 -- # set +x 00:25:08.431 02:36:32 -- nvmf/common.sh@469 -- # nvmfpid=2144301 00:25:08.431 02:36:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:08.431 02:36:32 -- nvmf/common.sh@470 -- # waitforlisten 2144301 00:25:08.431 02:36:32 -- common/autotest_common.sh@829 -- # '[' -z 2144301 ']' 00:25:08.431 02:36:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:08.431 02:36:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:08.431 02:36:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:08.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:08.431 02:36:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:08.431 02:36:32 -- common/autotest_common.sh@10 -- # set +x 00:25:08.431 [2024-11-27 02:36:33.012889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:08.431 [2024-11-27 02:36:33.012970] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:08.431 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.690 [2024-11-27 02:36:33.087637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:08.690 [2024-11-27 02:36:33.176999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:08.690 [2024-11-27 02:36:33.177172] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:08.690 [2024-11-27 02:36:33.177191] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:08.690 [2024-11-27 02:36:33.177206] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:08.690 [2024-11-27 02:36:33.177332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:08.690 [2024-11-27 02:36:33.177425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:08.690 [2024-11-27 02:36:33.177491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:08.690 [2024-11-27 02:36:33.177493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:09.623 02:36:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:09.623 02:36:33 -- common/autotest_common.sh@862 -- # return 0 00:25:09.623 02:36:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:09.623 02:36:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:09.623 02:36:33 -- common/autotest_common.sh@10 -- # set +x 00:25:09.623 02:36:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:09.623 02:36:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:09.623 02:36:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:09.623 02:36:33 -- common/autotest_common.sh@10 -- # set +x 00:25:09.623 [2024-11-27 02:36:33.990125] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:09.623 02:36:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:09.623 02:36:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:09.623 02:36:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:09.623 02:36:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:09.623 02:36:33 -- common/autotest_common.sh@10 -- # set +x 00:25:09.623 02:36:34 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.623 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.623 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.624 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.624 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.624 02:36:34 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:09.624 02:36:34 -- target/shutdown.sh@28 -- # cat 00:25:09.624 02:36:34 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:09.624 02:36:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:09.624 02:36:34 -- common/autotest_common.sh@10 -- # set +x 00:25:09.624 Malloc1 00:25:09.624 [2024-11-27 02:36:34.074668] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:09.624 Malloc2 00:25:09.624 Malloc3 00:25:09.624 Malloc4 00:25:09.624 Malloc5 00:25:09.882 Malloc6 00:25:09.882 Malloc7 00:25:09.882 Malloc8 00:25:09.882 Malloc9 00:25:09.882 Malloc10 00:25:10.141 02:36:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:10.142 02:36:34 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:10.142 02:36:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:10.142 02:36:34 -- common/autotest_common.sh@10 -- # set +x 00:25:10.142 02:36:34 -- target/shutdown.sh@78 -- # perfpid=2144572 00:25:10.142 02:36:34 -- target/shutdown.sh@79 -- # waitforlisten 2144572 /var/tmp/bdevperf.sock 00:25:10.142 02:36:34 -- common/autotest_common.sh@829 -- # '[' -z 2144572 ']' 00:25:10.142 02:36:34 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:10.142 02:36:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:10.142 02:36:34 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:10.142 02:36:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:10.142 02:36:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:10.142 02:36:34 -- nvmf/common.sh@520 -- # config=() 00:25:10.142 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:10.142 02:36:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:10.142 02:36:34 -- nvmf/common.sh@520 -- # local subsystem config 00:25:10.142 02:36:34 -- common/autotest_common.sh@10 -- # set +x 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.142 "trsvcid": "$NVMF_PORT", 00:25:10.142 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.142 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.142 "hdgst": ${hdgst:-false}, 00:25:10.142 "ddgst": ${ddgst:-false} 00:25:10.142 }, 00:25:10.142 "method": "bdev_nvme_attach_controller" 00:25:10.142 } 00:25:10.142 EOF 00:25:10.142 )") 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.142 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.142 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.142 { 00:25:10.142 "params": { 00:25:10.142 "name": "Nvme$subsystem", 00:25:10.142 "trtype": "$TEST_TRANSPORT", 00:25:10.142 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.142 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "$NVMF_PORT", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.143 "hdgst": ${hdgst:-false}, 00:25:10.143 "ddgst": ${ddgst:-false} 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 } 00:25:10.143 EOF 00:25:10.143 )") 00:25:10.143 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.143 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.143 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.143 { 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme$subsystem", 00:25:10.143 "trtype": "$TEST_TRANSPORT", 00:25:10.143 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "$NVMF_PORT", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.143 "hdgst": ${hdgst:-false}, 00:25:10.143 "ddgst": ${ddgst:-false} 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 } 00:25:10.143 EOF 00:25:10.143 )") 00:25:10.143 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.143 02:36:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:10.143 02:36:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:10.143 { 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme$subsystem", 00:25:10.143 "trtype": "$TEST_TRANSPORT", 00:25:10.143 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "$NVMF_PORT", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:10.143 "hdgst": ${hdgst:-false}, 00:25:10.143 "ddgst": ${ddgst:-false} 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 } 00:25:10.143 EOF 00:25:10.143 )") 00:25:10.143 02:36:34 -- nvmf/common.sh@542 -- # cat 00:25:10.143 02:36:34 -- nvmf/common.sh@544 -- # jq . 00:25:10.143 02:36:34 -- nvmf/common.sh@545 -- # IFS=, 00:25:10.143 02:36:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme1", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme2", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme3", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme4", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme5", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme6", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme7", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme8", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.143 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:10.143 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:10.143 "hdgst": false, 00:25:10.143 "ddgst": false 00:25:10.143 }, 00:25:10.143 "method": "bdev_nvme_attach_controller" 00:25:10.143 },{ 00:25:10.143 "params": { 00:25:10.143 "name": "Nvme9", 00:25:10.143 "trtype": "tcp", 00:25:10.143 "traddr": "10.0.0.2", 00:25:10.143 "adrfam": "ipv4", 00:25:10.143 "trsvcid": "4420", 00:25:10.144 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:10.144 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:10.144 "hdgst": false, 00:25:10.144 "ddgst": false 00:25:10.144 }, 00:25:10.144 "method": "bdev_nvme_attach_controller" 00:25:10.144 },{ 00:25:10.144 "params": { 00:25:10.144 "name": "Nvme10", 00:25:10.144 "trtype": "tcp", 00:25:10.144 "traddr": "10.0.0.2", 00:25:10.144 "adrfam": "ipv4", 00:25:10.144 "trsvcid": "4420", 00:25:10.144 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:10.144 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:10.144 "hdgst": false, 00:25:10.144 "ddgst": false 00:25:10.144 }, 00:25:10.144 "method": "bdev_nvme_attach_controller" 00:25:10.144 }' 00:25:10.144 [2024-11-27 02:36:34.586481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:10.144 [2024-11-27 02:36:34.586591] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:10.144 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.144 [2024-11-27 02:36:34.650693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:10.144 [2024-11-27 02:36:34.736229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:12.672 02:36:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:12.672 02:36:37 -- common/autotest_common.sh@862 -- # return 0 00:25:12.672 02:36:37 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:12.672 02:36:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:12.672 02:36:37 -- common/autotest_common.sh@10 -- # set +x 00:25:12.672 02:36:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:12.672 02:36:37 -- target/shutdown.sh@83 -- # kill -9 2144572 00:25:12.672 02:36:37 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:12.672 02:36:37 -- target/shutdown.sh@87 -- # sleep 1 00:25:13.606 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2144572 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:13.606 02:36:38 -- target/shutdown.sh@88 -- # kill -0 2144301 00:25:13.606 02:36:38 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:13.606 02:36:38 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:13.606 02:36:38 -- nvmf/common.sh@520 -- # config=() 00:25:13.606 02:36:38 -- nvmf/common.sh@520 -- # local subsystem config 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.606 "params": { 00:25:13.606 "name": "Nvme$subsystem", 00:25:13.606 "trtype": "$TEST_TRANSPORT", 00:25:13.606 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.606 "adrfam": "ipv4", 00:25:13.606 "trsvcid": "$NVMF_PORT", 00:25:13.606 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.606 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.606 "hdgst": ${hdgst:-false}, 00:25:13.606 "ddgst": ${ddgst:-false} 00:25:13.606 }, 00:25:13.606 "method": "bdev_nvme_attach_controller" 00:25:13.606 } 00:25:13.606 EOF 00:25:13.606 )") 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.606 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.606 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.606 { 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme$subsystem", 00:25:13.607 "trtype": "$TEST_TRANSPORT", 00:25:13.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "$NVMF_PORT", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.607 "hdgst": ${hdgst:-false}, 00:25:13.607 "ddgst": ${ddgst:-false} 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 } 00:25:13.607 EOF 00:25:13.607 )") 00:25:13.607 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.607 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.607 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.607 { 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme$subsystem", 00:25:13.607 "trtype": "$TEST_TRANSPORT", 00:25:13.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "$NVMF_PORT", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.607 "hdgst": ${hdgst:-false}, 00:25:13.607 "ddgst": ${ddgst:-false} 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 } 00:25:13.607 EOF 00:25:13.607 )") 00:25:13.607 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.607 02:36:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.607 02:36:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.607 { 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme$subsystem", 00:25:13.607 "trtype": "$TEST_TRANSPORT", 00:25:13.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "$NVMF_PORT", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.607 "hdgst": ${hdgst:-false}, 00:25:13.607 "ddgst": ${ddgst:-false} 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 } 00:25:13.607 EOF 00:25:13.607 )") 00:25:13.607 02:36:38 -- nvmf/common.sh@542 -- # cat 00:25:13.607 02:36:38 -- nvmf/common.sh@544 -- # jq . 00:25:13.607 02:36:38 -- nvmf/common.sh@545 -- # IFS=, 00:25:13.607 02:36:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme1", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme2", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme3", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme4", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme5", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme6", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme7", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme8", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme9", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:13.607 "hdgst": false, 00:25:13.607 "ddgst": false 00:25:13.607 }, 00:25:13.607 "method": "bdev_nvme_attach_controller" 00:25:13.607 },{ 00:25:13.607 "params": { 00:25:13.607 "name": "Nvme10", 00:25:13.607 "trtype": "tcp", 00:25:13.607 "traddr": "10.0.0.2", 00:25:13.607 "adrfam": "ipv4", 00:25:13.607 "trsvcid": "4420", 00:25:13.607 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:13.607 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:13.607 "hdgst": false, 00:25:13.608 "ddgst": false 00:25:13.608 }, 00:25:13.608 "method": "bdev_nvme_attach_controller" 00:25:13.608 }' 00:25:13.608 [2024-11-27 02:36:38.114810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:13.608 [2024-11-27 02:36:38.114916] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2145010 ] 00:25:13.608 EAL: No free 2048 kB hugepages reported on node 1 00:25:13.608 [2024-11-27 02:36:38.179180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:13.866 [2024-11-27 02:36:38.264887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:15.237 Running I/O for 1 seconds... 00:25:16.612 00:25:16.612 Latency(us) 00:25:16.612 [2024-11-27T01:36:41.247Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.612 [2024-11-27T01:36:41.247Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.612 Verification LBA range: start 0x0 length 0x400 00:25:16.612 Nvme1n1 : 1.10 395.02 24.69 0.00 0.00 159111.32 19223.89 130489.46 00:25:16.612 [2024-11-27T01:36:41.247Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.612 Verification LBA range: start 0x0 length 0x400 00:25:16.612 Nvme2n1 : 1.07 371.76 23.24 0.00 0.00 166664.16 36894.34 158451.48 00:25:16.612 [2024-11-27T01:36:41.247Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.612 Verification LBA range: start 0x0 length 0x400 00:25:16.612 Nvme3n1 : 1.09 397.99 24.87 0.00 0.00 155776.02 17767.54 123498.95 00:25:16.612 [2024-11-27T01:36:41.247Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.612 Verification LBA range: start 0x0 length 0x400 00:25:16.612 Nvme4n1 : 1.10 395.68 24.73 0.00 0.00 155277.14 20388.98 128159.29 00:25:16.612 [2024-11-27T01:36:41.248Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme5n1 : 1.10 394.34 24.65 0.00 0.00 154836.88 19223.89 128159.29 00:25:16.613 [2024-11-27T01:36:41.248Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme6n1 : 1.11 390.92 24.43 0.00 0.00 155598.84 14854.83 137479.96 00:25:16.613 [2024-11-27T01:36:41.248Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme7n1 : 1.10 393.32 24.58 0.00 0.00 152935.79 19903.53 121945.51 00:25:16.613 [2024-11-27T01:36:41.248Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme8n1 : 1.11 392.33 24.52 0.00 0.00 152535.12 18058.81 124275.67 00:25:16.613 [2024-11-27T01:36:41.248Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme9n1 : 1.12 389.22 24.33 0.00 0.00 153991.95 6068.15 137479.96 00:25:16.613 [2024-11-27T01:36:41.248Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.613 Verification LBA range: start 0x0 length 0x400 00:25:16.613 Nvme10n1 : 1.11 395.71 24.73 0.00 0.00 149142.50 9709.04 132819.63 00:25:16.613 [2024-11-27T01:36:41.248Z] =================================================================================================================== 00:25:16.613 [2024-11-27T01:36:41.248Z] Total : 3916.30 244.77 0.00 0.00 155485.48 6068.15 158451.48 00:25:16.613 02:36:41 -- target/shutdown.sh@93 -- # stoptarget 00:25:16.613 02:36:41 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:16.613 02:36:41 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:16.613 02:36:41 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:16.613 02:36:41 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:16.613 02:36:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:16.613 02:36:41 -- nvmf/common.sh@116 -- # sync 00:25:16.613 02:36:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:16.613 02:36:41 -- nvmf/common.sh@119 -- # set +e 00:25:16.613 02:36:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:16.613 02:36:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:16.613 rmmod nvme_tcp 00:25:16.613 rmmod nvme_fabrics 00:25:16.613 rmmod nvme_keyring 00:25:16.613 02:36:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:16.613 02:36:41 -- nvmf/common.sh@123 -- # set -e 00:25:16.613 02:36:41 -- nvmf/common.sh@124 -- # return 0 00:25:16.613 02:36:41 -- nvmf/common.sh@477 -- # '[' -n 2144301 ']' 00:25:16.613 02:36:41 -- nvmf/common.sh@478 -- # killprocess 2144301 00:25:16.613 02:36:41 -- common/autotest_common.sh@936 -- # '[' -z 2144301 ']' 00:25:16.613 02:36:41 -- common/autotest_common.sh@940 -- # kill -0 2144301 00:25:16.613 02:36:41 -- common/autotest_common.sh@941 -- # uname 00:25:16.613 02:36:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:16.613 02:36:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2144301 00:25:16.871 02:36:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:16.871 02:36:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:16.871 02:36:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2144301' 00:25:16.871 killing process with pid 2144301 00:25:16.871 02:36:41 -- common/autotest_common.sh@955 -- # kill 2144301 00:25:16.871 02:36:41 -- common/autotest_common.sh@960 -- # wait 2144301 00:25:17.131 02:36:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:17.131 02:36:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:17.131 02:36:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:17.131 02:36:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:17.131 02:36:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:17.131 02:36:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:17.131 02:36:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:17.131 02:36:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.663 02:36:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:19.663 00:25:19.663 real 0m13.049s 00:25:19.663 user 0m39.692s 00:25:19.663 sys 0m3.443s 00:25:19.663 02:36:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:19.663 02:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:19.663 ************************************ 00:25:19.663 END TEST nvmf_shutdown_tc1 00:25:19.663 ************************************ 00:25:19.663 02:36:43 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:19.663 02:36:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:19.663 02:36:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:19.663 02:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:19.663 ************************************ 00:25:19.663 START TEST nvmf_shutdown_tc2 00:25:19.663 ************************************ 00:25:19.663 02:36:43 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:19.663 02:36:43 -- target/shutdown.sh@98 -- # starttarget 00:25:19.663 02:36:43 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:19.663 02:36:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:19.663 02:36:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:19.663 02:36:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:19.663 02:36:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:19.663 02:36:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:19.663 02:36:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.663 02:36:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.663 02:36:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.663 02:36:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:19.663 02:36:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:19.663 02:36:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:19.663 02:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:19.663 02:36:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:19.663 02:36:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:19.663 02:36:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:19.663 02:36:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:19.663 02:36:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:19.663 02:36:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:19.663 02:36:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:19.663 02:36:43 -- nvmf/common.sh@294 -- # net_devs=() 00:25:19.663 02:36:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:19.663 02:36:43 -- nvmf/common.sh@295 -- # e810=() 00:25:19.663 02:36:43 -- nvmf/common.sh@295 -- # local -ga e810 00:25:19.663 02:36:43 -- nvmf/common.sh@296 -- # x722=() 00:25:19.663 02:36:43 -- nvmf/common.sh@296 -- # local -ga x722 00:25:19.663 02:36:43 -- nvmf/common.sh@297 -- # mlx=() 00:25:19.663 02:36:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:19.664 02:36:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:19.664 02:36:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:19.664 02:36:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:19.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:19.664 02:36:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:19.664 02:36:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:19.664 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:19.664 02:36:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:19.664 02:36:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:19.664 02:36:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:19.664 02:36:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:19.664 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:19.664 02:36:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:19.664 02:36:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:19.664 02:36:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:19.664 02:36:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:19.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:19.664 02:36:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:19.664 02:36:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:19.664 02:36:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:19.664 02:36:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:19.664 02:36:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:19.664 02:36:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:19.664 02:36:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:19.664 02:36:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:19.664 02:36:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:19.664 02:36:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:19.664 02:36:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:19.664 02:36:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:19.664 02:36:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:19.664 02:36:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:19.664 02:36:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:19.664 02:36:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:19.664 02:36:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:19.664 02:36:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:19.664 02:36:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:19.664 02:36:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:19.664 02:36:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:19.664 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:19.664 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:25:19.664 00:25:19.664 --- 10.0.0.2 ping statistics --- 00:25:19.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:19.664 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:25:19.664 02:36:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:19.664 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:19.664 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:25:19.664 00:25:19.664 --- 10.0.0.1 ping statistics --- 00:25:19.664 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:19.664 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:25:19.664 02:36:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:19.664 02:36:43 -- nvmf/common.sh@410 -- # return 0 00:25:19.664 02:36:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:19.664 02:36:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:19.664 02:36:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:19.664 02:36:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:19.664 02:36:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:19.664 02:36:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:19.664 02:36:43 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:19.664 02:36:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:19.664 02:36:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:19.664 02:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:19.664 02:36:43 -- nvmf/common.sh@469 -- # nvmfpid=2145791 00:25:19.664 02:36:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:19.664 02:36:43 -- nvmf/common.sh@470 -- # waitforlisten 2145791 00:25:19.664 02:36:43 -- common/autotest_common.sh@829 -- # '[' -z 2145791 ']' 00:25:19.664 02:36:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:19.664 02:36:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:19.664 02:36:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:19.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:19.664 02:36:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:19.664 02:36:43 -- common/autotest_common.sh@10 -- # set +x 00:25:19.664 [2024-11-27 02:36:44.022567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:19.664 [2024-11-27 02:36:44.022648] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:19.664 EAL: No free 2048 kB hugepages reported on node 1 00:25:19.664 [2024-11-27 02:36:44.086977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:19.664 [2024-11-27 02:36:44.176942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:19.664 [2024-11-27 02:36:44.177091] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:19.664 [2024-11-27 02:36:44.177109] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:19.664 [2024-11-27 02:36:44.177122] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:19.664 [2024-11-27 02:36:44.177217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:19.664 [2024-11-27 02:36:44.177279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:19.664 [2024-11-27 02:36:44.177412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:19.664 [2024-11-27 02:36:44.177414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:20.596 02:36:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:20.596 02:36:45 -- common/autotest_common.sh@862 -- # return 0 00:25:20.596 02:36:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:20.596 02:36:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:20.596 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:20.596 02:36:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:20.596 02:36:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:20.596 02:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.596 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:20.596 [2024-11-27 02:36:45.036274] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:20.596 02:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:20.596 02:36:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:20.596 02:36:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:20.596 02:36:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:20.596 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:20.596 02:36:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:20.596 02:36:45 -- target/shutdown.sh@28 -- # cat 00:25:20.596 02:36:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:20.596 02:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:20.596 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:20.596 Malloc1 00:25:20.596 [2024-11-27 02:36:45.111312] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:20.596 Malloc2 00:25:20.596 Malloc3 00:25:20.854 Malloc4 00:25:20.854 Malloc5 00:25:20.854 Malloc6 00:25:20.854 Malloc7 00:25:20.854 Malloc8 00:25:20.854 Malloc9 00:25:21.113 Malloc10 00:25:21.113 02:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:21.113 02:36:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:21.113 02:36:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:21.113 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:21.113 02:36:45 -- target/shutdown.sh@102 -- # perfpid=2146109 00:25:21.113 02:36:45 -- target/shutdown.sh@103 -- # waitforlisten 2146109 /var/tmp/bdevperf.sock 00:25:21.113 02:36:45 -- common/autotest_common.sh@829 -- # '[' -z 2146109 ']' 00:25:21.113 02:36:45 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:21.113 02:36:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:21.113 02:36:45 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:21.113 02:36:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:21.113 02:36:45 -- nvmf/common.sh@520 -- # config=() 00:25:21.113 02:36:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:21.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:21.113 02:36:45 -- nvmf/common.sh@520 -- # local subsystem config 00:25:21.113 02:36:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:21.113 02:36:45 -- common/autotest_common.sh@10 -- # set +x 00:25:21.113 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.113 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.113 { 00:25:21.113 "params": { 00:25:21.113 "name": "Nvme$subsystem", 00:25:21.113 "trtype": "$TEST_TRANSPORT", 00:25:21.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.113 "adrfam": "ipv4", 00:25:21.113 "trsvcid": "$NVMF_PORT", 00:25:21.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.113 "hdgst": ${hdgst:-false}, 00:25:21.113 "ddgst": ${ddgst:-false} 00:25:21.113 }, 00:25:21.113 "method": "bdev_nvme_attach_controller" 00:25:21.113 } 00:25:21.113 EOF 00:25:21.113 )") 00:25:21.113 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.113 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.113 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.113 { 00:25:21.113 "params": { 00:25:21.113 "name": "Nvme$subsystem", 00:25:21.113 "trtype": "$TEST_TRANSPORT", 00:25:21.113 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.113 "adrfam": "ipv4", 00:25:21.113 "trsvcid": "$NVMF_PORT", 00:25:21.113 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.113 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.113 "hdgst": ${hdgst:-false}, 00:25:21.113 "ddgst": ${ddgst:-false} 00:25:21.113 }, 00:25:21.113 "method": "bdev_nvme_attach_controller" 00:25:21.113 } 00:25:21.113 EOF 00:25:21.113 )") 00:25:21.113 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.113 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.113 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:21.114 { 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme$subsystem", 00:25:21.114 "trtype": "$TEST_TRANSPORT", 00:25:21.114 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "$NVMF_PORT", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:21.114 "hdgst": ${hdgst:-false}, 00:25:21.114 "ddgst": ${ddgst:-false} 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 } 00:25:21.114 EOF 00:25:21.114 )") 00:25:21.114 02:36:45 -- nvmf/common.sh@542 -- # cat 00:25:21.114 02:36:45 -- nvmf/common.sh@544 -- # jq . 00:25:21.114 02:36:45 -- nvmf/common.sh@545 -- # IFS=, 00:25:21.114 02:36:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:21.114 "params": { 00:25:21.114 "name": "Nvme1", 00:25:21.114 "trtype": "tcp", 00:25:21.114 "traddr": "10.0.0.2", 00:25:21.114 "adrfam": "ipv4", 00:25:21.114 "trsvcid": "4420", 00:25:21.114 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:21.114 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:21.114 "hdgst": false, 00:25:21.114 "ddgst": false 00:25:21.114 }, 00:25:21.114 "method": "bdev_nvme_attach_controller" 00:25:21.114 },{ 00:25:21.114 "params": { 00:25:21.115 "name": "Nvme2", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme3", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme4", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme5", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme6", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme7", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme8", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme9", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 },{ 00:25:21.115 "params": { 00:25:21.115 "name": "Nvme10", 00:25:21.115 "trtype": "tcp", 00:25:21.115 "traddr": "10.0.0.2", 00:25:21.115 "adrfam": "ipv4", 00:25:21.115 "trsvcid": "4420", 00:25:21.115 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:21.115 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:21.115 "hdgst": false, 00:25:21.115 "ddgst": false 00:25:21.115 }, 00:25:21.115 "method": "bdev_nvme_attach_controller" 00:25:21.115 }' 00:25:21.115 [2024-11-27 02:36:45.606521] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:21.115 [2024-11-27 02:36:45.606621] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2146109 ] 00:25:21.115 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.115 [2024-11-27 02:36:45.669589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:21.374 [2024-11-27 02:36:45.755207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:22.749 Running I/O for 10 seconds... 00:25:22.749 02:36:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:22.749 02:36:47 -- common/autotest_common.sh@862 -- # return 0 00:25:22.749 02:36:47 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:22.749 02:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.749 02:36:47 -- common/autotest_common.sh@10 -- # set +x 00:25:23.007 02:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.007 02:36:47 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:23.007 02:36:47 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:23.007 02:36:47 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:23.007 02:36:47 -- target/shutdown.sh@57 -- # local ret=1 00:25:23.007 02:36:47 -- target/shutdown.sh@58 -- # local i 00:25:23.007 02:36:47 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:23.007 02:36:47 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:23.007 02:36:47 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:23.007 02:36:47 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:23.007 02:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.007 02:36:47 -- common/autotest_common.sh@10 -- # set +x 00:25:23.007 02:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.007 02:36:47 -- target/shutdown.sh@60 -- # read_io_count=3 00:25:23.007 02:36:47 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:25:23.007 02:36:47 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:23.265 02:36:47 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:23.265 02:36:47 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:23.265 02:36:47 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:23.265 02:36:47 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:23.265 02:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.265 02:36:47 -- common/autotest_common.sh@10 -- # set +x 00:25:23.265 02:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.265 02:36:47 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:23.265 02:36:47 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:23.265 02:36:47 -- target/shutdown.sh@64 -- # ret=0 00:25:23.265 02:36:47 -- target/shutdown.sh@65 -- # break 00:25:23.265 02:36:47 -- target/shutdown.sh@69 -- # return 0 00:25:23.265 02:36:47 -- target/shutdown.sh@109 -- # killprocess 2146109 00:25:23.265 02:36:47 -- common/autotest_common.sh@936 -- # '[' -z 2146109 ']' 00:25:23.265 02:36:47 -- common/autotest_common.sh@940 -- # kill -0 2146109 00:25:23.265 02:36:47 -- common/autotest_common.sh@941 -- # uname 00:25:23.265 02:36:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.266 02:36:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2146109 00:25:23.266 02:36:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:23.266 02:36:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:23.266 02:36:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2146109' 00:25:23.266 killing process with pid 2146109 00:25:23.266 02:36:47 -- common/autotest_common.sh@955 -- # kill 2146109 00:25:23.266 02:36:47 -- common/autotest_common.sh@960 -- # wait 2146109 00:25:23.524 Received shutdown signal, test time was about 0.562206 seconds 00:25:23.524 00:25:23.524 Latency(us) 00:25:23.524 [2024-11-27T01:36:48.159Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme1n1 : 0.55 412.93 25.81 0.00 0.00 150381.49 16990.81 122722.23 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme2n1 : 0.56 409.62 25.60 0.00 0.00 148727.12 17087.91 121945.51 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme3n1 : 0.55 411.54 25.72 0.00 0.00 146779.77 15437.37 120392.06 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme4n1 : 0.56 410.49 25.66 0.00 0.00 145079.84 16019.91 121168.78 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme5n1 : 0.56 407.15 25.45 0.00 0.00 143560.04 19126.80 120392.06 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme6n1 : 0.56 406.13 25.38 0.00 0.00 141861.81 18835.53 121168.78 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme7n1 : 0.52 365.60 22.85 0.00 0.00 152778.34 26408.58 123498.95 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme8n1 : 0.52 363.53 22.72 0.00 0.00 151306.66 26214.40 125829.12 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme9n1 : 0.53 359.95 22.50 0.00 0.00 150369.48 26991.12 126605.84 00:25:23.524 [2024-11-27T01:36:48.159Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:23.524 Verification LBA range: start 0x0 length 0x400 00:25:23.524 Nvme10n1 : 0.53 360.08 22.50 0.00 0.00 148768.49 3228.25 128159.29 00:25:23.524 [2024-11-27T01:36:48.159Z] =================================================================================================================== 00:25:23.524 [2024-11-27T01:36:48.159Z] Total : 3907.02 244.19 0.00 0.00 147759.08 3228.25 128159.29 00:25:23.782 02:36:48 -- target/shutdown.sh@112 -- # sleep 1 00:25:24.716 02:36:49 -- target/shutdown.sh@113 -- # kill -0 2145791 00:25:24.716 02:36:49 -- target/shutdown.sh@115 -- # stoptarget 00:25:24.716 02:36:49 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:24.716 02:36:49 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:24.716 02:36:49 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:24.716 02:36:49 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:24.716 02:36:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:24.716 02:36:49 -- nvmf/common.sh@116 -- # sync 00:25:24.716 02:36:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:24.716 02:36:49 -- nvmf/common.sh@119 -- # set +e 00:25:24.716 02:36:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:24.716 02:36:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:24.716 rmmod nvme_tcp 00:25:24.716 rmmod nvme_fabrics 00:25:24.716 rmmod nvme_keyring 00:25:24.716 02:36:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:24.716 02:36:49 -- nvmf/common.sh@123 -- # set -e 00:25:24.716 02:36:49 -- nvmf/common.sh@124 -- # return 0 00:25:24.716 02:36:49 -- nvmf/common.sh@477 -- # '[' -n 2145791 ']' 00:25:24.716 02:36:49 -- nvmf/common.sh@478 -- # killprocess 2145791 00:25:24.716 02:36:49 -- common/autotest_common.sh@936 -- # '[' -z 2145791 ']' 00:25:24.716 02:36:49 -- common/autotest_common.sh@940 -- # kill -0 2145791 00:25:24.716 02:36:49 -- common/autotest_common.sh@941 -- # uname 00:25:24.716 02:36:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:24.716 02:36:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2145791 00:25:24.716 02:36:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:24.716 02:36:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:24.716 02:36:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2145791' 00:25:24.716 killing process with pid 2145791 00:25:24.716 02:36:49 -- common/autotest_common.sh@955 -- # kill 2145791 00:25:24.716 02:36:49 -- common/autotest_common.sh@960 -- # wait 2145791 00:25:25.281 02:36:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:25.281 02:36:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:25.281 02:36:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:25.281 02:36:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:25.281 02:36:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:25.281 02:36:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:25.281 02:36:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:25.281 02:36:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:27.813 02:36:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:27.813 00:25:27.813 real 0m8.041s 00:25:27.813 user 0m25.029s 00:25:27.813 sys 0m1.372s 00:25:27.813 02:36:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:27.813 02:36:51 -- common/autotest_common.sh@10 -- # set +x 00:25:27.813 ************************************ 00:25:27.813 END TEST nvmf_shutdown_tc2 00:25:27.813 ************************************ 00:25:27.813 02:36:51 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:27.813 02:36:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:27.813 02:36:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:27.813 02:36:51 -- common/autotest_common.sh@10 -- # set +x 00:25:27.813 ************************************ 00:25:27.813 START TEST nvmf_shutdown_tc3 00:25:27.813 ************************************ 00:25:27.813 02:36:51 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:27.813 02:36:51 -- target/shutdown.sh@120 -- # starttarget 00:25:27.813 02:36:51 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:27.813 02:36:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:27.813 02:36:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:27.813 02:36:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:27.813 02:36:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:27.813 02:36:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:27.813 02:36:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.813 02:36:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.813 02:36:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:27.813 02:36:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:27.813 02:36:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:27.813 02:36:51 -- common/autotest_common.sh@10 -- # set +x 00:25:27.813 02:36:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:27.813 02:36:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:27.813 02:36:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:27.813 02:36:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:27.813 02:36:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:27.813 02:36:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:27.813 02:36:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:27.813 02:36:51 -- nvmf/common.sh@294 -- # net_devs=() 00:25:27.813 02:36:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:27.813 02:36:51 -- nvmf/common.sh@295 -- # e810=() 00:25:27.813 02:36:51 -- nvmf/common.sh@295 -- # local -ga e810 00:25:27.813 02:36:51 -- nvmf/common.sh@296 -- # x722=() 00:25:27.813 02:36:51 -- nvmf/common.sh@296 -- # local -ga x722 00:25:27.813 02:36:51 -- nvmf/common.sh@297 -- # mlx=() 00:25:27.813 02:36:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:27.813 02:36:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:27.813 02:36:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:27.813 02:36:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:27.813 02:36:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:27.813 02:36:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.813 02:36:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:27.813 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:27.813 02:36:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.813 02:36:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:27.813 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:27.813 02:36:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:27.813 02:36:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.813 02:36:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.813 02:36:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.813 02:36:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.813 02:36:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:27.813 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:27.813 02:36:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.813 02:36:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.813 02:36:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.813 02:36:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.813 02:36:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.813 02:36:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:27.813 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:27.813 02:36:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.813 02:36:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:27.813 02:36:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:27.813 02:36:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:27.813 02:36:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:27.813 02:36:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:27.813 02:36:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:27.813 02:36:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:27.813 02:36:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:27.814 02:36:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:27.814 02:36:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:27.814 02:36:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:27.814 02:36:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:27.814 02:36:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:27.814 02:36:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:27.814 02:36:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:27.814 02:36:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:27.814 02:36:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:27.814 02:36:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:27.814 02:36:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:27.814 02:36:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:27.814 02:36:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:27.814 02:36:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:27.814 02:36:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:27.814 02:36:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:27.814 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:27.814 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:25:27.814 00:25:27.814 --- 10.0.0.2 ping statistics --- 00:25:27.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.814 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:25:27.814 02:36:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:27.814 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:27.814 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:25:27.814 00:25:27.814 --- 10.0.0.1 ping statistics --- 00:25:27.814 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.814 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:27.814 02:36:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:27.814 02:36:52 -- nvmf/common.sh@410 -- # return 0 00:25:27.814 02:36:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:27.814 02:36:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:27.814 02:36:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:27.814 02:36:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:27.814 02:36:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:27.814 02:36:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:27.814 02:36:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:27.814 02:36:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:27.814 02:36:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:27.814 02:36:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:27.814 02:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:27.814 02:36:52 -- nvmf/common.sh@469 -- # nvmfpid=2146911 00:25:27.814 02:36:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:27.814 02:36:52 -- nvmf/common.sh@470 -- # waitforlisten 2146911 00:25:27.814 02:36:52 -- common/autotest_common.sh@829 -- # '[' -z 2146911 ']' 00:25:27.814 02:36:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:27.814 02:36:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:27.814 02:36:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:27.814 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:27.814 02:36:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:27.814 02:36:52 -- common/autotest_common.sh@10 -- # set +x 00:25:27.814 [2024-11-27 02:36:52.086073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:27.814 [2024-11-27 02:36:52.086162] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:27.814 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.814 [2024-11-27 02:36:52.150279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:27.814 [2024-11-27 02:36:52.240948] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:27.814 [2024-11-27 02:36:52.241099] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:27.814 [2024-11-27 02:36:52.241119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:27.814 [2024-11-27 02:36:52.241131] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:27.814 [2024-11-27 02:36:52.241186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:27.814 [2024-11-27 02:36:52.241236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:27.814 [2024-11-27 02:36:52.241287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:27.814 [2024-11-27 02:36:52.241289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:28.747 02:36:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.747 02:36:53 -- common/autotest_common.sh@862 -- # return 0 00:25:28.747 02:36:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:28.747 02:36:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:28.747 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:28.747 02:36:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:28.747 02:36:53 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:28.747 02:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.747 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:28.747 [2024-11-27 02:36:53.133394] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:28.747 02:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.747 02:36:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:28.747 02:36:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:28.747 02:36:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:28.747 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:28.747 02:36:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:28.747 02:36:53 -- target/shutdown.sh@28 -- # cat 00:25:28.747 02:36:53 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:28.747 02:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.747 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:28.747 Malloc1 00:25:28.747 [2024-11-27 02:36:53.223062] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.747 Malloc2 00:25:28.747 Malloc3 00:25:28.747 Malloc4 00:25:29.006 Malloc5 00:25:29.006 Malloc6 00:25:29.006 Malloc7 00:25:29.006 Malloc8 00:25:29.006 Malloc9 00:25:29.264 Malloc10 00:25:29.264 02:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.264 02:36:53 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:29.264 02:36:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:29.264 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:29.265 02:36:53 -- target/shutdown.sh@124 -- # perfpid=2147225 00:25:29.265 02:36:53 -- target/shutdown.sh@125 -- # waitforlisten 2147225 /var/tmp/bdevperf.sock 00:25:29.265 02:36:53 -- common/autotest_common.sh@829 -- # '[' -z 2147225 ']' 00:25:29.265 02:36:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:29.265 02:36:53 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:29.265 02:36:53 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:29.265 02:36:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:29.265 02:36:53 -- nvmf/common.sh@520 -- # config=() 00:25:29.265 02:36:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:29.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:29.265 02:36:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:29.265 02:36:53 -- nvmf/common.sh@520 -- # local subsystem config 00:25:29.265 02:36:53 -- common/autotest_common.sh@10 -- # set +x 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:29.265 { 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme$subsystem", 00:25:29.265 "trtype": "$TEST_TRANSPORT", 00:25:29.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "$NVMF_PORT", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:29.265 "hdgst": ${hdgst:-false}, 00:25:29.265 "ddgst": ${ddgst:-false} 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 } 00:25:29.265 EOF 00:25:29.265 )") 00:25:29.265 02:36:53 -- nvmf/common.sh@542 -- # cat 00:25:29.265 02:36:53 -- nvmf/common.sh@544 -- # jq . 00:25:29.265 02:36:53 -- nvmf/common.sh@545 -- # IFS=, 00:25:29.265 02:36:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme1", 00:25:29.265 "trtype": "tcp", 00:25:29.265 "traddr": "10.0.0.2", 00:25:29.265 "adrfam": "ipv4", 00:25:29.265 "trsvcid": "4420", 00:25:29.265 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:29.265 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:29.265 "hdgst": false, 00:25:29.265 "ddgst": false 00:25:29.265 }, 00:25:29.265 "method": "bdev_nvme_attach_controller" 00:25:29.265 },{ 00:25:29.265 "params": { 00:25:29.265 "name": "Nvme2", 00:25:29.265 "trtype": "tcp", 00:25:29.265 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme3", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme4", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme5", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme6", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme7", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme8", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme9", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 },{ 00:25:29.266 "params": { 00:25:29.266 "name": "Nvme10", 00:25:29.266 "trtype": "tcp", 00:25:29.266 "traddr": "10.0.0.2", 00:25:29.266 "adrfam": "ipv4", 00:25:29.266 "trsvcid": "4420", 00:25:29.266 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:29.266 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:29.266 "hdgst": false, 00:25:29.266 "ddgst": false 00:25:29.266 }, 00:25:29.266 "method": "bdev_nvme_attach_controller" 00:25:29.266 }' 00:25:29.266 [2024-11-27 02:36:53.748159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:29.266 [2024-11-27 02:36:53.748249] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2147225 ] 00:25:29.266 EAL: No free 2048 kB hugepages reported on node 1 00:25:29.266 [2024-11-27 02:36:53.814254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:29.524 [2024-11-27 02:36:53.899492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:31.424 Running I/O for 10 seconds... 00:25:31.683 02:36:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:31.683 02:36:56 -- common/autotest_common.sh@862 -- # return 0 00:25:31.683 02:36:56 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:31.683 02:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.683 02:36:56 -- common/autotest_common.sh@10 -- # set +x 00:25:31.683 02:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.683 02:36:56 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:31.683 02:36:56 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:31.683 02:36:56 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:31.683 02:36:56 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:31.683 02:36:56 -- target/shutdown.sh@57 -- # local ret=1 00:25:31.683 02:36:56 -- target/shutdown.sh@58 -- # local i 00:25:31.683 02:36:56 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:31.683 02:36:56 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:31.683 02:36:56 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:31.683 02:36:56 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:31.683 02:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.683 02:36:56 -- common/autotest_common.sh@10 -- # set +x 00:25:31.683 02:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.683 02:36:56 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:31.683 02:36:56 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:31.683 02:36:56 -- target/shutdown.sh@64 -- # ret=0 00:25:31.683 02:36:56 -- target/shutdown.sh@65 -- # break 00:25:31.683 02:36:56 -- target/shutdown.sh@69 -- # return 0 00:25:31.683 02:36:56 -- target/shutdown.sh@134 -- # killprocess 2146911 00:25:31.683 02:36:56 -- common/autotest_common.sh@936 -- # '[' -z 2146911 ']' 00:25:31.683 02:36:56 -- common/autotest_common.sh@940 -- # kill -0 2146911 00:25:31.683 02:36:56 -- common/autotest_common.sh@941 -- # uname 00:25:31.683 02:36:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:31.683 02:36:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2146911 00:25:31.959 02:36:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:31.959 02:36:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:31.959 02:36:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2146911' 00:25:31.959 killing process with pid 2146911 00:25:31.959 02:36:56 -- common/autotest_common.sh@955 -- # kill 2146911 00:25:31.959 02:36:56 -- common/autotest_common.sh@960 -- # wait 2146911 00:25:31.959 [2024-11-27 02:36:56.354985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.959 [2024-11-27 02:36:56.355209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.355957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383840 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.960 [2024-11-27 02:36:56.357518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.357992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.358004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.358016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381300 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359698] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.961 [2024-11-27 02:36:56.359720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.961 [2024-11-27 02:36:56.359745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-27 02:36:56.359758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:31.961 the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with [2024-11-27 02:36:56.359773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:31.961 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.961 [2024-11-27 02:36:56.359787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359789] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.961 [2024-11-27 02:36:56.359800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.961 [2024-11-27 02:36:56.359812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.961 [2024-11-27 02:36:56.359838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.961 [2024-11-27 02:36:56.359851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.961 [2024-11-27 02:36:56.359855] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e84240 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359950] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-27 02:36:56.359955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:31.962 the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.359985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.359990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.359998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-27 02:36:56.360064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with [2024-11-27 02:36:56.360077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce7710 is same the state(5) to be set 00:25:31.962 with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with [2024-11-27 02:36:56.360156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:31.962 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360179] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360210] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-27 02:36:56.360240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:31.962 the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with [2024-11-27 02:36:56.360253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:31.962 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce9200 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with [2024-11-27 02:36:56.360313] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:25:31.962 id:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 [2024-11-27 02:36:56.360344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-27 02:36:56.360369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.962 the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.962 [2024-11-27 02:36:56.360386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.962 [2024-11-27 02:36:56.360397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.963 [2024-11-27 02:36:56.360401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.963 [2024-11-27 02:36:56.360416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.963 [2024-11-27 02:36:56.360422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.963 [2024-11-27 02:36:56.360431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23817b0 is same with the state(5) to be set 00:25:31.963 [2024-11-27 02:36:56.360444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbcfe0 is same with the state(5) to be set 00:25:31.963 [2024-11-27 02:36:56.360519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.360969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.360986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.963 [2024-11-27 02:36:56.361479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.963 [2024-11-27 02:36:56.361495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.361713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:1the state(5) to be set 00:25:31.964 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.361779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:36864 len:1the state(5) to be set 00:25:31.964 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.361827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36992 len:12the state(5) to be set 00:25:31.964 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.361943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.361982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.361990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.361994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.362007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:31.964 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.362020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.362026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.362032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.362041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.964 [2024-11-27 02:36:56.362045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.362058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.964 [2024-11-27 02:36:56.362061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.964 [2024-11-27 02:36:56.362088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:31.964 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38144 len:12the state(5) to be set 00:25:31.965 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.362252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38784 len:1the state(5) to be set 00:25:31.965 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.965 [2024-11-27 02:36:56.362320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.965 [2024-11-27 02:36:56.362333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.965 [2024-11-27 02:36:56.362339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:12the state(5) to be set 00:25:31.966 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.362422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.362460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with [2024-11-27 02:36:56.362511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39552 len:1the state(5) to be set 00:25:31.966 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2381c40 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c94ac0 is same with the state(5) to be set 00:25:31.966 [2024-11-27 02:36:56.362826] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c94ac0 was disconnected and freed. reset controller. 00:25:31.966 [2024-11-27 02:36:56.362889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.362970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.362985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.966 [2024-11-27 02:36:56.363249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.966 [2024-11-27 02:36:56.363264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32512 len:12[2024-11-27 02:36:56.363334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23820f0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.363367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23820f0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.363383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.363977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.363993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.364007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.364008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.364033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.364047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.364060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.364077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 [2024-11-27 02:36:56.364090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.967 [2024-11-27 02:36:56.364106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.967 [2024-11-27 02:36:56.364117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:1[2024-11-27 02:36:56.364119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.967 the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.364134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with [2024-11-27 02:36:56.364214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37248 len:1the state(5) to be set 00:25:31.968 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37632 len:12[2024-11-27 02:36:56.364325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.364341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with [2024-11-27 02:36:56.364408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:31.968 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.364473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.968 [2024-11-27 02:36:56.364625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.968 [2024-11-27 02:36:56.364632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.968 [2024-11-27 02:36:56.364638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:1[2024-11-27 02:36:56.364650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.364664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with [2024-11-27 02:36:56.364695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:31.969 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39680 len:1[2024-11-27 02:36:56.364892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 02:36:56.364913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23825a0 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.364930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.364977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.364993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.365007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.365022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.969 [2024-11-27 02:36:56.365036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.969 [2024-11-27 02:36:56.365134] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1e34e90 was disconnected and freed. reset controller. 00:25:31.969 [2024-11-27 02:36:56.366389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.969 [2024-11-27 02:36:56.366698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.366992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.367224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382a50 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.970 [2024-11-27 02:36:56.368641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.368998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2382ee0 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.369996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.971 [2024-11-27 02:36:56.370009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370095] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.370165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.374245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e84240 (9): Bad file descriptor 00:25:31.972 [2024-11-27 02:36:56.374311] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374378] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374405] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d08190 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.374478] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374514] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374580] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce85f0 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.374652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374732] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e84960 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.374834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce7710 (9): Bad file descriptor 00:25:31.972 [2024-11-27 02:36:56.374892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.374972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.374986] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.375000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.375013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e66980 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.375041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce9200 (9): Bad file descriptor 00:25:31.972 [2024-11-27 02:36:56.375068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbcfe0 (9): Bad file descriptor 00:25:31.972 [2024-11-27 02:36:56.375109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.375129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.375145] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.375159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.375174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.375188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.375202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.972 [2024-11-27 02:36:56.375216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.375230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e8ae80 is same with the state(5) to be set 00:25:31.972 [2024-11-27 02:36:56.377619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.972 [2024-11-27 02:36:56.377650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.377674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.972 [2024-11-27 02:36:56.377690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.972 [2024-11-27 02:36:56.377707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.972 [2024-11-27 02:36:56.377721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.377971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.377986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.973 [2024-11-27 02:36:56.378720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.973 [2024-11-27 02:36:56.378736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.378975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.378990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379781] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1cabd20 was disconnected and freed. reset controller. 00:25:31.974 [2024-11-27 02:36:56.379851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.974 [2024-11-27 02:36:56.379895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.974 [2024-11-27 02:36:56.379910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.379927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.379941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.379956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.379970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.379986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.380193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.380210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.392196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.392703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2383390 is same with the state(5) to be set 00:25:31.975 [2024-11-27 02:36:56.402001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.402070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.402090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.402106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.402123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.402138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.402156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.402170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.975 [2024-11-27 02:36:56.402186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.975 [2024-11-27 02:36:56.402201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.402982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.402999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.976 [2024-11-27 02:36:56.403190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.976 [2024-11-27 02:36:56.403205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.977 [2024-11-27 02:36:56.403711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.403726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cad300 is same with the state(5) to be set 00:25:31.977 [2024-11-27 02:36:56.403831] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1cad300 was disconnected and freed. reset controller. 00:25:31.977 [2024-11-27 02:36:56.404298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:31.977 [2024-11-27 02:36:56.404335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:31.977 [2024-11-27 02:36:56.404477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.977 [2024-11-27 02:36:56.404501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.404518] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.977 [2024-11-27 02:36:56.404544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.404561] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.977 [2024-11-27 02:36:56.404574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.404594] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.977 [2024-11-27 02:36:56.404610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.977 [2024-11-27 02:36:56.404623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d0ec00 is same with the state(5) to be set 00:25:31.977 [2024-11-27 02:36:56.404669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d08190 (9): Bad file descriptor 00:25:31.977 [2024-11-27 02:36:56.404702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce85f0 (9): Bad file descriptor 00:25:31.977 [2024-11-27 02:36:56.404727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e84960 (9): Bad file descriptor 00:25:31.977 [2024-11-27 02:36:56.404762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e66980 (9): Bad file descriptor 00:25:31.977 [2024-11-27 02:36:56.404791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e8ae80 (9): Bad file descriptor 00:25:31.977 [2024-11-27 02:36:56.407443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:31.977 [2024-11-27 02:36:56.407697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.977 [2024-11-27 02:36:56.407799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.978 [2024-11-27 02:36:56.407826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbcfe0 with addr=10.0.0.2, port=4420 00:25:31.978 [2024-11-27 02:36:56.407844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbcfe0 is same with the state(5) to be set 00:25:31.978 [2024-11-27 02:36:56.407941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.978 [2024-11-27 02:36:56.408037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.978 [2024-11-27 02:36:56.408063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce9200 with addr=10.0.0.2, port=4420 00:25:31.978 [2024-11-27 02:36:56.408080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce9200 is same with the state(5) to be set 00:25:31.978 [2024-11-27 02:36:56.408680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.408977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.408994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.978 [2024-11-27 02:36:56.409582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.978 [2024-11-27 02:36:56.409599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.409972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.409986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.979 [2024-11-27 02:36:56.410540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.979 [2024-11-27 02:36:56.410567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.410584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.410598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.410614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.410629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.410645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.410660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.410676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.410690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.410707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.410722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.980 [2024-11-27 02:36:56.413945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.980 [2024-11-27 02:36:56.413961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.413975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.413992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.981 [2024-11-27 02:36:56.414904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.981 [2024-11-27 02:36:56.414919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.414935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.414950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.414966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.414981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.414997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.415011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.415028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.415042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.415057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.415072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.415088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.415103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.417361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:31.982 [2024-11-27 02:36:56.417396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:31.982 [2024-11-27 02:36:56.417417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:31.982 [2024-11-27 02:36:56.417620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.982 [2024-11-27 02:36:56.417752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.982 [2024-11-27 02:36:56.417778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e66980 with addr=10.0.0.2, port=4420 00:25:31.982 [2024-11-27 02:36:56.417795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e66980 is same with the state(5) to be set 00:25:31.982 [2024-11-27 02:36:56.417826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbcfe0 (9): Bad file descriptor 00:25:31.982 [2024-11-27 02:36:56.417848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce9200 (9): Bad file descriptor 00:25:31.982 [2024-11-27 02:36:56.417903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d0ec00 (9): Bad file descriptor 00:25:31.982 [2024-11-27 02:36:56.417973] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.982 [2024-11-27 02:36:56.418002] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.982 [2024-11-27 02:36:56.418691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.418969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.418991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.419029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.419067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.419111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.419151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.982 [2024-11-27 02:36:56.419190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.982 [2024-11-27 02:36:56.419207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.419552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.419580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.420414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cae8e0 is same with the state(5) to be set 00:25:31.983 [2024-11-27 02:36:56.420497] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1cae8e0 was disconnected and freed. reset controller. 00:25:31.983 [2024-11-27 02:36:56.420518] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.983 [2024-11-27 02:36:56.420615] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:31.983 [2024-11-27 02:36:56.420699] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:31.983 [2024-11-27 02:36:56.420909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce7710 with addr=10.0.0.2, port=4420 00:25:31.983 [2024-11-27 02:36:56.421046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce7710 is same with the state(5) to be set 00:25:31.983 [2024-11-27 02:36:56.421143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d08190 with addr=10.0.0.2, port=4420 00:25:31.983 [2024-11-27 02:36:56.421270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d08190 is same with the state(5) to be set 00:25:31.983 [2024-11-27 02:36:56.421351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.983 [2024-11-27 02:36:56.421458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e84240 with addr=10.0.0.2, port=4420 00:25:31.983 [2024-11-27 02:36:56.421474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e84240 is same with the state(5) to be set 00:25:31.983 [2024-11-27 02:36:56.421494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e66980 (9): Bad file descriptor 00:25:31.983 [2024-11-27 02:36:56.421513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:31.983 [2024-11-27 02:36:56.421536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:31.983 [2024-11-27 02:36:56.421555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:31.983 [2024-11-27 02:36:56.421577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:31.983 [2024-11-27 02:36:56.421593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:31.983 [2024-11-27 02:36:56.421607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:31.983 [2024-11-27 02:36:56.421631] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.983 [2024-11-27 02:36:56.421997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.983 [2024-11-27 02:36:56.422348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.983 [2024-11-27 02:36:56.422365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.422970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.422985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.984 [2024-11-27 02:36:56.423340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.984 [2024-11-27 02:36:56.423355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.423973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.423987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.424004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.424018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.424033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cafec0 is same with the state(5) to be set 00:25:31.985 [2024-11-27 02:36:56.425253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.985 [2024-11-27 02:36:56.425548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.985 [2024-11-27 02:36:56.425571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.425979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.425993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.986 [2024-11-27 02:36:56.426563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.986 [2024-11-27 02:36:56.426579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.426977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.426991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.987 [2024-11-27 02:36:56.427262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.987 [2024-11-27 02:36:56.427281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cb14a0 is same with the state(5) to be set 00:25:31.987 [2024-11-27 02:36:56.428551] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:31.987 [2024-11-27 02:36:56.428866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.987 [2024-11-27 02:36:56.428889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.987 [2024-11-27 02:36:56.428906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:31.987 [2024-11-27 02:36:56.428927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:31.987 [2024-11-27 02:36:56.428946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:31.987 [2024-11-27 02:36:56.429013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce7710 (9): Bad file descriptor 00:25:31.987 [2024-11-27 02:36:56.429039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d08190 (9): Bad file descriptor 00:25:31.987 [2024-11-27 02:36:56.429059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e84240 (9): Bad file descriptor 00:25:31.987 [2024-11-27 02:36:56.429077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:31.987 [2024-11-27 02:36:56.429091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:31.987 [2024-11-27 02:36:56.429108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:31.987 [2024-11-27 02:36:56.429195] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.987 [2024-11-27 02:36:56.429223] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.987 [2024-11-27 02:36:56.429243] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.987 [2024-11-27 02:36:56.429632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.987 [2024-11-27 02:36:56.429789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.987 [2024-11-27 02:36:56.429877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.987 [2024-11-27 02:36:56.429903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce85f0 with addr=10.0.0.2, port=4420 00:25:31.987 [2024-11-27 02:36:56.429921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce85f0 is same with the state(5) to be set 00:25:31.988 [2024-11-27 02:36:56.430005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.988 [2024-11-27 02:36:56.430088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.988 [2024-11-27 02:36:56.430121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e8ae80 with addr=10.0.0.2, port=4420 00:25:31.988 [2024-11-27 02:36:56.430143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e8ae80 is same with the state(5) to be set 00:25:31.988 [2024-11-27 02:36:56.430224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.988 [2024-11-27 02:36:56.430308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.988 [2024-11-27 02:36:56.430334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e84960 with addr=10.0.0.2, port=4420 00:25:31.988 [2024-11-27 02:36:56.430352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e84960 is same with the state(5) to be set 00:25:31.988 [2024-11-27 02:36:56.430368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:31.988 [2024-11-27 02:36:56.430381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:31.988 [2024-11-27 02:36:56.430406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:31.988 [2024-11-27 02:36:56.430427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:31.988 [2024-11-27 02:36:56.430442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:31.988 [2024-11-27 02:36:56.430456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:31.988 [2024-11-27 02:36:56.430474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:31.988 [2024-11-27 02:36:56.430488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:31.988 [2024-11-27 02:36:56.430501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:31.988 [2024-11-27 02:36:56.431087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.988 [2024-11-27 02:36:56.431637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.988 [2024-11-27 02:36:56.431653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.431980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.431997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.989 [2024-11-27 02:36:56.432621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.989 [2024-11-27 02:36:56.432638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.432979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.432997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.433015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.433030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.433046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.433061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.433077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.433092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.433109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:31.990 [2024-11-27 02:36:56.433124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.990 [2024-11-27 02:36:56.433139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cb2a80 is same with the state(5) to be set 00:25:31.990 [2024-11-27 02:36:56.434930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:31.990 [2024-11-27 02:36:56.434961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:31.990 [2024-11-27 02:36:56.434980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.990 [2024-11-27 02:36:56.434995] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.990 [2024-11-27 02:36:56.435008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.990 task offset: 34816 on job bdev=Nvme1n1 fails 00:25:31.990 00:25:31.990 Latency(us) 00:25:31.990 [2024-11-27T01:36:56.625Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme1n1 ended in about 0.70 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme1n1 : 0.70 356.62 22.29 90.93 0.00 141965.23 16796.63 146800.64 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme2n1 ended in about 0.70 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme2n1 : 0.70 356.06 22.25 90.79 0.00 140667.61 37476.88 115731.72 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme3n1 ended in about 0.74 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme3n1 : 0.74 339.57 21.22 86.58 0.00 146091.11 80390.83 115731.72 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme4n1 ended in about 0.73 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme4n1 : 0.73 342.24 21.39 87.26 0.00 143331.89 57477.50 117285.17 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme5n1 ended in about 0.73 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme5n1 : 0.73 341.74 21.36 87.14 0.00 142047.84 32428.18 121168.78 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme6n1 ended in about 0.75 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme6n1 : 0.75 334.35 20.90 29.42 0.00 164666.79 6650.69 155344.59 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme7n1 ended in about 0.75 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme7n1 : 0.75 276.43 17.28 85.06 0.00 165085.76 99032.18 157674.76 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme8n1 ended in about 0.76 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme8n1 : 0.76 275.24 17.20 84.69 0.00 164097.00 100973.99 149130.81 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.990 [2024-11-27T01:36:56.625Z] Job: Nvme9n1 ended in about 0.76 seconds with error 00:25:31.990 Verification LBA range: start 0x0 length 0x400 00:25:31.990 Nvme9n1 : 0.76 273.13 17.07 84.04 0.00 163765.75 99420.54 142917.03 00:25:31.991 [2024-11-27T01:36:56.626Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:31.991 [2024-11-27T01:36:56.626Z] Job: Nvme10n1 ended in about 0.74 seconds with error 00:25:31.991 Verification LBA range: start 0x0 length 0x400 00:25:31.991 Nvme10n1 : 0.74 279.74 17.48 86.08 0.00 157860.38 99420.54 125829.12 00:25:31.991 [2024-11-27T01:36:56.626Z] =================================================================================================================== 00:25:31.991 [2024-11-27T01:36:56.626Z] Total : 3175.13 198.45 811.99 0.00 152215.35 6650.69 157674.76 00:25:31.991 [2024-11-27 02:36:56.461700] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:31.991 [2024-11-27 02:36:56.461798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:31.991 [2024-11-27 02:36:56.461912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce85f0 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.461954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e8ae80 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.461974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e84960 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.462398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.462577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.462605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce9200 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.462626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce9200 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.462715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.462808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.462835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbcfe0 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.462853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbcfe0 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.462948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.463033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.463060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d0ec00 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.463078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d0ec00 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.463095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.463110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.463128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:31.991 [2024-11-27 02:36:56.463158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.463175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.463189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:31.991 [2024-11-27 02:36:56.463206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.463221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.463235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:31.991 [2024-11-27 02:36:56.463290] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.991 [2024-11-27 02:36:56.463315] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.991 [2024-11-27 02:36:56.463335] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.991 [2024-11-27 02:36:56.463354] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:31.991 [2024-11-27 02:36:56.463684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:31.991 [2024-11-27 02:36:56.463740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.463760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.463773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.463810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce9200 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.463835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbcfe0 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.463855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d0ec00 (9): Bad file descriptor 00:25:31.991 [2024-11-27 02:36:56.463914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:31.991 [2024-11-27 02:36:56.463940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:31.991 [2024-11-27 02:36:56.463959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:31.991 [2024-11-27 02:36:56.464072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e66980 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.464207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e66980 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.464224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.464238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.464252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:31.991 [2024-11-27 02:36:56.464271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.464285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.464299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:31.991 [2024-11-27 02:36:56.464324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:31.991 [2024-11-27 02:36:56.464339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:31.991 [2024-11-27 02:36:56.464353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:31.991 [2024-11-27 02:36:56.464402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.464423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.464437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.991 [2024-11-27 02:36:56.464513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e84240 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.464658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e84240 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.464738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.464852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d08190 with addr=10.0.0.2, port=4420 00:25:31.991 [2024-11-27 02:36:56.464869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d08190 is same with the state(5) to be set 00:25:31.991 [2024-11-27 02:36:56.464939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.991 [2024-11-27 02:36:56.465027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:31.992 [2024-11-27 02:36:56.465052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ce7710 with addr=10.0.0.2, port=4420 00:25:31.992 [2024-11-27 02:36:56.465069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ce7710 is same with the state(5) to be set 00:25:31.992 [2024-11-27 02:36:56.465089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e66980 (9): Bad file descriptor 00:25:31.992 [2024-11-27 02:36:56.465138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e84240 (9): Bad file descriptor 00:25:31.992 [2024-11-27 02:36:56.465164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d08190 (9): Bad file descriptor 00:25:31.992 [2024-11-27 02:36:56.465183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ce7710 (9): Bad file descriptor 00:25:31.992 [2024-11-27 02:36:56.465199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:31.992 [2024-11-27 02:36:56.465213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:31.992 [2024-11-27 02:36:56.465228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:31.992 [2024-11-27 02:36:56.465266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.992 [2024-11-27 02:36:56.465286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:31.992 [2024-11-27 02:36:56.465300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:31.992 [2024-11-27 02:36:56.465314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:31.992 [2024-11-27 02:36:56.465331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:31.992 [2024-11-27 02:36:56.465347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:31.992 [2024-11-27 02:36:56.465367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:31.992 [2024-11-27 02:36:56.465384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:31.992 [2024-11-27 02:36:56.465399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:31.992 [2024-11-27 02:36:56.465413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:31.992 [2024-11-27 02:36:56.465457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.992 [2024-11-27 02:36:56.465476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:31.992 [2024-11-27 02:36:56.465490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:32.561 02:36:56 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:32.561 02:36:56 -- target/shutdown.sh@138 -- # sleep 1 00:25:33.558 02:36:57 -- target/shutdown.sh@141 -- # kill -9 2147225 00:25:33.558 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2147225) - No such process 00:25:33.558 02:36:57 -- target/shutdown.sh@141 -- # true 00:25:33.558 02:36:57 -- target/shutdown.sh@143 -- # stoptarget 00:25:33.558 02:36:57 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:33.558 02:36:57 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:33.558 02:36:57 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:33.558 02:36:57 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:33.558 02:36:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:33.558 02:36:57 -- nvmf/common.sh@116 -- # sync 00:25:33.558 02:36:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:33.558 02:36:57 -- nvmf/common.sh@119 -- # set +e 00:25:33.558 02:36:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:33.558 02:36:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:33.558 rmmod nvme_tcp 00:25:33.558 rmmod nvme_fabrics 00:25:33.558 rmmod nvme_keyring 00:25:33.558 02:36:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:33.558 02:36:57 -- nvmf/common.sh@123 -- # set -e 00:25:33.558 02:36:57 -- nvmf/common.sh@124 -- # return 0 00:25:33.558 02:36:57 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:33.558 02:36:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:33.558 02:36:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:33.558 02:36:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:33.558 02:36:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:33.558 02:36:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:33.558 02:36:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.558 02:36:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.558 02:36:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.460 02:37:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:35.460 00:25:35.460 real 0m8.162s 00:25:35.460 user 0m21.826s 00:25:35.460 sys 0m1.432s 00:25:35.460 02:37:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:35.460 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:35.460 ************************************ 00:25:35.460 END TEST nvmf_shutdown_tc3 00:25:35.460 ************************************ 00:25:35.460 02:37:00 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:35.460 00:25:35.460 real 0m29.500s 00:25:35.460 user 1m26.683s 00:25:35.460 sys 0m6.381s 00:25:35.460 02:37:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:35.460 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:35.460 ************************************ 00:25:35.460 END TEST nvmf_shutdown 00:25:35.460 ************************************ 00:25:35.460 02:37:00 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:35.460 02:37:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.460 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:35.718 02:37:00 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:35.718 02:37:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:35.718 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:35.718 02:37:00 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:35.718 02:37:00 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:35.718 02:37:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:35.718 02:37:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:35.718 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:35.718 ************************************ 00:25:35.718 START TEST nvmf_multicontroller 00:25:35.718 ************************************ 00:25:35.718 02:37:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:35.718 * Looking for test storage... 00:25:35.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:35.718 02:37:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:35.718 02:37:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:35.718 02:37:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:35.718 02:37:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:35.718 02:37:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:35.718 02:37:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:35.718 02:37:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:35.718 02:37:00 -- scripts/common.sh@335 -- # IFS=.-: 00:25:35.718 02:37:00 -- scripts/common.sh@335 -- # read -ra ver1 00:25:35.718 02:37:00 -- scripts/common.sh@336 -- # IFS=.-: 00:25:35.719 02:37:00 -- scripts/common.sh@336 -- # read -ra ver2 00:25:35.719 02:37:00 -- scripts/common.sh@337 -- # local 'op=<' 00:25:35.719 02:37:00 -- scripts/common.sh@339 -- # ver1_l=2 00:25:35.719 02:37:00 -- scripts/common.sh@340 -- # ver2_l=1 00:25:35.719 02:37:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:35.719 02:37:00 -- scripts/common.sh@343 -- # case "$op" in 00:25:35.719 02:37:00 -- scripts/common.sh@344 -- # : 1 00:25:35.719 02:37:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:35.719 02:37:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:35.719 02:37:00 -- scripts/common.sh@364 -- # decimal 1 00:25:35.719 02:37:00 -- scripts/common.sh@352 -- # local d=1 00:25:35.719 02:37:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:35.719 02:37:00 -- scripts/common.sh@354 -- # echo 1 00:25:35.719 02:37:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:35.719 02:37:00 -- scripts/common.sh@365 -- # decimal 2 00:25:35.719 02:37:00 -- scripts/common.sh@352 -- # local d=2 00:25:35.719 02:37:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:35.719 02:37:00 -- scripts/common.sh@354 -- # echo 2 00:25:35.719 02:37:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:35.719 02:37:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:35.719 02:37:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:35.719 02:37:00 -- scripts/common.sh@367 -- # return 0 00:25:35.719 02:37:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:35.719 02:37:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:35.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.719 --rc genhtml_branch_coverage=1 00:25:35.719 --rc genhtml_function_coverage=1 00:25:35.719 --rc genhtml_legend=1 00:25:35.719 --rc geninfo_all_blocks=1 00:25:35.719 --rc geninfo_unexecuted_blocks=1 00:25:35.719 00:25:35.719 ' 00:25:35.719 02:37:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:35.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.719 --rc genhtml_branch_coverage=1 00:25:35.719 --rc genhtml_function_coverage=1 00:25:35.719 --rc genhtml_legend=1 00:25:35.719 --rc geninfo_all_blocks=1 00:25:35.719 --rc geninfo_unexecuted_blocks=1 00:25:35.719 00:25:35.719 ' 00:25:35.719 02:37:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:35.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.719 --rc genhtml_branch_coverage=1 00:25:35.719 --rc genhtml_function_coverage=1 00:25:35.719 --rc genhtml_legend=1 00:25:35.719 --rc geninfo_all_blocks=1 00:25:35.719 --rc geninfo_unexecuted_blocks=1 00:25:35.719 00:25:35.719 ' 00:25:35.719 02:37:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:35.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:35.719 --rc genhtml_branch_coverage=1 00:25:35.719 --rc genhtml_function_coverage=1 00:25:35.719 --rc genhtml_legend=1 00:25:35.719 --rc geninfo_all_blocks=1 00:25:35.719 --rc geninfo_unexecuted_blocks=1 00:25:35.719 00:25:35.719 ' 00:25:35.719 02:37:00 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:35.719 02:37:00 -- nvmf/common.sh@7 -- # uname -s 00:25:35.719 02:37:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:35.719 02:37:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:35.719 02:37:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:35.719 02:37:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:35.719 02:37:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:35.719 02:37:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:35.719 02:37:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:35.719 02:37:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:35.719 02:37:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:35.719 02:37:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:35.719 02:37:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.719 02:37:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.719 02:37:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:35.719 02:37:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:35.719 02:37:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:35.719 02:37:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:35.719 02:37:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:35.719 02:37:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:35.719 02:37:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:35.719 02:37:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.719 02:37:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.719 02:37:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.719 02:37:00 -- paths/export.sh@5 -- # export PATH 00:25:35.719 02:37:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.719 02:37:00 -- nvmf/common.sh@46 -- # : 0 00:25:35.719 02:37:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:35.719 02:37:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:35.719 02:37:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:35.719 02:37:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:35.719 02:37:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:35.719 02:37:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:35.719 02:37:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:35.719 02:37:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:35.719 02:37:00 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:35.719 02:37:00 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:35.719 02:37:00 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:35.719 02:37:00 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:35.719 02:37:00 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:35.719 02:37:00 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:35.719 02:37:00 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:35.719 02:37:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:35.719 02:37:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:35.719 02:37:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:35.719 02:37:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:35.719 02:37:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:35.719 02:37:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.719 02:37:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.719 02:37:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.719 02:37:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:35.719 02:37:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:35.719 02:37:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:35.719 02:37:00 -- common/autotest_common.sh@10 -- # set +x 00:25:37.622 02:37:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:37.622 02:37:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:37.622 02:37:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:37.622 02:37:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:37.622 02:37:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:37.622 02:37:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:37.622 02:37:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:37.622 02:37:02 -- nvmf/common.sh@294 -- # net_devs=() 00:25:37.622 02:37:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:37.622 02:37:02 -- nvmf/common.sh@295 -- # e810=() 00:25:37.622 02:37:02 -- nvmf/common.sh@295 -- # local -ga e810 00:25:37.622 02:37:02 -- nvmf/common.sh@296 -- # x722=() 00:25:37.622 02:37:02 -- nvmf/common.sh@296 -- # local -ga x722 00:25:37.622 02:37:02 -- nvmf/common.sh@297 -- # mlx=() 00:25:37.622 02:37:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:37.622 02:37:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:37.622 02:37:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:37.623 02:37:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:37.623 02:37:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:37.623 02:37:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:37.623 02:37:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:37.623 02:37:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:37.623 02:37:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:37.623 02:37:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.623 02:37:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:37.623 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:37.623 02:37:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.623 02:37:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:37.623 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:37.623 02:37:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.623 02:37:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:37.623 02:37:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:37.881 02:37:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:37.881 02:37:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.882 02:37:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.882 02:37:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.882 02:37:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.882 02:37:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:37.882 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:37.882 02:37:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.882 02:37:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.882 02:37:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.882 02:37:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.882 02:37:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.882 02:37:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:37.882 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:37.882 02:37:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.882 02:37:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:37.882 02:37:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:37.882 02:37:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:37.882 02:37:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:37.882 02:37:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:37.882 02:37:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:37.882 02:37:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:37.882 02:37:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:37.882 02:37:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:37.882 02:37:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:37.882 02:37:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:37.882 02:37:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:37.882 02:37:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:37.882 02:37:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:37.882 02:37:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:37.882 02:37:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:37.882 02:37:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:37.882 02:37:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:37.882 02:37:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:37.882 02:37:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:37.882 02:37:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:37.882 02:37:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:37.882 02:37:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:37.882 02:37:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:37.882 02:37:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:37.882 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:37.882 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:25:37.882 00:25:37.882 --- 10.0.0.2 ping statistics --- 00:25:37.882 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.882 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:25:37.882 02:37:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:37.882 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:37.882 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:25:37.882 00:25:37.882 --- 10.0.0.1 ping statistics --- 00:25:37.882 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.882 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:25:37.882 02:37:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:37.882 02:37:02 -- nvmf/common.sh@410 -- # return 0 00:25:37.882 02:37:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:37.882 02:37:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:37.882 02:37:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:37.882 02:37:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:37.882 02:37:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:37.882 02:37:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:37.882 02:37:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:37.882 02:37:02 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:37.882 02:37:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:37.882 02:37:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:37.882 02:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:37.882 02:37:02 -- nvmf/common.sh@469 -- # nvmfpid=2149709 00:25:37.882 02:37:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:37.882 02:37:02 -- nvmf/common.sh@470 -- # waitforlisten 2149709 00:25:37.882 02:37:02 -- common/autotest_common.sh@829 -- # '[' -z 2149709 ']' 00:25:37.882 02:37:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:37.882 02:37:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:37.882 02:37:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:37.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:37.882 02:37:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:37.882 02:37:02 -- common/autotest_common.sh@10 -- # set +x 00:25:37.882 [2024-11-27 02:37:02.480342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:37.882 [2024-11-27 02:37:02.480416] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:37.882 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.140 [2024-11-27 02:37:02.545915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:38.140 [2024-11-27 02:37:02.636163] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:38.140 [2024-11-27 02:37:02.636320] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:38.140 [2024-11-27 02:37:02.636339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:38.140 [2024-11-27 02:37:02.636352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:38.140 [2024-11-27 02:37:02.636420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:38.140 [2024-11-27 02:37:02.636621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:38.140 [2024-11-27 02:37:02.636626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:39.073 02:37:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.073 02:37:03 -- common/autotest_common.sh@862 -- # return 0 00:25:39.073 02:37:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:39.073 02:37:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:39.073 02:37:03 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 [2024-11-27 02:37:03.470448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 Malloc0 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 [2024-11-27 02:37:03.532482] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 [2024-11-27 02:37:03.540378] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 Malloc1 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:39.073 02:37:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:39.073 02:37:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:39.073 02:37:03 -- host/multicontroller.sh@44 -- # bdevperf_pid=2149887 00:25:39.073 02:37:03 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:39.073 02:37:03 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:39.073 02:37:03 -- host/multicontroller.sh@47 -- # waitforlisten 2149887 /var/tmp/bdevperf.sock 00:25:39.073 02:37:03 -- common/autotest_common.sh@829 -- # '[' -z 2149887 ']' 00:25:39.073 02:37:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:39.073 02:37:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:39.073 02:37:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:39.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:39.073 02:37:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:39.073 02:37:03 -- common/autotest_common.sh@10 -- # set +x 00:25:40.006 02:37:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:40.006 02:37:04 -- common/autotest_common.sh@862 -- # return 0 00:25:40.006 02:37:04 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:40.006 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.006 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.264 NVMe0n1 00:25:40.264 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.264 02:37:04 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:40.264 02:37:04 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:40.264 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.264 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.264 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.264 1 00:25:40.264 02:37:04 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:40.264 02:37:04 -- common/autotest_common.sh@650 -- # local es=0 00:25:40.264 02:37:04 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:40.264 02:37:04 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.264 02:37:04 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:40.264 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.264 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.264 request: 00:25:40.264 { 00:25:40.264 "name": "NVMe0", 00:25:40.264 "trtype": "tcp", 00:25:40.264 "traddr": "10.0.0.2", 00:25:40.264 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:40.264 "hostaddr": "10.0.0.2", 00:25:40.264 "hostsvcid": "60000", 00:25:40.264 "adrfam": "ipv4", 00:25:40.264 "trsvcid": "4420", 00:25:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:40.264 "method": "bdev_nvme_attach_controller", 00:25:40.264 "req_id": 1 00:25:40.264 } 00:25:40.264 Got JSON-RPC error response 00:25:40.264 response: 00:25:40.264 { 00:25:40.264 "code": -114, 00:25:40.264 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:40.264 } 00:25:40.264 02:37:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:40.264 02:37:04 -- common/autotest_common.sh@653 -- # es=1 00:25:40.264 02:37:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:40.264 02:37:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:40.264 02:37:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:40.264 02:37:04 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:40.264 02:37:04 -- common/autotest_common.sh@650 -- # local es=0 00:25:40.264 02:37:04 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:40.264 02:37:04 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:40.264 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.264 02:37:04 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:40.264 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.264 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.264 request: 00:25:40.264 { 00:25:40.264 "name": "NVMe0", 00:25:40.264 "trtype": "tcp", 00:25:40.264 "traddr": "10.0.0.2", 00:25:40.264 "hostaddr": "10.0.0.2", 00:25:40.264 "hostsvcid": "60000", 00:25:40.264 "adrfam": "ipv4", 00:25:40.264 "trsvcid": "4420", 00:25:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:40.264 "method": "bdev_nvme_attach_controller", 00:25:40.264 "req_id": 1 00:25:40.264 } 00:25:40.264 Got JSON-RPC error response 00:25:40.264 response: 00:25:40.264 { 00:25:40.264 "code": -114, 00:25:40.264 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:40.264 } 00:25:40.264 02:37:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:40.264 02:37:04 -- common/autotest_common.sh@653 -- # es=1 00:25:40.264 02:37:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:40.264 02:37:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:40.264 02:37:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:40.264 02:37:04 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:40.264 02:37:04 -- common/autotest_common.sh@650 -- # local es=0 00:25:40.265 02:37:04 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.265 02:37:04 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.265 request: 00:25:40.265 { 00:25:40.265 "name": "NVMe0", 00:25:40.265 "trtype": "tcp", 00:25:40.265 "traddr": "10.0.0.2", 00:25:40.265 "hostaddr": "10.0.0.2", 00:25:40.265 "hostsvcid": "60000", 00:25:40.265 "adrfam": "ipv4", 00:25:40.265 "trsvcid": "4420", 00:25:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:40.265 "multipath": "disable", 00:25:40.265 "method": "bdev_nvme_attach_controller", 00:25:40.265 "req_id": 1 00:25:40.265 } 00:25:40.265 Got JSON-RPC error response 00:25:40.265 response: 00:25:40.265 { 00:25:40.265 "code": -114, 00:25:40.265 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:40.265 } 00:25:40.265 02:37:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:40.265 02:37:04 -- common/autotest_common.sh@653 -- # es=1 00:25:40.265 02:37:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:40.265 02:37:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:40.265 02:37:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:40.265 02:37:04 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:40.265 02:37:04 -- common/autotest_common.sh@650 -- # local es=0 00:25:40.265 02:37:04 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:40.265 02:37:04 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:40.265 02:37:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:40.265 02:37:04 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:40.265 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.265 request: 00:25:40.265 { 00:25:40.265 "name": "NVMe0", 00:25:40.265 "trtype": "tcp", 00:25:40.265 "traddr": "10.0.0.2", 00:25:40.265 "hostaddr": "10.0.0.2", 00:25:40.265 "hostsvcid": "60000", 00:25:40.265 "adrfam": "ipv4", 00:25:40.265 "trsvcid": "4420", 00:25:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:40.265 "multipath": "failover", 00:25:40.265 "method": "bdev_nvme_attach_controller", 00:25:40.265 "req_id": 1 00:25:40.265 } 00:25:40.265 Got JSON-RPC error response 00:25:40.265 response: 00:25:40.265 { 00:25:40.265 "code": -114, 00:25:40.265 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:40.265 } 00:25:40.265 02:37:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:40.265 02:37:04 -- common/autotest_common.sh@653 -- # es=1 00:25:40.265 02:37:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:40.265 02:37:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:40.265 02:37:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:40.265 02:37:04 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:40.265 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.265 00:25:40.265 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.265 02:37:04 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:40.265 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.265 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.265 02:37:04 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:40.265 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.265 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.523 00:25:40.523 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.523 02:37:04 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:40.523 02:37:04 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:40.523 02:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:40.523 02:37:04 -- common/autotest_common.sh@10 -- # set +x 00:25:40.523 02:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:40.523 02:37:04 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:40.523 02:37:04 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:41.457 0 00:25:41.457 02:37:06 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:41.457 02:37:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.457 02:37:06 -- common/autotest_common.sh@10 -- # set +x 00:25:41.715 02:37:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.715 02:37:06 -- host/multicontroller.sh@100 -- # killprocess 2149887 00:25:41.715 02:37:06 -- common/autotest_common.sh@936 -- # '[' -z 2149887 ']' 00:25:41.715 02:37:06 -- common/autotest_common.sh@940 -- # kill -0 2149887 00:25:41.715 02:37:06 -- common/autotest_common.sh@941 -- # uname 00:25:41.715 02:37:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:41.715 02:37:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2149887 00:25:41.715 02:37:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:41.715 02:37:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:41.715 02:37:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2149887' 00:25:41.715 killing process with pid 2149887 00:25:41.715 02:37:06 -- common/autotest_common.sh@955 -- # kill 2149887 00:25:41.715 02:37:06 -- common/autotest_common.sh@960 -- # wait 2149887 00:25:41.973 02:37:06 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:41.973 02:37:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.973 02:37:06 -- common/autotest_common.sh@10 -- # set +x 00:25:41.973 02:37:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.973 02:37:06 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:41.973 02:37:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.973 02:37:06 -- common/autotest_common.sh@10 -- # set +x 00:25:41.973 02:37:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.973 02:37:06 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:41.973 02:37:06 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:41.973 02:37:06 -- common/autotest_common.sh@1607 -- # read -r file 00:25:41.973 02:37:06 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:41.973 02:37:06 -- common/autotest_common.sh@1606 -- # sort -u 00:25:41.973 02:37:06 -- common/autotest_common.sh@1608 -- # cat 00:25:41.973 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:41.973 [2024-11-27 02:37:03.641087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:41.973 [2024-11-27 02:37:03.641171] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2149887 ] 00:25:41.973 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.973 [2024-11-27 02:37:03.701716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:41.973 [2024-11-27 02:37:03.786986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:41.973 [2024-11-27 02:37:04.941368] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name f06d8f19-ffd6-46ea-bc20-d4694a4b0e5b already exists 00:25:41.973 [2024-11-27 02:37:04.941407] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:f06d8f19-ffd6-46ea-bc20-d4694a4b0e5b alias for bdev NVMe1n1 00:25:41.973 [2024-11-27 02:37:04.941448] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:41.973 Running I/O for 1 seconds... 00:25:41.973 00:25:41.973 Latency(us) 00:25:41.973 [2024-11-27T01:37:06.608Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:41.973 [2024-11-27T01:37:06.608Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:41.973 NVMe0n1 : 1.00 19708.19 76.99 0.00 0.00 6477.77 3495.25 14466.47 00:25:41.973 [2024-11-27T01:37:06.608Z] =================================================================================================================== 00:25:41.973 [2024-11-27T01:37:06.608Z] Total : 19708.19 76.99 0.00 0.00 6477.77 3495.25 14466.47 00:25:41.973 Received shutdown signal, test time was about 1.000000 seconds 00:25:41.973 00:25:41.973 Latency(us) 00:25:41.973 [2024-11-27T01:37:06.608Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:41.973 [2024-11-27T01:37:06.608Z] =================================================================================================================== 00:25:41.973 [2024-11-27T01:37:06.608Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:41.973 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:41.973 02:37:06 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:41.973 02:37:06 -- common/autotest_common.sh@1607 -- # read -r file 00:25:41.973 02:37:06 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:41.973 02:37:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:41.973 02:37:06 -- nvmf/common.sh@116 -- # sync 00:25:41.973 02:37:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:41.973 02:37:06 -- nvmf/common.sh@119 -- # set +e 00:25:41.973 02:37:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:41.973 02:37:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:41.973 rmmod nvme_tcp 00:25:41.973 rmmod nvme_fabrics 00:25:41.973 rmmod nvme_keyring 00:25:41.973 02:37:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:41.973 02:37:06 -- nvmf/common.sh@123 -- # set -e 00:25:41.973 02:37:06 -- nvmf/common.sh@124 -- # return 0 00:25:41.973 02:37:06 -- nvmf/common.sh@477 -- # '[' -n 2149709 ']' 00:25:41.973 02:37:06 -- nvmf/common.sh@478 -- # killprocess 2149709 00:25:41.973 02:37:06 -- common/autotest_common.sh@936 -- # '[' -z 2149709 ']' 00:25:41.973 02:37:06 -- common/autotest_common.sh@940 -- # kill -0 2149709 00:25:41.973 02:37:06 -- common/autotest_common.sh@941 -- # uname 00:25:41.973 02:37:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:41.973 02:37:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2149709 00:25:41.973 02:37:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:41.973 02:37:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:41.973 02:37:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2149709' 00:25:41.973 killing process with pid 2149709 00:25:41.973 02:37:06 -- common/autotest_common.sh@955 -- # kill 2149709 00:25:41.973 02:37:06 -- common/autotest_common.sh@960 -- # wait 2149709 00:25:42.231 02:37:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:42.231 02:37:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:42.231 02:37:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:42.231 02:37:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:42.231 02:37:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:42.231 02:37:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:42.231 02:37:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:42.231 02:37:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:44.137 02:37:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:44.137 00:25:44.137 real 0m8.652s 00:25:44.137 user 0m16.134s 00:25:44.137 sys 0m2.395s 00:25:44.137 02:37:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:44.137 02:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:44.137 ************************************ 00:25:44.137 END TEST nvmf_multicontroller 00:25:44.137 ************************************ 00:25:44.396 02:37:08 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:44.396 02:37:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:44.396 02:37:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:44.396 02:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:44.396 ************************************ 00:25:44.396 START TEST nvmf_aer 00:25:44.396 ************************************ 00:25:44.396 02:37:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:44.396 * Looking for test storage... 00:25:44.396 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:44.396 02:37:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:44.396 02:37:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:44.396 02:37:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:44.396 02:37:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:44.396 02:37:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:44.396 02:37:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:44.396 02:37:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:44.396 02:37:08 -- scripts/common.sh@335 -- # IFS=.-: 00:25:44.396 02:37:08 -- scripts/common.sh@335 -- # read -ra ver1 00:25:44.396 02:37:08 -- scripts/common.sh@336 -- # IFS=.-: 00:25:44.396 02:37:08 -- scripts/common.sh@336 -- # read -ra ver2 00:25:44.396 02:37:08 -- scripts/common.sh@337 -- # local 'op=<' 00:25:44.396 02:37:08 -- scripts/common.sh@339 -- # ver1_l=2 00:25:44.396 02:37:08 -- scripts/common.sh@340 -- # ver2_l=1 00:25:44.396 02:37:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:44.396 02:37:08 -- scripts/common.sh@343 -- # case "$op" in 00:25:44.396 02:37:08 -- scripts/common.sh@344 -- # : 1 00:25:44.396 02:37:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:44.396 02:37:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:44.396 02:37:08 -- scripts/common.sh@364 -- # decimal 1 00:25:44.396 02:37:08 -- scripts/common.sh@352 -- # local d=1 00:25:44.396 02:37:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:44.396 02:37:08 -- scripts/common.sh@354 -- # echo 1 00:25:44.396 02:37:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:44.396 02:37:08 -- scripts/common.sh@365 -- # decimal 2 00:25:44.396 02:37:08 -- scripts/common.sh@352 -- # local d=2 00:25:44.396 02:37:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:44.396 02:37:08 -- scripts/common.sh@354 -- # echo 2 00:25:44.396 02:37:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:44.396 02:37:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:44.396 02:37:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:44.396 02:37:08 -- scripts/common.sh@367 -- # return 0 00:25:44.397 02:37:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:44.397 02:37:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:44.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:44.397 --rc genhtml_branch_coverage=1 00:25:44.397 --rc genhtml_function_coverage=1 00:25:44.397 --rc genhtml_legend=1 00:25:44.397 --rc geninfo_all_blocks=1 00:25:44.397 --rc geninfo_unexecuted_blocks=1 00:25:44.397 00:25:44.397 ' 00:25:44.397 02:37:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:44.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:44.397 --rc genhtml_branch_coverage=1 00:25:44.397 --rc genhtml_function_coverage=1 00:25:44.397 --rc genhtml_legend=1 00:25:44.397 --rc geninfo_all_blocks=1 00:25:44.397 --rc geninfo_unexecuted_blocks=1 00:25:44.397 00:25:44.397 ' 00:25:44.397 02:37:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:44.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:44.397 --rc genhtml_branch_coverage=1 00:25:44.397 --rc genhtml_function_coverage=1 00:25:44.397 --rc genhtml_legend=1 00:25:44.397 --rc geninfo_all_blocks=1 00:25:44.397 --rc geninfo_unexecuted_blocks=1 00:25:44.397 00:25:44.397 ' 00:25:44.397 02:37:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:44.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:44.397 --rc genhtml_branch_coverage=1 00:25:44.397 --rc genhtml_function_coverage=1 00:25:44.397 --rc genhtml_legend=1 00:25:44.397 --rc geninfo_all_blocks=1 00:25:44.397 --rc geninfo_unexecuted_blocks=1 00:25:44.397 00:25:44.397 ' 00:25:44.397 02:37:08 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:44.397 02:37:08 -- nvmf/common.sh@7 -- # uname -s 00:25:44.397 02:37:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:44.397 02:37:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:44.397 02:37:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:44.397 02:37:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:44.397 02:37:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:44.397 02:37:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:44.397 02:37:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:44.397 02:37:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:44.397 02:37:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:44.397 02:37:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:44.397 02:37:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:44.397 02:37:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:44.397 02:37:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:44.397 02:37:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:44.397 02:37:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:44.397 02:37:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:44.397 02:37:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:44.397 02:37:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:44.397 02:37:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:44.397 02:37:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:44.397 02:37:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:44.397 02:37:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:44.397 02:37:08 -- paths/export.sh@5 -- # export PATH 00:25:44.397 02:37:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:44.397 02:37:08 -- nvmf/common.sh@46 -- # : 0 00:25:44.397 02:37:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:44.397 02:37:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:44.397 02:37:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:44.397 02:37:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:44.397 02:37:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:44.397 02:37:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:44.397 02:37:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:44.397 02:37:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:44.397 02:37:08 -- host/aer.sh@11 -- # nvmftestinit 00:25:44.397 02:37:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:44.397 02:37:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:44.397 02:37:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:44.397 02:37:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:44.397 02:37:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:44.397 02:37:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:44.397 02:37:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:44.397 02:37:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:44.397 02:37:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:44.397 02:37:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:44.397 02:37:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:44.397 02:37:08 -- common/autotest_common.sh@10 -- # set +x 00:25:46.318 02:37:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:46.318 02:37:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:46.318 02:37:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:46.318 02:37:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:46.318 02:37:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:46.318 02:37:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:46.318 02:37:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:46.318 02:37:10 -- nvmf/common.sh@294 -- # net_devs=() 00:25:46.318 02:37:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:46.318 02:37:10 -- nvmf/common.sh@295 -- # e810=() 00:25:46.318 02:37:10 -- nvmf/common.sh@295 -- # local -ga e810 00:25:46.318 02:37:10 -- nvmf/common.sh@296 -- # x722=() 00:25:46.318 02:37:10 -- nvmf/common.sh@296 -- # local -ga x722 00:25:46.318 02:37:10 -- nvmf/common.sh@297 -- # mlx=() 00:25:46.318 02:37:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:46.318 02:37:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:46.318 02:37:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:46.318 02:37:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:46.318 02:37:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.318 02:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:46.318 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:46.318 02:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:46.318 02:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:46.318 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:46.318 02:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.318 02:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.318 02:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.318 02:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:46.318 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:46.318 02:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.318 02:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:46.318 02:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:46.318 02:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:46.318 02:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:46.318 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:46.318 02:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:46.318 02:37:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:46.318 02:37:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:46.318 02:37:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:46.318 02:37:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:46.318 02:37:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:46.318 02:37:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:46.318 02:37:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:46.318 02:37:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:46.318 02:37:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:46.318 02:37:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:46.318 02:37:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:46.318 02:37:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:46.318 02:37:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:46.318 02:37:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:46.318 02:37:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:46.318 02:37:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:46.318 02:37:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:46.318 02:37:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:46.576 02:37:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:46.576 02:37:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:46.576 02:37:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:46.576 02:37:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:46.576 02:37:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:46.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:46.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:25:46.576 00:25:46.576 --- 10.0.0.2 ping statistics --- 00:25:46.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.576 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:25:46.576 02:37:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:46.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:46.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:25:46.576 00:25:46.576 --- 10.0.0.1 ping statistics --- 00:25:46.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:46.576 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:25:46.576 02:37:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:46.576 02:37:11 -- nvmf/common.sh@410 -- # return 0 00:25:46.576 02:37:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:46.576 02:37:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:46.576 02:37:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:46.576 02:37:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:46.576 02:37:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:46.576 02:37:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:46.576 02:37:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:46.576 02:37:11 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:46.576 02:37:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:46.576 02:37:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:46.576 02:37:11 -- common/autotest_common.sh@10 -- # set +x 00:25:46.576 02:37:11 -- nvmf/common.sh@469 -- # nvmfpid=2152182 00:25:46.576 02:37:11 -- nvmf/common.sh@470 -- # waitforlisten 2152182 00:25:46.576 02:37:11 -- common/autotest_common.sh@829 -- # '[' -z 2152182 ']' 00:25:46.576 02:37:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:46.576 02:37:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.576 02:37:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:46.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:46.576 02:37:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.576 02:37:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:46.576 02:37:11 -- common/autotest_common.sh@10 -- # set +x 00:25:46.576 [2024-11-27 02:37:11.084173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:46.576 [2024-11-27 02:37:11.084283] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:46.576 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.576 [2024-11-27 02:37:11.152664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:46.854 [2024-11-27 02:37:11.242290] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:46.854 [2024-11-27 02:37:11.242450] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:46.854 [2024-11-27 02:37:11.242470] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:46.854 [2024-11-27 02:37:11.242485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:46.854 [2024-11-27 02:37:11.242626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:46.854 [2024-11-27 02:37:11.242666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:46.854 [2024-11-27 02:37:11.242756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:46.854 [2024-11-27 02:37:11.242759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.418 02:37:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.418 02:37:12 -- common/autotest_common.sh@862 -- # return 0 00:25:47.418 02:37:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:47.418 02:37:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:47.418 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.418 02:37:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:47.418 02:37:12 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:47.418 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.418 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 [2024-11-27 02:37:12.053168] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:47.677 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.677 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 Malloc0 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:47.677 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.677 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:47.677 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.677 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:47.677 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.677 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 [2024-11-27 02:37:12.104587] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:47.677 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.677 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.677 [2024-11-27 02:37:12.112293] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:47.677 [ 00:25:47.677 { 00:25:47.677 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:47.677 "subtype": "Discovery", 00:25:47.677 "listen_addresses": [], 00:25:47.677 "allow_any_host": true, 00:25:47.677 "hosts": [] 00:25:47.677 }, 00:25:47.677 { 00:25:47.677 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:47.677 "subtype": "NVMe", 00:25:47.677 "listen_addresses": [ 00:25:47.677 { 00:25:47.677 "transport": "TCP", 00:25:47.677 "trtype": "TCP", 00:25:47.677 "adrfam": "IPv4", 00:25:47.677 "traddr": "10.0.0.2", 00:25:47.677 "trsvcid": "4420" 00:25:47.677 } 00:25:47.677 ], 00:25:47.677 "allow_any_host": true, 00:25:47.677 "hosts": [], 00:25:47.677 "serial_number": "SPDK00000000000001", 00:25:47.677 "model_number": "SPDK bdev Controller", 00:25:47.677 "max_namespaces": 2, 00:25:47.677 "min_cntlid": 1, 00:25:47.677 "max_cntlid": 65519, 00:25:47.677 "namespaces": [ 00:25:47.677 { 00:25:47.677 "nsid": 1, 00:25:47.677 "bdev_name": "Malloc0", 00:25:47.677 "name": "Malloc0", 00:25:47.677 "nguid": "A2F7F6E8BE5A465199D54035A80ECA3E", 00:25:47.677 "uuid": "a2f7f6e8-be5a-4651-99d5-4035a80eca3e" 00:25:47.677 } 00:25:47.677 ] 00:25:47.677 } 00:25:47.677 ] 00:25:47.677 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.677 02:37:12 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:47.677 02:37:12 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:47.677 02:37:12 -- host/aer.sh@33 -- # aerpid=2152341 00:25:47.677 02:37:12 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:47.677 02:37:12 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:47.677 02:37:12 -- common/autotest_common.sh@1254 -- # local i=0 00:25:47.677 02:37:12 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:47.677 02:37:12 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:47.677 02:37:12 -- common/autotest_common.sh@1257 -- # i=1 00:25:47.677 02:37:12 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:47.677 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.677 02:37:12 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:47.677 02:37:12 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:47.677 02:37:12 -- common/autotest_common.sh@1257 -- # i=2 00:25:47.677 02:37:12 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:47.936 02:37:12 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:47.936 02:37:12 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:47.936 02:37:12 -- common/autotest_common.sh@1265 -- # return 0 00:25:47.936 02:37:12 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 Malloc1 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 Asynchronous Event Request test 00:25:47.936 Attaching to 10.0.0.2 00:25:47.936 Attached to 10.0.0.2 00:25:47.936 Registering asynchronous event callbacks... 00:25:47.936 Starting namespace attribute notice tests for all controllers... 00:25:47.936 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:47.936 aer_cb - Changed Namespace 00:25:47.936 Cleaning up... 00:25:47.936 [ 00:25:47.936 { 00:25:47.936 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:47.936 "subtype": "Discovery", 00:25:47.936 "listen_addresses": [], 00:25:47.936 "allow_any_host": true, 00:25:47.936 "hosts": [] 00:25:47.936 }, 00:25:47.936 { 00:25:47.936 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:47.936 "subtype": "NVMe", 00:25:47.936 "listen_addresses": [ 00:25:47.936 { 00:25:47.936 "transport": "TCP", 00:25:47.936 "trtype": "TCP", 00:25:47.936 "adrfam": "IPv4", 00:25:47.936 "traddr": "10.0.0.2", 00:25:47.936 "trsvcid": "4420" 00:25:47.936 } 00:25:47.936 ], 00:25:47.936 "allow_any_host": true, 00:25:47.936 "hosts": [], 00:25:47.936 "serial_number": "SPDK00000000000001", 00:25:47.936 "model_number": "SPDK bdev Controller", 00:25:47.936 "max_namespaces": 2, 00:25:47.936 "min_cntlid": 1, 00:25:47.936 "max_cntlid": 65519, 00:25:47.936 "namespaces": [ 00:25:47.936 { 00:25:47.936 "nsid": 1, 00:25:47.936 "bdev_name": "Malloc0", 00:25:47.936 "name": "Malloc0", 00:25:47.936 "nguid": "A2F7F6E8BE5A465199D54035A80ECA3E", 00:25:47.936 "uuid": "a2f7f6e8-be5a-4651-99d5-4035a80eca3e" 00:25:47.936 }, 00:25:47.936 { 00:25:47.936 "nsid": 2, 00:25:47.936 "bdev_name": "Malloc1", 00:25:47.936 "name": "Malloc1", 00:25:47.936 "nguid": "9B166EAC140B43169574EE52AE102F7A", 00:25:47.936 "uuid": "9b166eac-140b-4316-9574-ee52ae102f7a" 00:25:47.936 } 00:25:47.936 ] 00:25:47.936 } 00:25:47.936 ] 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@43 -- # wait 2152341 00:25:47.936 02:37:12 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:47.936 02:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:47.936 02:37:12 -- common/autotest_common.sh@10 -- # set +x 00:25:47.936 02:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.936 02:37:12 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:47.936 02:37:12 -- host/aer.sh@51 -- # nvmftestfini 00:25:47.936 02:37:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:47.936 02:37:12 -- nvmf/common.sh@116 -- # sync 00:25:47.936 02:37:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:47.936 02:37:12 -- nvmf/common.sh@119 -- # set +e 00:25:47.936 02:37:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:47.936 02:37:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:47.936 rmmod nvme_tcp 00:25:47.936 rmmod nvme_fabrics 00:25:47.936 rmmod nvme_keyring 00:25:47.936 02:37:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:47.936 02:37:12 -- nvmf/common.sh@123 -- # set -e 00:25:47.936 02:37:12 -- nvmf/common.sh@124 -- # return 0 00:25:47.936 02:37:12 -- nvmf/common.sh@477 -- # '[' -n 2152182 ']' 00:25:47.936 02:37:12 -- nvmf/common.sh@478 -- # killprocess 2152182 00:25:47.936 02:37:12 -- common/autotest_common.sh@936 -- # '[' -z 2152182 ']' 00:25:47.936 02:37:12 -- common/autotest_common.sh@940 -- # kill -0 2152182 00:25:47.936 02:37:12 -- common/autotest_common.sh@941 -- # uname 00:25:47.936 02:37:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.936 02:37:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2152182 00:25:48.195 02:37:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:48.195 02:37:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:48.195 02:37:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2152182' 00:25:48.195 killing process with pid 2152182 00:25:48.195 02:37:12 -- common/autotest_common.sh@955 -- # kill 2152182 00:25:48.195 [2024-11-27 02:37:12.579930] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:48.195 02:37:12 -- common/autotest_common.sh@960 -- # wait 2152182 00:25:48.195 02:37:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:48.195 02:37:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:48.195 02:37:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:48.195 02:37:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:48.195 02:37:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:48.195 02:37:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.195 02:37:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.195 02:37:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.729 02:37:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:50.729 00:25:50.729 real 0m6.055s 00:25:50.729 user 0m7.069s 00:25:50.729 sys 0m1.942s 00:25:50.729 02:37:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:50.729 02:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:50.729 ************************************ 00:25:50.729 END TEST nvmf_aer 00:25:50.729 ************************************ 00:25:50.729 02:37:14 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:50.729 02:37:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:50.729 02:37:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:50.729 02:37:14 -- common/autotest_common.sh@10 -- # set +x 00:25:50.729 ************************************ 00:25:50.729 START TEST nvmf_async_init 00:25:50.729 ************************************ 00:25:50.729 02:37:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:50.729 * Looking for test storage... 00:25:50.729 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:50.729 02:37:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:50.729 02:37:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:50.729 02:37:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:50.729 02:37:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:50.729 02:37:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:50.729 02:37:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:50.729 02:37:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:50.729 02:37:15 -- scripts/common.sh@335 -- # IFS=.-: 00:25:50.729 02:37:15 -- scripts/common.sh@335 -- # read -ra ver1 00:25:50.729 02:37:15 -- scripts/common.sh@336 -- # IFS=.-: 00:25:50.729 02:37:15 -- scripts/common.sh@336 -- # read -ra ver2 00:25:50.729 02:37:15 -- scripts/common.sh@337 -- # local 'op=<' 00:25:50.729 02:37:15 -- scripts/common.sh@339 -- # ver1_l=2 00:25:50.729 02:37:15 -- scripts/common.sh@340 -- # ver2_l=1 00:25:50.730 02:37:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:50.730 02:37:15 -- scripts/common.sh@343 -- # case "$op" in 00:25:50.730 02:37:15 -- scripts/common.sh@344 -- # : 1 00:25:50.730 02:37:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:50.730 02:37:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:50.730 02:37:15 -- scripts/common.sh@364 -- # decimal 1 00:25:50.730 02:37:15 -- scripts/common.sh@352 -- # local d=1 00:25:50.730 02:37:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:50.730 02:37:15 -- scripts/common.sh@354 -- # echo 1 00:25:50.730 02:37:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:50.730 02:37:15 -- scripts/common.sh@365 -- # decimal 2 00:25:50.730 02:37:15 -- scripts/common.sh@352 -- # local d=2 00:25:50.730 02:37:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:50.730 02:37:15 -- scripts/common.sh@354 -- # echo 2 00:25:50.730 02:37:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:50.730 02:37:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:50.730 02:37:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:50.730 02:37:15 -- scripts/common.sh@367 -- # return 0 00:25:50.730 02:37:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:50.730 02:37:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:50.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.730 --rc genhtml_branch_coverage=1 00:25:50.730 --rc genhtml_function_coverage=1 00:25:50.730 --rc genhtml_legend=1 00:25:50.730 --rc geninfo_all_blocks=1 00:25:50.730 --rc geninfo_unexecuted_blocks=1 00:25:50.730 00:25:50.730 ' 00:25:50.730 02:37:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:50.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.730 --rc genhtml_branch_coverage=1 00:25:50.730 --rc genhtml_function_coverage=1 00:25:50.730 --rc genhtml_legend=1 00:25:50.730 --rc geninfo_all_blocks=1 00:25:50.730 --rc geninfo_unexecuted_blocks=1 00:25:50.730 00:25:50.730 ' 00:25:50.730 02:37:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:50.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.730 --rc genhtml_branch_coverage=1 00:25:50.730 --rc genhtml_function_coverage=1 00:25:50.730 --rc genhtml_legend=1 00:25:50.730 --rc geninfo_all_blocks=1 00:25:50.730 --rc geninfo_unexecuted_blocks=1 00:25:50.730 00:25:50.730 ' 00:25:50.730 02:37:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:50.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.730 --rc genhtml_branch_coverage=1 00:25:50.730 --rc genhtml_function_coverage=1 00:25:50.730 --rc genhtml_legend=1 00:25:50.730 --rc geninfo_all_blocks=1 00:25:50.730 --rc geninfo_unexecuted_blocks=1 00:25:50.730 00:25:50.730 ' 00:25:50.730 02:37:15 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:50.730 02:37:15 -- nvmf/common.sh@7 -- # uname -s 00:25:50.730 02:37:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:50.730 02:37:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:50.730 02:37:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:50.730 02:37:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:50.730 02:37:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:50.730 02:37:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:50.730 02:37:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:50.730 02:37:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:50.730 02:37:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:50.730 02:37:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:50.730 02:37:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.730 02:37:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.730 02:37:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:50.730 02:37:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:50.730 02:37:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:50.730 02:37:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:50.730 02:37:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:50.730 02:37:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:50.730 02:37:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:50.730 02:37:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.730 02:37:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.730 02:37:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.730 02:37:15 -- paths/export.sh@5 -- # export PATH 00:25:50.730 02:37:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.730 02:37:15 -- nvmf/common.sh@46 -- # : 0 00:25:50.730 02:37:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:50.730 02:37:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:50.730 02:37:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:50.730 02:37:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:50.730 02:37:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:50.730 02:37:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:50.730 02:37:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:50.730 02:37:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:50.730 02:37:15 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:50.730 02:37:15 -- host/async_init.sh@14 -- # null_block_size=512 00:25:50.730 02:37:15 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:50.730 02:37:15 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:50.730 02:37:15 -- host/async_init.sh@20 -- # uuidgen 00:25:50.730 02:37:15 -- host/async_init.sh@20 -- # tr -d - 00:25:50.730 02:37:15 -- host/async_init.sh@20 -- # nguid=2166209d348547e2b045ec63c1cc4052 00:25:50.730 02:37:15 -- host/async_init.sh@22 -- # nvmftestinit 00:25:50.730 02:37:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:50.730 02:37:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:50.730 02:37:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:50.730 02:37:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:50.730 02:37:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:50.730 02:37:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.730 02:37:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.730 02:37:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.730 02:37:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:50.730 02:37:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:50.730 02:37:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:50.730 02:37:15 -- common/autotest_common.sh@10 -- # set +x 00:25:52.633 02:37:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:52.633 02:37:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:52.633 02:37:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:52.633 02:37:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:52.633 02:37:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:52.633 02:37:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:52.634 02:37:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:52.634 02:37:17 -- nvmf/common.sh@294 -- # net_devs=() 00:25:52.634 02:37:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:52.634 02:37:17 -- nvmf/common.sh@295 -- # e810=() 00:25:52.634 02:37:17 -- nvmf/common.sh@295 -- # local -ga e810 00:25:52.634 02:37:17 -- nvmf/common.sh@296 -- # x722=() 00:25:52.634 02:37:17 -- nvmf/common.sh@296 -- # local -ga x722 00:25:52.634 02:37:17 -- nvmf/common.sh@297 -- # mlx=() 00:25:52.634 02:37:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:52.634 02:37:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:52.634 02:37:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:52.634 02:37:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:52.634 02:37:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.634 02:37:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:52.634 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:52.634 02:37:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.634 02:37:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:52.634 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:52.634 02:37:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.634 02:37:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.634 02:37:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.634 02:37:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:52.634 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:52.634 02:37:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.634 02:37:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.634 02:37:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.634 02:37:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.634 02:37:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:52.634 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:52.634 02:37:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.634 02:37:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:52.634 02:37:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:52.634 02:37:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:52.634 02:37:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:52.634 02:37:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:52.634 02:37:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:52.634 02:37:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:52.634 02:37:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:52.634 02:37:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:52.634 02:37:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:52.634 02:37:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:52.634 02:37:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:52.634 02:37:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:52.634 02:37:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:52.634 02:37:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:52.634 02:37:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:52.634 02:37:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:52.634 02:37:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:52.634 02:37:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:52.634 02:37:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:52.893 02:37:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:52.893 02:37:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:52.893 02:37:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:52.893 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:52.893 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:25:52.893 00:25:52.893 --- 10.0.0.2 ping statistics --- 00:25:52.893 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.893 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:25:52.893 02:37:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:52.893 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:52.893 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:25:52.893 00:25:52.893 --- 10.0.0.1 ping statistics --- 00:25:52.893 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:52.893 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:25:52.893 02:37:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:52.893 02:37:17 -- nvmf/common.sh@410 -- # return 0 00:25:52.893 02:37:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:52.893 02:37:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:52.893 02:37:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:52.893 02:37:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:52.893 02:37:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:52.893 02:37:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:52.893 02:37:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:52.893 02:37:17 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:52.893 02:37:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:52.893 02:37:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:52.893 02:37:17 -- common/autotest_common.sh@10 -- # set +x 00:25:52.893 02:37:17 -- nvmf/common.sh@469 -- # nvmfpid=2154416 00:25:52.893 02:37:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:52.893 02:37:17 -- nvmf/common.sh@470 -- # waitforlisten 2154416 00:25:52.893 02:37:17 -- common/autotest_common.sh@829 -- # '[' -z 2154416 ']' 00:25:52.893 02:37:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:52.893 02:37:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:52.893 02:37:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:52.893 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:52.893 02:37:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:52.893 02:37:17 -- common/autotest_common.sh@10 -- # set +x 00:25:52.893 [2024-11-27 02:37:17.373346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:52.893 [2024-11-27 02:37:17.373427] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:52.893 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.893 [2024-11-27 02:37:17.436082] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:52.893 [2024-11-27 02:37:17.520326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:52.893 [2024-11-27 02:37:17.520486] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:52.893 [2024-11-27 02:37:17.520503] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:52.893 [2024-11-27 02:37:17.520515] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:52.893 [2024-11-27 02:37:17.520576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:53.831 02:37:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:53.831 02:37:18 -- common/autotest_common.sh@862 -- # return 0 00:25:53.831 02:37:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:53.831 02:37:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 02:37:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:53.831 02:37:18 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 [2024-11-27 02:37:18.404255] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 null0 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 2166209d348547e2b045ec63c1cc4052 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:53.831 [2024-11-27 02:37:18.444514] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:53.831 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:53.831 02:37:18 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:53.831 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.831 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.090 nvme0n1 00:25:54.090 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.090 02:37:18 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:54.090 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.090 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.090 [ 00:25:54.090 { 00:25:54.090 "name": "nvme0n1", 00:25:54.090 "aliases": [ 00:25:54.090 "2166209d-3485-47e2-b045-ec63c1cc4052" 00:25:54.090 ], 00:25:54.090 "product_name": "NVMe disk", 00:25:54.090 "block_size": 512, 00:25:54.090 "num_blocks": 2097152, 00:25:54.091 "uuid": "2166209d-3485-47e2-b045-ec63c1cc4052", 00:25:54.091 "assigned_rate_limits": { 00:25:54.091 "rw_ios_per_sec": 0, 00:25:54.091 "rw_mbytes_per_sec": 0, 00:25:54.091 "r_mbytes_per_sec": 0, 00:25:54.091 "w_mbytes_per_sec": 0 00:25:54.091 }, 00:25:54.091 "claimed": false, 00:25:54.091 "zoned": false, 00:25:54.091 "supported_io_types": { 00:25:54.091 "read": true, 00:25:54.091 "write": true, 00:25:54.091 "unmap": false, 00:25:54.091 "write_zeroes": true, 00:25:54.091 "flush": true, 00:25:54.091 "reset": true, 00:25:54.091 "compare": true, 00:25:54.091 "compare_and_write": true, 00:25:54.091 "abort": true, 00:25:54.091 "nvme_admin": true, 00:25:54.091 "nvme_io": true 00:25:54.091 }, 00:25:54.091 "driver_specific": { 00:25:54.091 "nvme": [ 00:25:54.091 { 00:25:54.091 "trid": { 00:25:54.091 "trtype": "TCP", 00:25:54.091 "adrfam": "IPv4", 00:25:54.091 "traddr": "10.0.0.2", 00:25:54.091 "trsvcid": "4420", 00:25:54.091 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:54.091 }, 00:25:54.091 "ctrlr_data": { 00:25:54.091 "cntlid": 1, 00:25:54.091 "vendor_id": "0x8086", 00:25:54.091 "model_number": "SPDK bdev Controller", 00:25:54.091 "serial_number": "00000000000000000000", 00:25:54.091 "firmware_revision": "24.01.1", 00:25:54.091 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:54.091 "oacs": { 00:25:54.091 "security": 0, 00:25:54.091 "format": 0, 00:25:54.091 "firmware": 0, 00:25:54.091 "ns_manage": 0 00:25:54.091 }, 00:25:54.091 "multi_ctrlr": true, 00:25:54.091 "ana_reporting": false 00:25:54.091 }, 00:25:54.091 "vs": { 00:25:54.091 "nvme_version": "1.3" 00:25:54.091 }, 00:25:54.091 "ns_data": { 00:25:54.091 "id": 1, 00:25:54.091 "can_share": true 00:25:54.091 } 00:25:54.091 } 00:25:54.091 ], 00:25:54.091 "mp_policy": "active_passive" 00:25:54.091 } 00:25:54.091 } 00:25:54.091 ] 00:25:54.091 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.091 02:37:18 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:54.091 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.091 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.091 [2024-11-27 02:37:18.693256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:54.091 [2024-11-27 02:37:18.693365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f4bba0 (9): Bad file descriptor 00:25:54.349 [2024-11-27 02:37:18.825694] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:54.349 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.349 02:37:18 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:54.349 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.349 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.349 [ 00:25:54.349 { 00:25:54.349 "name": "nvme0n1", 00:25:54.349 "aliases": [ 00:25:54.349 "2166209d-3485-47e2-b045-ec63c1cc4052" 00:25:54.349 ], 00:25:54.349 "product_name": "NVMe disk", 00:25:54.349 "block_size": 512, 00:25:54.349 "num_blocks": 2097152, 00:25:54.349 "uuid": "2166209d-3485-47e2-b045-ec63c1cc4052", 00:25:54.349 "assigned_rate_limits": { 00:25:54.349 "rw_ios_per_sec": 0, 00:25:54.349 "rw_mbytes_per_sec": 0, 00:25:54.349 "r_mbytes_per_sec": 0, 00:25:54.349 "w_mbytes_per_sec": 0 00:25:54.349 }, 00:25:54.349 "claimed": false, 00:25:54.349 "zoned": false, 00:25:54.349 "supported_io_types": { 00:25:54.349 "read": true, 00:25:54.349 "write": true, 00:25:54.349 "unmap": false, 00:25:54.349 "write_zeroes": true, 00:25:54.349 "flush": true, 00:25:54.349 "reset": true, 00:25:54.349 "compare": true, 00:25:54.349 "compare_and_write": true, 00:25:54.349 "abort": true, 00:25:54.349 "nvme_admin": true, 00:25:54.349 "nvme_io": true 00:25:54.349 }, 00:25:54.349 "driver_specific": { 00:25:54.349 "nvme": [ 00:25:54.349 { 00:25:54.349 "trid": { 00:25:54.349 "trtype": "TCP", 00:25:54.349 "adrfam": "IPv4", 00:25:54.349 "traddr": "10.0.0.2", 00:25:54.349 "trsvcid": "4420", 00:25:54.349 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:54.349 }, 00:25:54.349 "ctrlr_data": { 00:25:54.349 "cntlid": 2, 00:25:54.349 "vendor_id": "0x8086", 00:25:54.349 "model_number": "SPDK bdev Controller", 00:25:54.349 "serial_number": "00000000000000000000", 00:25:54.349 "firmware_revision": "24.01.1", 00:25:54.349 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:54.349 "oacs": { 00:25:54.349 "security": 0, 00:25:54.349 "format": 0, 00:25:54.349 "firmware": 0, 00:25:54.349 "ns_manage": 0 00:25:54.349 }, 00:25:54.349 "multi_ctrlr": true, 00:25:54.349 "ana_reporting": false 00:25:54.349 }, 00:25:54.349 "vs": { 00:25:54.349 "nvme_version": "1.3" 00:25:54.349 }, 00:25:54.349 "ns_data": { 00:25:54.349 "id": 1, 00:25:54.349 "can_share": true 00:25:54.349 } 00:25:54.349 } 00:25:54.349 ], 00:25:54.349 "mp_policy": "active_passive" 00:25:54.349 } 00:25:54.349 } 00:25:54.349 ] 00:25:54.349 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.349 02:37:18 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:54.349 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.349 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.349 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@53 -- # mktemp 00:25:54.350 02:37:18 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.MRMTbvqu37 00:25:54.350 02:37:18 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:54.350 02:37:18 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.MRMTbvqu37 00:25:54.350 02:37:18 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.350 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.350 [2024-11-27 02:37:18.873883] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:54.350 [2024-11-27 02:37:18.874064] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:54.350 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.MRMTbvqu37 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.350 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.MRMTbvqu37 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.350 [2024-11-27 02:37:18.889911] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:54.350 nvme0n1 00:25:54.350 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.350 [ 00:25:54.350 { 00:25:54.350 "name": "nvme0n1", 00:25:54.350 "aliases": [ 00:25:54.350 "2166209d-3485-47e2-b045-ec63c1cc4052" 00:25:54.350 ], 00:25:54.350 "product_name": "NVMe disk", 00:25:54.350 "block_size": 512, 00:25:54.350 "num_blocks": 2097152, 00:25:54.350 "uuid": "2166209d-3485-47e2-b045-ec63c1cc4052", 00:25:54.350 "assigned_rate_limits": { 00:25:54.350 "rw_ios_per_sec": 0, 00:25:54.350 "rw_mbytes_per_sec": 0, 00:25:54.350 "r_mbytes_per_sec": 0, 00:25:54.350 "w_mbytes_per_sec": 0 00:25:54.350 }, 00:25:54.350 "claimed": false, 00:25:54.350 "zoned": false, 00:25:54.350 "supported_io_types": { 00:25:54.350 "read": true, 00:25:54.350 "write": true, 00:25:54.350 "unmap": false, 00:25:54.350 "write_zeroes": true, 00:25:54.350 "flush": true, 00:25:54.350 "reset": true, 00:25:54.350 "compare": true, 00:25:54.350 "compare_and_write": true, 00:25:54.350 "abort": true, 00:25:54.350 "nvme_admin": true, 00:25:54.350 "nvme_io": true 00:25:54.350 }, 00:25:54.350 "driver_specific": { 00:25:54.350 "nvme": [ 00:25:54.350 { 00:25:54.350 "trid": { 00:25:54.350 "trtype": "TCP", 00:25:54.350 "adrfam": "IPv4", 00:25:54.350 "traddr": "10.0.0.2", 00:25:54.350 "trsvcid": "4421", 00:25:54.350 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:54.350 }, 00:25:54.350 "ctrlr_data": { 00:25:54.350 "cntlid": 3, 00:25:54.350 "vendor_id": "0x8086", 00:25:54.350 "model_number": "SPDK bdev Controller", 00:25:54.350 "serial_number": "00000000000000000000", 00:25:54.350 "firmware_revision": "24.01.1", 00:25:54.350 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:54.350 "oacs": { 00:25:54.350 "security": 0, 00:25:54.350 "format": 0, 00:25:54.350 "firmware": 0, 00:25:54.350 "ns_manage": 0 00:25:54.350 }, 00:25:54.350 "multi_ctrlr": true, 00:25:54.350 "ana_reporting": false 00:25:54.350 }, 00:25:54.350 "vs": { 00:25:54.350 "nvme_version": "1.3" 00:25:54.350 }, 00:25:54.350 "ns_data": { 00:25:54.350 "id": 1, 00:25:54.350 "can_share": true 00:25:54.350 } 00:25:54.350 } 00:25:54.350 ], 00:25:54.350 "mp_policy": "active_passive" 00:25:54.350 } 00:25:54.350 } 00:25:54.350 ] 00:25:54.350 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.350 02:37:18 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:54.350 02:37:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.350 02:37:18 -- common/autotest_common.sh@10 -- # set +x 00:25:54.609 02:37:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.609 02:37:18 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.MRMTbvqu37 00:25:54.609 02:37:18 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:54.609 02:37:18 -- host/async_init.sh@78 -- # nvmftestfini 00:25:54.609 02:37:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:54.609 02:37:18 -- nvmf/common.sh@116 -- # sync 00:25:54.609 02:37:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:54.609 02:37:18 -- nvmf/common.sh@119 -- # set +e 00:25:54.609 02:37:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:54.609 02:37:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:54.609 rmmod nvme_tcp 00:25:54.609 rmmod nvme_fabrics 00:25:54.609 rmmod nvme_keyring 00:25:54.609 02:37:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:54.609 02:37:19 -- nvmf/common.sh@123 -- # set -e 00:25:54.609 02:37:19 -- nvmf/common.sh@124 -- # return 0 00:25:54.609 02:37:19 -- nvmf/common.sh@477 -- # '[' -n 2154416 ']' 00:25:54.609 02:37:19 -- nvmf/common.sh@478 -- # killprocess 2154416 00:25:54.609 02:37:19 -- common/autotest_common.sh@936 -- # '[' -z 2154416 ']' 00:25:54.609 02:37:19 -- common/autotest_common.sh@940 -- # kill -0 2154416 00:25:54.609 02:37:19 -- common/autotest_common.sh@941 -- # uname 00:25:54.609 02:37:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:54.609 02:37:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2154416 00:25:54.609 02:37:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:54.609 02:37:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:54.609 02:37:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2154416' 00:25:54.609 killing process with pid 2154416 00:25:54.609 02:37:19 -- common/autotest_common.sh@955 -- # kill 2154416 00:25:54.609 02:37:19 -- common/autotest_common.sh@960 -- # wait 2154416 00:25:54.867 02:37:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:54.867 02:37:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:54.867 02:37:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:54.867 02:37:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:54.867 02:37:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:54.867 02:37:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.867 02:37:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.867 02:37:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.774 02:37:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:56.774 00:25:56.774 real 0m6.445s 00:25:56.774 user 0m3.217s 00:25:56.774 sys 0m1.897s 00:25:56.774 02:37:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:56.774 02:37:21 -- common/autotest_common.sh@10 -- # set +x 00:25:56.774 ************************************ 00:25:56.774 END TEST nvmf_async_init 00:25:56.774 ************************************ 00:25:56.774 02:37:21 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:56.774 02:37:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:56.774 02:37:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:56.774 02:37:21 -- common/autotest_common.sh@10 -- # set +x 00:25:56.774 ************************************ 00:25:56.774 START TEST dma 00:25:56.774 ************************************ 00:25:56.774 02:37:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:56.774 * Looking for test storage... 00:25:56.774 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:56.774 02:37:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:56.774 02:37:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:56.774 02:37:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.033 02:37:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.033 02:37:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.033 02:37:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.033 02:37:21 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.033 02:37:21 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.033 02:37:21 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.033 02:37:21 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.033 02:37:21 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.033 02:37:21 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.033 02:37:21 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.033 02:37:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.033 02:37:21 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.033 02:37:21 -- scripts/common.sh@344 -- # : 1 00:25:57.033 02:37:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.033 02:37:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.033 02:37:21 -- scripts/common.sh@364 -- # decimal 1 00:25:57.033 02:37:21 -- scripts/common.sh@352 -- # local d=1 00:25:57.033 02:37:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.033 02:37:21 -- scripts/common.sh@354 -- # echo 1 00:25:57.033 02:37:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.033 02:37:21 -- scripts/common.sh@365 -- # decimal 2 00:25:57.033 02:37:21 -- scripts/common.sh@352 -- # local d=2 00:25:57.033 02:37:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.033 02:37:21 -- scripts/common.sh@354 -- # echo 2 00:25:57.033 02:37:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.033 02:37:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.033 02:37:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.033 02:37:21 -- scripts/common.sh@367 -- # return 0 00:25:57.033 02:37:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.033 --rc genhtml_branch_coverage=1 00:25:57.033 --rc genhtml_function_coverage=1 00:25:57.033 --rc genhtml_legend=1 00:25:57.033 --rc geninfo_all_blocks=1 00:25:57.033 --rc geninfo_unexecuted_blocks=1 00:25:57.033 00:25:57.033 ' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.033 --rc genhtml_branch_coverage=1 00:25:57.033 --rc genhtml_function_coverage=1 00:25:57.033 --rc genhtml_legend=1 00:25:57.033 --rc geninfo_all_blocks=1 00:25:57.033 --rc geninfo_unexecuted_blocks=1 00:25:57.033 00:25:57.033 ' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.033 --rc genhtml_branch_coverage=1 00:25:57.033 --rc genhtml_function_coverage=1 00:25:57.033 --rc genhtml_legend=1 00:25:57.033 --rc geninfo_all_blocks=1 00:25:57.033 --rc geninfo_unexecuted_blocks=1 00:25:57.033 00:25:57.033 ' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.033 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.033 --rc genhtml_branch_coverage=1 00:25:57.033 --rc genhtml_function_coverage=1 00:25:57.033 --rc genhtml_legend=1 00:25:57.033 --rc geninfo_all_blocks=1 00:25:57.033 --rc geninfo_unexecuted_blocks=1 00:25:57.033 00:25:57.033 ' 00:25:57.033 02:37:21 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.033 02:37:21 -- nvmf/common.sh@7 -- # uname -s 00:25:57.033 02:37:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.033 02:37:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.033 02:37:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.033 02:37:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.033 02:37:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.033 02:37:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.033 02:37:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.033 02:37:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.033 02:37:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.033 02:37:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.033 02:37:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.033 02:37:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.033 02:37:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.033 02:37:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.033 02:37:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.033 02:37:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.033 02:37:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.033 02:37:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.033 02:37:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.033 02:37:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.033 02:37:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.033 02:37:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.033 02:37:21 -- paths/export.sh@5 -- # export PATH 00:25:57.033 02:37:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.033 02:37:21 -- nvmf/common.sh@46 -- # : 0 00:25:57.033 02:37:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.033 02:37:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.033 02:37:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.033 02:37:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.033 02:37:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.033 02:37:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.033 02:37:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.033 02:37:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.033 02:37:21 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:57.033 02:37:21 -- host/dma.sh@13 -- # exit 0 00:25:57.033 00:25:57.033 real 0m0.156s 00:25:57.033 user 0m0.105s 00:25:57.033 sys 0m0.059s 00:25:57.033 02:37:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.033 02:37:21 -- common/autotest_common.sh@10 -- # set +x 00:25:57.033 ************************************ 00:25:57.033 END TEST dma 00:25:57.033 ************************************ 00:25:57.033 02:37:21 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:57.033 02:37:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:57.033 02:37:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:57.033 02:37:21 -- common/autotest_common.sh@10 -- # set +x 00:25:57.033 ************************************ 00:25:57.033 START TEST nvmf_identify 00:25:57.033 ************************************ 00:25:57.033 02:37:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:57.033 * Looking for test storage... 00:25:57.033 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:57.034 02:37:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:57.034 02:37:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:57.034 02:37:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.034 02:37:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.034 02:37:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.034 02:37:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.034 02:37:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.034 02:37:21 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.034 02:37:21 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.034 02:37:21 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.034 02:37:21 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.034 02:37:21 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.034 02:37:21 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.034 02:37:21 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.034 02:37:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.034 02:37:21 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.034 02:37:21 -- scripts/common.sh@344 -- # : 1 00:25:57.034 02:37:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.034 02:37:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.034 02:37:21 -- scripts/common.sh@364 -- # decimal 1 00:25:57.034 02:37:21 -- scripts/common.sh@352 -- # local d=1 00:25:57.034 02:37:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.034 02:37:21 -- scripts/common.sh@354 -- # echo 1 00:25:57.034 02:37:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.034 02:37:21 -- scripts/common.sh@365 -- # decimal 2 00:25:57.034 02:37:21 -- scripts/common.sh@352 -- # local d=2 00:25:57.034 02:37:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.034 02:37:21 -- scripts/common.sh@354 -- # echo 2 00:25:57.034 02:37:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.034 02:37:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.034 02:37:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.034 02:37:21 -- scripts/common.sh@367 -- # return 0 00:25:57.034 02:37:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.034 02:37:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.034 --rc genhtml_branch_coverage=1 00:25:57.034 --rc genhtml_function_coverage=1 00:25:57.034 --rc genhtml_legend=1 00:25:57.034 --rc geninfo_all_blocks=1 00:25:57.034 --rc geninfo_unexecuted_blocks=1 00:25:57.034 00:25:57.034 ' 00:25:57.034 02:37:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.034 --rc genhtml_branch_coverage=1 00:25:57.034 --rc genhtml_function_coverage=1 00:25:57.034 --rc genhtml_legend=1 00:25:57.034 --rc geninfo_all_blocks=1 00:25:57.034 --rc geninfo_unexecuted_blocks=1 00:25:57.034 00:25:57.034 ' 00:25:57.034 02:37:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.034 --rc genhtml_branch_coverage=1 00:25:57.034 --rc genhtml_function_coverage=1 00:25:57.034 --rc genhtml_legend=1 00:25:57.034 --rc geninfo_all_blocks=1 00:25:57.034 --rc geninfo_unexecuted_blocks=1 00:25:57.034 00:25:57.034 ' 00:25:57.034 02:37:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.034 --rc genhtml_branch_coverage=1 00:25:57.034 --rc genhtml_function_coverage=1 00:25:57.034 --rc genhtml_legend=1 00:25:57.034 --rc geninfo_all_blocks=1 00:25:57.034 --rc geninfo_unexecuted_blocks=1 00:25:57.034 00:25:57.034 ' 00:25:57.034 02:37:21 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.034 02:37:21 -- nvmf/common.sh@7 -- # uname -s 00:25:57.293 02:37:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.293 02:37:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.293 02:37:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.293 02:37:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.293 02:37:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.293 02:37:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.293 02:37:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.293 02:37:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.293 02:37:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.293 02:37:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.293 02:37:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.293 02:37:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.293 02:37:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.293 02:37:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.293 02:37:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.293 02:37:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.293 02:37:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.293 02:37:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.293 02:37:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.293 02:37:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.293 02:37:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.293 02:37:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.293 02:37:21 -- paths/export.sh@5 -- # export PATH 00:25:57.293 02:37:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.293 02:37:21 -- nvmf/common.sh@46 -- # : 0 00:25:57.293 02:37:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.293 02:37:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.293 02:37:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.293 02:37:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.293 02:37:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.293 02:37:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.293 02:37:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.293 02:37:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.293 02:37:21 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:57.293 02:37:21 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:57.293 02:37:21 -- host/identify.sh@14 -- # nvmftestinit 00:25:57.293 02:37:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:57.293 02:37:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:57.293 02:37:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:57.293 02:37:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:57.293 02:37:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:57.293 02:37:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.293 02:37:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.293 02:37:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.293 02:37:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:57.293 02:37:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:57.293 02:37:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:57.293 02:37:21 -- common/autotest_common.sh@10 -- # set +x 00:25:59.200 02:37:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.200 02:37:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:59.200 02:37:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:59.200 02:37:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:59.200 02:37:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:59.200 02:37:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:59.200 02:37:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:59.200 02:37:23 -- nvmf/common.sh@294 -- # net_devs=() 00:25:59.200 02:37:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:59.200 02:37:23 -- nvmf/common.sh@295 -- # e810=() 00:25:59.200 02:37:23 -- nvmf/common.sh@295 -- # local -ga e810 00:25:59.200 02:37:23 -- nvmf/common.sh@296 -- # x722=() 00:25:59.200 02:37:23 -- nvmf/common.sh@296 -- # local -ga x722 00:25:59.200 02:37:23 -- nvmf/common.sh@297 -- # mlx=() 00:25:59.200 02:37:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:59.200 02:37:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.200 02:37:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:59.200 02:37:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:59.200 02:37:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:59.200 02:37:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.200 02:37:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:59.200 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:59.200 02:37:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.200 02:37:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:59.200 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:59.200 02:37:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.200 02:37:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:59.201 02:37:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.201 02:37:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.201 02:37:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.201 02:37:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.201 02:37:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:59.201 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:59.201 02:37:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.201 02:37:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.201 02:37:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.201 02:37:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.201 02:37:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.201 02:37:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:59.201 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:59.201 02:37:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.201 02:37:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:59.201 02:37:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:59.201 02:37:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:59.201 02:37:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:59.201 02:37:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:59.201 02:37:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:59.201 02:37:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:59.201 02:37:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:59.201 02:37:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:59.201 02:37:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:59.201 02:37:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:59.201 02:37:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:59.201 02:37:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:59.201 02:37:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:59.201 02:37:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:59.201 02:37:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:59.201 02:37:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:59.201 02:37:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:59.201 02:37:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:59.201 02:37:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:59.201 02:37:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:59.460 02:37:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:59.460 02:37:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:59.460 02:37:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:59.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:59.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.357 ms 00:25:59.460 00:25:59.460 --- 10.0.0.2 ping statistics --- 00:25:59.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.460 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:25:59.460 02:37:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:59.460 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:59.460 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:25:59.460 00:25:59.460 --- 10.0.0.1 ping statistics --- 00:25:59.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.460 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:25:59.460 02:37:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:59.460 02:37:23 -- nvmf/common.sh@410 -- # return 0 00:25:59.460 02:37:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:59.460 02:37:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:59.460 02:37:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:59.460 02:37:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:59.460 02:37:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:59.460 02:37:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:59.460 02:37:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:59.460 02:37:23 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:59.460 02:37:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:59.460 02:37:23 -- common/autotest_common.sh@10 -- # set +x 00:25:59.460 02:37:23 -- host/identify.sh@19 -- # nvmfpid=2156582 00:25:59.460 02:37:23 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:59.460 02:37:23 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:59.460 02:37:23 -- host/identify.sh@23 -- # waitforlisten 2156582 00:25:59.460 02:37:23 -- common/autotest_common.sh@829 -- # '[' -z 2156582 ']' 00:25:59.460 02:37:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:59.460 02:37:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.460 02:37:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:59.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:59.460 02:37:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.460 02:37:23 -- common/autotest_common.sh@10 -- # set +x 00:25:59.460 [2024-11-27 02:37:23.950699] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:59.460 [2024-11-27 02:37:23.950794] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.460 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.460 [2024-11-27 02:37:24.016955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:59.719 [2024-11-27 02:37:24.108479] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.719 [2024-11-27 02:37:24.108645] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:59.719 [2024-11-27 02:37:24.108664] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:59.719 [2024-11-27 02:37:24.108677] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:59.719 [2024-11-27 02:37:24.108752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:59.719 [2024-11-27 02:37:24.108770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:59.719 [2024-11-27 02:37:24.108837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:59.719 [2024-11-27 02:37:24.108840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.286 02:37:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.286 02:37:24 -- common/autotest_common.sh@862 -- # return 0 00:26:00.286 02:37:24 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:00.286 02:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.286 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.546 [2024-11-27 02:37:24.921199] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.546 02:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.546 02:37:24 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:00.546 02:37:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:00.546 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.546 02:37:24 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:00.546 02:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.546 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.546 Malloc0 00:26:00.547 02:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:24 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:00.547 02:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.547 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.547 02:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:24 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:00.547 02:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.547 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.547 02:37:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:24 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:00.547 02:37:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.547 02:37:24 -- common/autotest_common.sh@10 -- # set +x 00:26:00.547 [2024-11-27 02:37:24.998443] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.547 02:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:25 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:00.547 02:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.547 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:26:00.547 02:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:25 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:00.547 02:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.547 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:26:00.547 [2024-11-27 02:37:25.014197] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:00.547 [ 00:26:00.547 { 00:26:00.547 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:00.547 "subtype": "Discovery", 00:26:00.547 "listen_addresses": [ 00:26:00.547 { 00:26:00.547 "transport": "TCP", 00:26:00.547 "trtype": "TCP", 00:26:00.547 "adrfam": "IPv4", 00:26:00.547 "traddr": "10.0.0.2", 00:26:00.547 "trsvcid": "4420" 00:26:00.547 } 00:26:00.547 ], 00:26:00.547 "allow_any_host": true, 00:26:00.547 "hosts": [] 00:26:00.547 }, 00:26:00.547 { 00:26:00.547 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:00.547 "subtype": "NVMe", 00:26:00.547 "listen_addresses": [ 00:26:00.547 { 00:26:00.547 "transport": "TCP", 00:26:00.547 "trtype": "TCP", 00:26:00.547 "adrfam": "IPv4", 00:26:00.547 "traddr": "10.0.0.2", 00:26:00.547 "trsvcid": "4420" 00:26:00.547 } 00:26:00.547 ], 00:26:00.547 "allow_any_host": true, 00:26:00.547 "hosts": [], 00:26:00.547 "serial_number": "SPDK00000000000001", 00:26:00.547 "model_number": "SPDK bdev Controller", 00:26:00.547 "max_namespaces": 32, 00:26:00.547 "min_cntlid": 1, 00:26:00.547 "max_cntlid": 65519, 00:26:00.547 "namespaces": [ 00:26:00.547 { 00:26:00.547 "nsid": 1, 00:26:00.547 "bdev_name": "Malloc0", 00:26:00.547 "name": "Malloc0", 00:26:00.547 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:00.547 "eui64": "ABCDEF0123456789", 00:26:00.547 "uuid": "ef888a74-2fb7-4923-9a20-cca8b185a376" 00:26:00.547 } 00:26:00.547 ] 00:26:00.547 } 00:26:00.547 ] 00:26:00.547 02:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.547 02:37:25 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:00.547 [2024-11-27 02:37:25.038609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:00.547 [2024-11-27 02:37:25.038652] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2156743 ] 00:26:00.547 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.547 [2024-11-27 02:37:25.070879] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:00.547 [2024-11-27 02:37:25.070944] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:00.547 [2024-11-27 02:37:25.070955] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:00.547 [2024-11-27 02:37:25.070973] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:00.547 [2024-11-27 02:37:25.070986] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:00.547 [2024-11-27 02:37:25.074585] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:00.547 [2024-11-27 02:37:25.074652] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xc632f0 0 00:26:00.547 [2024-11-27 02:37:25.082559] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:00.547 [2024-11-27 02:37:25.082581] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:00.547 [2024-11-27 02:37:25.082590] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:00.547 [2024-11-27 02:37:25.082597] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:00.547 [2024-11-27 02:37:25.082653] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.082668] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.082676] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.547 [2024-11-27 02:37:25.082698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:00.547 [2024-11-27 02:37:25.082725] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.547 [2024-11-27 02:37:25.090543] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.547 [2024-11-27 02:37:25.090561] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.547 [2024-11-27 02:37:25.090569] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090577] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.547 [2024-11-27 02:37:25.090594] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:00.547 [2024-11-27 02:37:25.090608] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:00.547 [2024-11-27 02:37:25.090618] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:00.547 [2024-11-27 02:37:25.090639] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090648] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090654] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.547 [2024-11-27 02:37:25.090666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.547 [2024-11-27 02:37:25.090689] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.547 [2024-11-27 02:37:25.090822] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.547 [2024-11-27 02:37:25.090838] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.547 [2024-11-27 02:37:25.090846] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090853] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.547 [2024-11-27 02:37:25.090866] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:00.547 [2024-11-27 02:37:25.090881] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:00.547 [2024-11-27 02:37:25.090895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.090911] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.547 [2024-11-27 02:37:25.090924] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.547 [2024-11-27 02:37:25.090946] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.547 [2024-11-27 02:37:25.091030] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.547 [2024-11-27 02:37:25.091046] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.547 [2024-11-27 02:37:25.091053] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091060] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.547 [2024-11-27 02:37:25.091070] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:00.547 [2024-11-27 02:37:25.091086] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:00.547 [2024-11-27 02:37:25.091101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091109] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091115] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.547 [2024-11-27 02:37:25.091126] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.547 [2024-11-27 02:37:25.091147] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.547 [2024-11-27 02:37:25.091229] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.547 [2024-11-27 02:37:25.091244] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.547 [2024-11-27 02:37:25.091252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091259] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.547 [2024-11-27 02:37:25.091269] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:00.547 [2024-11-27 02:37:25.091288] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091298] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.547 [2024-11-27 02:37:25.091305] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.547 [2024-11-27 02:37:25.091316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.547 [2024-11-27 02:37:25.091338] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.547 [2024-11-27 02:37:25.091415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.091430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.091437] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091444] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.091455] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:00.548 [2024-11-27 02:37:25.091467] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:00.548 [2024-11-27 02:37:25.091480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:00.548 [2024-11-27 02:37:25.091591] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:00.548 [2024-11-27 02:37:25.091604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:00.548 [2024-11-27 02:37:25.091622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091630] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.091652] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.548 [2024-11-27 02:37:25.091675] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.548 [2024-11-27 02:37:25.091788] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.091804] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.091811] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091818] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.091829] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:00.548 [2024-11-27 02:37:25.091848] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091857] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.091864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.091875] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.548 [2024-11-27 02:37:25.091899] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.548 [2024-11-27 02:37:25.091984] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.091999] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.092006] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.092013] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.092023] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:00.548 [2024-11-27 02:37:25.092034] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.092048] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:00.548 [2024-11-27 02:37:25.092064] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.092083] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.092091] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.092098] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.092110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.548 [2024-11-27 02:37:25.092132] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.548 [2024-11-27 02:37:25.092269] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.548 [2024-11-27 02:37:25.092285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.548 [2024-11-27 02:37:25.092292] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.092299] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc632f0): datao=0, datal=4096, cccid=0 00:26:00.548 [2024-11-27 02:37:25.092308] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xcbbec0) on tqpair(0xc632f0): expected_datao=0, payload_size=4096 00:26:00.548 [2024-11-27 02:37:25.092333] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.092347] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.132681] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.132706] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.132718] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.132727] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.132742] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:00.548 [2024-11-27 02:37:25.132752] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:00.548 [2024-11-27 02:37:25.132760] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:00.548 [2024-11-27 02:37:25.132769] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:00.548 [2024-11-27 02:37:25.132778] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:00.548 [2024-11-27 02:37:25.132787] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.132809] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.132826] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.132834] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.132841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.132853] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:00.548 [2024-11-27 02:37:25.132876] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.548 [2024-11-27 02:37:25.132984] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.133000] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.133008] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133015] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbbec0) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.133028] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133036] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133044] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.133055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.548 [2024-11-27 02:37:25.133065] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133087] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133093] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.133102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.548 [2024-11-27 02:37:25.133112] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133119] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133125] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.133148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.548 [2024-11-27 02:37:25.133158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133165] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133171] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.133185] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.548 [2024-11-27 02:37:25.133195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.133217] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:00.548 [2024-11-27 02:37:25.133246] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133254] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133261] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc632f0) 00:26:00.548 [2024-11-27 02:37:25.133271] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.548 [2024-11-27 02:37:25.133294] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbbec0, cid 0, qid 0 00:26:00.548 [2024-11-27 02:37:25.133320] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc020, cid 1, qid 0 00:26:00.548 [2024-11-27 02:37:25.133328] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc180, cid 2, qid 0 00:26:00.548 [2024-11-27 02:37:25.133336] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.548 [2024-11-27 02:37:25.133344] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc440, cid 4, qid 0 00:26:00.548 [2024-11-27 02:37:25.133488] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.548 [2024-11-27 02:37:25.133504] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.548 [2024-11-27 02:37:25.133511] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.133518] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc440) on tqpair=0xc632f0 00:26:00.548 [2024-11-27 02:37:25.137541] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:00.548 [2024-11-27 02:37:25.137556] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:00.548 [2024-11-27 02:37:25.137576] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.548 [2024-11-27 02:37:25.137587] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137594] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc632f0) 00:26:00.549 [2024-11-27 02:37:25.137605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.549 [2024-11-27 02:37:25.137627] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc440, cid 4, qid 0 00:26:00.549 [2024-11-27 02:37:25.137782] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.549 [2024-11-27 02:37:25.137800] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.549 [2024-11-27 02:37:25.137808] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137819] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc632f0): datao=0, datal=4096, cccid=4 00:26:00.549 [2024-11-27 02:37:25.137832] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xcbc440) on tqpair(0xc632f0): expected_datao=0, payload_size=4096 00:26:00.549 [2024-11-27 02:37:25.137845] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137853] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.549 [2024-11-27 02:37:25.137875] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.549 [2024-11-27 02:37:25.137882] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137889] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc440) on tqpair=0xc632f0 00:26:00.549 [2024-11-27 02:37:25.137914] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:00.549 [2024-11-27 02:37:25.137956] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137967] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.137974] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc632f0) 00:26:00.549 [2024-11-27 02:37:25.137985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.549 [2024-11-27 02:37:25.137997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138011] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc632f0) 00:26:00.549 [2024-11-27 02:37:25.138020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.549 [2024-11-27 02:37:25.138048] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc440, cid 4, qid 0 00:26:00.549 [2024-11-27 02:37:25.138060] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc5a0, cid 5, qid 0 00:26:00.549 [2024-11-27 02:37:25.138214] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.549 [2024-11-27 02:37:25.138230] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.549 [2024-11-27 02:37:25.138237] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138244] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc632f0): datao=0, datal=1024, cccid=4 00:26:00.549 [2024-11-27 02:37:25.138255] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xcbc440) on tqpair(0xc632f0): expected_datao=0, payload_size=1024 00:26:00.549 [2024-11-27 02:37:25.138267] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138274] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.549 [2024-11-27 02:37:25.138292] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.549 [2024-11-27 02:37:25.138299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.138305] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc5a0) on tqpair=0xc632f0 00:26:00.549 [2024-11-27 02:37:25.178629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.549 [2024-11-27 02:37:25.178651] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.549 [2024-11-27 02:37:25.178660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178667] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc440) on tqpair=0xc632f0 00:26:00.549 [2024-11-27 02:37:25.178686] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178695] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178702] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc632f0) 00:26:00.549 [2024-11-27 02:37:25.178714] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.549 [2024-11-27 02:37:25.178747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc440, cid 4, qid 0 00:26:00.549 [2024-11-27 02:37:25.178856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.549 [2024-11-27 02:37:25.178873] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.549 [2024-11-27 02:37:25.178880] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178888] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc632f0): datao=0, datal=3072, cccid=4 00:26:00.549 [2024-11-27 02:37:25.178907] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xcbc440) on tqpair(0xc632f0): expected_datao=0, payload_size=3072 00:26:00.549 [2024-11-27 02:37:25.178923] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178931] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178943] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.549 [2024-11-27 02:37:25.178954] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.549 [2024-11-27 02:37:25.178961] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178968] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc440) on tqpair=0xc632f0 00:26:00.549 [2024-11-27 02:37:25.178983] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178992] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.549 [2024-11-27 02:37:25.178999] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc632f0) 00:26:00.549 [2024-11-27 02:37:25.179010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.549 [2024-11-27 02:37:25.179042] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc440, cid 4, qid 0 00:26:00.812 [2024-11-27 02:37:25.179137] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.812 [2024-11-27 02:37:25.179154] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.812 [2024-11-27 02:37:25.179161] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.812 [2024-11-27 02:37:25.179168] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc632f0): datao=0, datal=8, cccid=4 00:26:00.812 [2024-11-27 02:37:25.179176] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xcbc440) on tqpair(0xc632f0): expected_datao=0, payload_size=8 00:26:00.812 [2024-11-27 02:37:25.179187] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.812 [2024-11-27 02:37:25.179195] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.812 [2024-11-27 02:37:25.223547] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.812 [2024-11-27 02:37:25.223567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.812 [2024-11-27 02:37:25.223591] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.812 [2024-11-27 02:37:25.223598] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc440) on tqpair=0xc632f0 00:26:00.812 ===================================================== 00:26:00.812 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:00.812 ===================================================== 00:26:00.812 Controller Capabilities/Features 00:26:00.812 ================================ 00:26:00.812 Vendor ID: 0000 00:26:00.812 Subsystem Vendor ID: 0000 00:26:00.812 Serial Number: .................... 00:26:00.812 Model Number: ........................................ 00:26:00.812 Firmware Version: 24.01.1 00:26:00.812 Recommended Arb Burst: 0 00:26:00.812 IEEE OUI Identifier: 00 00 00 00:26:00.812 Multi-path I/O 00:26:00.812 May have multiple subsystem ports: No 00:26:00.812 May have multiple controllers: No 00:26:00.812 Associated with SR-IOV VF: No 00:26:00.812 Max Data Transfer Size: 131072 00:26:00.812 Max Number of Namespaces: 0 00:26:00.812 Max Number of I/O Queues: 1024 00:26:00.812 NVMe Specification Version (VS): 1.3 00:26:00.812 NVMe Specification Version (Identify): 1.3 00:26:00.812 Maximum Queue Entries: 128 00:26:00.812 Contiguous Queues Required: Yes 00:26:00.812 Arbitration Mechanisms Supported 00:26:00.812 Weighted Round Robin: Not Supported 00:26:00.812 Vendor Specific: Not Supported 00:26:00.812 Reset Timeout: 15000 ms 00:26:00.812 Doorbell Stride: 4 bytes 00:26:00.812 NVM Subsystem Reset: Not Supported 00:26:00.812 Command Sets Supported 00:26:00.812 NVM Command Set: Supported 00:26:00.812 Boot Partition: Not Supported 00:26:00.812 Memory Page Size Minimum: 4096 bytes 00:26:00.812 Memory Page Size Maximum: 4096 bytes 00:26:00.812 Persistent Memory Region: Not Supported 00:26:00.812 Optional Asynchronous Events Supported 00:26:00.812 Namespace Attribute Notices: Not Supported 00:26:00.812 Firmware Activation Notices: Not Supported 00:26:00.812 ANA Change Notices: Not Supported 00:26:00.812 PLE Aggregate Log Change Notices: Not Supported 00:26:00.812 LBA Status Info Alert Notices: Not Supported 00:26:00.812 EGE Aggregate Log Change Notices: Not Supported 00:26:00.812 Normal NVM Subsystem Shutdown event: Not Supported 00:26:00.812 Zone Descriptor Change Notices: Not Supported 00:26:00.812 Discovery Log Change Notices: Supported 00:26:00.812 Controller Attributes 00:26:00.812 128-bit Host Identifier: Not Supported 00:26:00.812 Non-Operational Permissive Mode: Not Supported 00:26:00.812 NVM Sets: Not Supported 00:26:00.812 Read Recovery Levels: Not Supported 00:26:00.812 Endurance Groups: Not Supported 00:26:00.812 Predictable Latency Mode: Not Supported 00:26:00.812 Traffic Based Keep ALive: Not Supported 00:26:00.812 Namespace Granularity: Not Supported 00:26:00.812 SQ Associations: Not Supported 00:26:00.812 UUID List: Not Supported 00:26:00.812 Multi-Domain Subsystem: Not Supported 00:26:00.812 Fixed Capacity Management: Not Supported 00:26:00.812 Variable Capacity Management: Not Supported 00:26:00.812 Delete Endurance Group: Not Supported 00:26:00.812 Delete NVM Set: Not Supported 00:26:00.812 Extended LBA Formats Supported: Not Supported 00:26:00.813 Flexible Data Placement Supported: Not Supported 00:26:00.813 00:26:00.813 Controller Memory Buffer Support 00:26:00.813 ================================ 00:26:00.813 Supported: No 00:26:00.813 00:26:00.813 Persistent Memory Region Support 00:26:00.813 ================================ 00:26:00.813 Supported: No 00:26:00.813 00:26:00.813 Admin Command Set Attributes 00:26:00.813 ============================ 00:26:00.813 Security Send/Receive: Not Supported 00:26:00.813 Format NVM: Not Supported 00:26:00.813 Firmware Activate/Download: Not Supported 00:26:00.813 Namespace Management: Not Supported 00:26:00.813 Device Self-Test: Not Supported 00:26:00.813 Directives: Not Supported 00:26:00.813 NVMe-MI: Not Supported 00:26:00.813 Virtualization Management: Not Supported 00:26:00.813 Doorbell Buffer Config: Not Supported 00:26:00.813 Get LBA Status Capability: Not Supported 00:26:00.813 Command & Feature Lockdown Capability: Not Supported 00:26:00.813 Abort Command Limit: 1 00:26:00.813 Async Event Request Limit: 4 00:26:00.813 Number of Firmware Slots: N/A 00:26:00.813 Firmware Slot 1 Read-Only: N/A 00:26:00.813 Firmware Activation Without Reset: N/A 00:26:00.813 Multiple Update Detection Support: N/A 00:26:00.813 Firmware Update Granularity: No Information Provided 00:26:00.813 Per-Namespace SMART Log: No 00:26:00.813 Asymmetric Namespace Access Log Page: Not Supported 00:26:00.813 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:00.813 Command Effects Log Page: Not Supported 00:26:00.813 Get Log Page Extended Data: Supported 00:26:00.813 Telemetry Log Pages: Not Supported 00:26:00.813 Persistent Event Log Pages: Not Supported 00:26:00.813 Supported Log Pages Log Page: May Support 00:26:00.813 Commands Supported & Effects Log Page: Not Supported 00:26:00.813 Feature Identifiers & Effects Log Page:May Support 00:26:00.813 NVMe-MI Commands & Effects Log Page: May Support 00:26:00.813 Data Area 4 for Telemetry Log: Not Supported 00:26:00.813 Error Log Page Entries Supported: 128 00:26:00.813 Keep Alive: Not Supported 00:26:00.813 00:26:00.813 NVM Command Set Attributes 00:26:00.813 ========================== 00:26:00.813 Submission Queue Entry Size 00:26:00.813 Max: 1 00:26:00.813 Min: 1 00:26:00.813 Completion Queue Entry Size 00:26:00.813 Max: 1 00:26:00.813 Min: 1 00:26:00.813 Number of Namespaces: 0 00:26:00.813 Compare Command: Not Supported 00:26:00.813 Write Uncorrectable Command: Not Supported 00:26:00.813 Dataset Management Command: Not Supported 00:26:00.813 Write Zeroes Command: Not Supported 00:26:00.813 Set Features Save Field: Not Supported 00:26:00.813 Reservations: Not Supported 00:26:00.813 Timestamp: Not Supported 00:26:00.813 Copy: Not Supported 00:26:00.813 Volatile Write Cache: Not Present 00:26:00.813 Atomic Write Unit (Normal): 1 00:26:00.813 Atomic Write Unit (PFail): 1 00:26:00.813 Atomic Compare & Write Unit: 1 00:26:00.813 Fused Compare & Write: Supported 00:26:00.813 Scatter-Gather List 00:26:00.813 SGL Command Set: Supported 00:26:00.813 SGL Keyed: Supported 00:26:00.813 SGL Bit Bucket Descriptor: Not Supported 00:26:00.813 SGL Metadata Pointer: Not Supported 00:26:00.813 Oversized SGL: Not Supported 00:26:00.813 SGL Metadata Address: Not Supported 00:26:00.813 SGL Offset: Supported 00:26:00.813 Transport SGL Data Block: Not Supported 00:26:00.813 Replay Protected Memory Block: Not Supported 00:26:00.813 00:26:00.813 Firmware Slot Information 00:26:00.813 ========================= 00:26:00.813 Active slot: 0 00:26:00.813 00:26:00.813 00:26:00.813 Error Log 00:26:00.813 ========= 00:26:00.813 00:26:00.813 Active Namespaces 00:26:00.813 ================= 00:26:00.813 Discovery Log Page 00:26:00.813 ================== 00:26:00.813 Generation Counter: 2 00:26:00.813 Number of Records: 2 00:26:00.813 Record Format: 0 00:26:00.813 00:26:00.813 Discovery Log Entry 0 00:26:00.813 ---------------------- 00:26:00.813 Transport Type: 3 (TCP) 00:26:00.813 Address Family: 1 (IPv4) 00:26:00.813 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:00.813 Entry Flags: 00:26:00.813 Duplicate Returned Information: 1 00:26:00.813 Explicit Persistent Connection Support for Discovery: 1 00:26:00.813 Transport Requirements: 00:26:00.813 Secure Channel: Not Required 00:26:00.813 Port ID: 0 (0x0000) 00:26:00.813 Controller ID: 65535 (0xffff) 00:26:00.813 Admin Max SQ Size: 128 00:26:00.813 Transport Service Identifier: 4420 00:26:00.813 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:00.813 Transport Address: 10.0.0.2 00:26:00.813 Discovery Log Entry 1 00:26:00.813 ---------------------- 00:26:00.813 Transport Type: 3 (TCP) 00:26:00.813 Address Family: 1 (IPv4) 00:26:00.813 Subsystem Type: 2 (NVM Subsystem) 00:26:00.813 Entry Flags: 00:26:00.813 Duplicate Returned Information: 0 00:26:00.813 Explicit Persistent Connection Support for Discovery: 0 00:26:00.813 Transport Requirements: 00:26:00.813 Secure Channel: Not Required 00:26:00.813 Port ID: 0 (0x0000) 00:26:00.813 Controller ID: 65535 (0xffff) 00:26:00.813 Admin Max SQ Size: 128 00:26:00.813 Transport Service Identifier: 4420 00:26:00.813 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:00.813 Transport Address: 10.0.0.2 [2024-11-27 02:37:25.223718] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:00.813 [2024-11-27 02:37:25.223748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.813 [2024-11-27 02:37:25.223763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.813 [2024-11-27 02:37:25.223773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.813 [2024-11-27 02:37:25.223783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.813 [2024-11-27 02:37:25.223798] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.223806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.223812] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.813 [2024-11-27 02:37:25.223824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.813 [2024-11-27 02:37:25.223850] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.813 [2024-11-27 02:37:25.223937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.813 [2024-11-27 02:37:25.223953] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.813 [2024-11-27 02:37:25.223965] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.223972] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.813 [2024-11-27 02:37:25.223985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.223993] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224000] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.813 [2024-11-27 02:37:25.224011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.813 [2024-11-27 02:37:25.224040] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.813 [2024-11-27 02:37:25.224172] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.813 [2024-11-27 02:37:25.224187] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.813 [2024-11-27 02:37:25.224194] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224202] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.813 [2024-11-27 02:37:25.224214] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:00.813 [2024-11-27 02:37:25.224223] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:00.813 [2024-11-27 02:37:25.224241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224250] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224257] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.813 [2024-11-27 02:37:25.224271] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.813 [2024-11-27 02:37:25.224293] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.813 [2024-11-27 02:37:25.224381] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.813 [2024-11-27 02:37:25.224396] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.813 [2024-11-27 02:37:25.224404] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224411] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.813 [2024-11-27 02:37:25.224429] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224441] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.813 [2024-11-27 02:37:25.224448] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.813 [2024-11-27 02:37:25.224459] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.224480] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.224578] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.224594] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.224601] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224608] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.224628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224645] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.224656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.224680] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.224754] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.224771] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.224778] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224785] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.224804] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224815] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.224832] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.224855] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.224932] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.224947] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.224954] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224961] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.224980] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224991] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.224997] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225008] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.225114] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.225128] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.225136] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225143] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.225162] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225172] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225179] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225212] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.225295] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.225310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.225317] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225324] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.225343] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225360] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225371] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225392] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.225467] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.225486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.225494] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225501] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.225522] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225544] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225551] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225565] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225589] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.225690] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.225705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.225713] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225720] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.225741] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225750] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225757] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225768] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225793] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.225868] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.225883] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.225891] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225898] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.225917] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225927] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.225934] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.225945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.225970] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.226050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.226066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.226073] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.226098] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226109] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226115] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.226126] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.226147] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.226229] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.226245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.226256] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226263] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.226282] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226293] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226300] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.226310] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.226332] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.226413] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.226428] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.226436] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.226462] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226472] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.226479] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.814 [2024-11-27 02:37:25.226490] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.814 [2024-11-27 02:37:25.226512] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.814 [2024-11-27 02:37:25.230540] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.814 [2024-11-27 02:37:25.230557] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.814 [2024-11-27 02:37:25.230564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.230571] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.814 [2024-11-27 02:37:25.230590] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.230601] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.814 [2024-11-27 02:37:25.230607] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc632f0) 00:26:00.815 [2024-11-27 02:37:25.230618] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.230640] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xcbc2e0, cid 3, qid 0 00:26:00.815 [2024-11-27 02:37:25.230760] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.230776] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.230783] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.230790] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xcbc2e0) on tqpair=0xc632f0 00:26:00.815 [2024-11-27 02:37:25.230806] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:26:00.815 00:26:00.815 02:37:25 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:00.815 [2024-11-27 02:37:25.261434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:00.815 [2024-11-27 02:37:25.261486] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2156854 ] 00:26:00.815 EAL: No free 2048 kB hugepages reported on node 1 00:26:00.815 [2024-11-27 02:37:25.295711] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:00.815 [2024-11-27 02:37:25.295758] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:00.815 [2024-11-27 02:37:25.295768] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:00.815 [2024-11-27 02:37:25.295783] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:00.815 [2024-11-27 02:37:25.295795] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:00.815 [2024-11-27 02:37:25.299593] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:00.815 [2024-11-27 02:37:25.299637] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1ae62f0 0 00:26:00.815 [2024-11-27 02:37:25.306550] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:00.815 [2024-11-27 02:37:25.306580] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:00.815 [2024-11-27 02:37:25.306588] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:00.815 [2024-11-27 02:37:25.306593] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:00.815 [2024-11-27 02:37:25.306630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.306642] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.306648] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.306661] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:00.815 [2024-11-27 02:37:25.306686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.314537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.314554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.314561] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.314587] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:00.815 [2024-11-27 02:37:25.314597] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:00.815 [2024-11-27 02:37:25.314606] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:00.815 [2024-11-27 02:37:25.314622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.314648] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.314671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.314820] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.314835] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.314842] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314848] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.314858] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:00.815 [2024-11-27 02:37:25.314871] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:00.815 [2024-11-27 02:37:25.314889] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314897] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.314903] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.314914] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.314935] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.315019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.315033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.315040] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.315056] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:00.815 [2024-11-27 02:37:25.315069] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315081] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315089] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315095] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.315105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.315126] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.315218] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.315230] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.315236] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315243] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.315252] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315267] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315280] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.315291] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.315311] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.315391] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.315405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.315412] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.315426] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:00.815 [2024-11-27 02:37:25.315435] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315557] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:00.815 [2024-11-27 02:37:25.315570] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315583] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315590] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315596] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.315607] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.315628] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.315756] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.315768] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.315774] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315780] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.815 [2024-11-27 02:37:25.315789] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:00.815 [2024-11-27 02:37:25.315805] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315813] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315819] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.815 [2024-11-27 02:37:25.315829] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.815 [2024-11-27 02:37:25.315849] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.815 [2024-11-27 02:37:25.315929] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.815 [2024-11-27 02:37:25.315943] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.815 [2024-11-27 02:37:25.315949] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.815 [2024-11-27 02:37:25.315956] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.315964] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:00.816 [2024-11-27 02:37:25.315972] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.315985] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:00.816 [2024-11-27 02:37:25.315999] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.316012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.816 [2024-11-27 02:37:25.316056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.816 [2024-11-27 02:37:25.316193] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.816 [2024-11-27 02:37:25.316207] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.816 [2024-11-27 02:37:25.316214] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316220] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=4096, cccid=0 00:26:00.816 [2024-11-27 02:37:25.316232] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3eec0) on tqpair(0x1ae62f0): expected_datao=0, payload_size=4096 00:26:00.816 [2024-11-27 02:37:25.316243] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316250] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316272] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.816 [2024-11-27 02:37:25.316285] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.816 [2024-11-27 02:37:25.316292] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316298] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.316309] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:00.816 [2024-11-27 02:37:25.316318] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:00.816 [2024-11-27 02:37:25.316325] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:00.816 [2024-11-27 02:37:25.316331] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:00.816 [2024-11-27 02:37:25.316338] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:00.816 [2024-11-27 02:37:25.316346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.316364] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.316378] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316385] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316391] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316402] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:00.816 [2024-11-27 02:37:25.316423] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.816 [2024-11-27 02:37:25.316552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.816 [2024-11-27 02:37:25.316567] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.816 [2024-11-27 02:37:25.316574] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316580] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3eec0) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.316592] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316599] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316605] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316615] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.816 [2024-11-27 02:37:25.316624] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316645] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.816 [2024-11-27 02:37:25.316654] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316661] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316667] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.816 [2024-11-27 02:37:25.316689] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316696] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316702] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316710] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.816 [2024-11-27 02:37:25.316718] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.316736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.316748] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316755] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.316761] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.316771] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.816 [2024-11-27 02:37:25.316808] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3eec0, cid 0, qid 0 00:26:00.816 [2024-11-27 02:37:25.316819] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f020, cid 1, qid 0 00:26:00.816 [2024-11-27 02:37:25.316826] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f180, cid 2, qid 0 00:26:00.816 [2024-11-27 02:37:25.316833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.816 [2024-11-27 02:37:25.316840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.816 [2024-11-27 02:37:25.317068] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.816 [2024-11-27 02:37:25.317081] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.816 [2024-11-27 02:37:25.317087] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317093] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.317102] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:00.816 [2024-11-27 02:37:25.317110] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.317124] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.317139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.317151] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.317174] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:00.816 [2024-11-27 02:37:25.317195] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.816 [2024-11-27 02:37:25.317321] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.816 [2024-11-27 02:37:25.317333] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.816 [2024-11-27 02:37:25.317339] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317349] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.317415] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.317433] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:00.816 [2024-11-27 02:37:25.317447] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317454] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317460] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.816 [2024-11-27 02:37:25.317470] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.816 [2024-11-27 02:37:25.317491] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.816 [2024-11-27 02:37:25.317628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.816 [2024-11-27 02:37:25.317644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.816 [2024-11-27 02:37:25.317651] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317657] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=4096, cccid=4 00:26:00.816 [2024-11-27 02:37:25.317664] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f440) on tqpair(0x1ae62f0): expected_datao=0, payload_size=4096 00:26:00.816 [2024-11-27 02:37:25.317682] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317691] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317720] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.816 [2024-11-27 02:37:25.317733] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.816 [2024-11-27 02:37:25.317740] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.816 [2024-11-27 02:37:25.317746] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.816 [2024-11-27 02:37:25.317768] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:00.817 [2024-11-27 02:37:25.317790] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.317808] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.317821] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.317828] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.317834] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.317844] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.317866] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.817 [2024-11-27 02:37:25.317966] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.817 [2024-11-27 02:37:25.317980] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.817 [2024-11-27 02:37:25.317986] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.317993] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=4096, cccid=4 00:26:00.817 [2024-11-27 02:37:25.318000] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f440) on tqpair(0x1ae62f0): expected_datao=0, payload_size=4096 00:26:00.817 [2024-11-27 02:37:25.318017] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318026] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.318062] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.318068] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318074] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.318099] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318118] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318131] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318138] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318145] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.318155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.318175] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.817 [2024-11-27 02:37:25.318267] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.817 [2024-11-27 02:37:25.318281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.817 [2024-11-27 02:37:25.318288] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318294] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=4096, cccid=4 00:26:00.817 [2024-11-27 02:37:25.318301] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f440) on tqpair(0x1ae62f0): expected_datao=0, payload_size=4096 00:26:00.817 [2024-11-27 02:37:25.318318] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318327] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318352] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.318363] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.318369] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318375] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.318390] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318404] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318420] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318431] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318440] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318448] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:00.817 [2024-11-27 02:37:25.318456] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:00.817 [2024-11-27 02:37:25.318465] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:00.817 [2024-11-27 02:37:25.318483] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318491] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.318500] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.318511] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.318522] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322540] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322547] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.322557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.817 [2024-11-27 02:37:25.322599] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.817 [2024-11-27 02:37:25.322612] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f5a0, cid 5, qid 0 00:26:00.817 [2024-11-27 02:37:25.322719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.322733] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.322740] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322747] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.322757] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.322767] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.322773] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322779] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f5a0) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.322795] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322804] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322810] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.322820] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.322840] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f5a0, cid 5, qid 0 00:26:00.817 [2024-11-27 02:37:25.322970] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.322984] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.322990] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.322996] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f5a0) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.323012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.323021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.323027] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.323037] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.323056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f5a0, cid 5, qid 0 00:26:00.817 [2024-11-27 02:37:25.323138] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.323150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.323156] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.323163] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f5a0) on tqpair=0x1ae62f0 00:26:00.817 [2024-11-27 02:37:25.323177] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.323185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.817 [2024-11-27 02:37:25.323191] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1ae62f0) 00:26:00.817 [2024-11-27 02:37:25.323205] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.817 [2024-11-27 02:37:25.323225] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f5a0, cid 5, qid 0 00:26:00.817 [2024-11-27 02:37:25.323300] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.817 [2024-11-27 02:37:25.323312] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.817 [2024-11-27 02:37:25.323319] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f5a0) on tqpair=0x1ae62f0 00:26:00.818 [2024-11-27 02:37:25.323344] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323359] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1ae62f0) 00:26:00.818 [2024-11-27 02:37:25.323369] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.818 [2024-11-27 02:37:25.323380] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323393] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1ae62f0) 00:26:00.818 [2024-11-27 02:37:25.323402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.818 [2024-11-27 02:37:25.323413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323420] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1ae62f0) 00:26:00.818 [2024-11-27 02:37:25.323435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.818 [2024-11-27 02:37:25.323446] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323453] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323459] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1ae62f0) 00:26:00.818 [2024-11-27 02:37:25.323468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.818 [2024-11-27 02:37:25.323490] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f5a0, cid 5, qid 0 00:26:00.818 [2024-11-27 02:37:25.323501] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f440, cid 4, qid 0 00:26:00.818 [2024-11-27 02:37:25.323508] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f700, cid 6, qid 0 00:26:00.818 [2024-11-27 02:37:25.323515] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f860, cid 7, qid 0 00:26:00.818 [2024-11-27 02:37:25.323711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.818 [2024-11-27 02:37:25.323726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.818 [2024-11-27 02:37:25.323733] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323739] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=8192, cccid=5 00:26:00.818 [2024-11-27 02:37:25.323747] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f5a0) on tqpair(0x1ae62f0): expected_datao=0, payload_size=8192 00:26:00.818 [2024-11-27 02:37:25.323769] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323778] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323791] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.818 [2024-11-27 02:37:25.323800] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.818 [2024-11-27 02:37:25.323806] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323812] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=512, cccid=4 00:26:00.818 [2024-11-27 02:37:25.323820] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f440) on tqpair(0x1ae62f0): expected_datao=0, payload_size=512 00:26:00.818 [2024-11-27 02:37:25.323830] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323836] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323844] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.818 [2024-11-27 02:37:25.323853] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.818 [2024-11-27 02:37:25.323859] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323865] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=512, cccid=6 00:26:00.818 [2024-11-27 02:37:25.323872] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f700) on tqpair(0x1ae62f0): expected_datao=0, payload_size=512 00:26:00.818 [2024-11-27 02:37:25.323882] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323889] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323897] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:00.818 [2024-11-27 02:37:25.323905] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:00.818 [2024-11-27 02:37:25.323911] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323917] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1ae62f0): datao=0, datal=4096, cccid=7 00:26:00.818 [2024-11-27 02:37:25.323924] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1b3f860) on tqpair(0x1ae62f0): expected_datao=0, payload_size=4096 00:26:00.818 [2024-11-27 02:37:25.323935] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323941] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323953] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.818 [2024-11-27 02:37:25.323962] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.818 [2024-11-27 02:37:25.323968] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.323975] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f5a0) on tqpair=0x1ae62f0 00:26:00.818 [2024-11-27 02:37:25.323995] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.818 [2024-11-27 02:37:25.324005] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.818 [2024-11-27 02:37:25.324011] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.324018] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f440) on tqpair=0x1ae62f0 00:26:00.818 [2024-11-27 02:37:25.324032] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.818 [2024-11-27 02:37:25.324042] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.818 [2024-11-27 02:37:25.324048] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.324054] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f700) on tqpair=0x1ae62f0 00:26:00.818 [2024-11-27 02:37:25.324066] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.818 [2024-11-27 02:37:25.324075] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.818 [2024-11-27 02:37:25.324081] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.818 [2024-11-27 02:37:25.324087] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f860) on tqpair=0x1ae62f0 00:26:00.818 ===================================================== 00:26:00.818 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:00.818 ===================================================== 00:26:00.818 Controller Capabilities/Features 00:26:00.818 ================================ 00:26:00.818 Vendor ID: 8086 00:26:00.818 Subsystem Vendor ID: 8086 00:26:00.818 Serial Number: SPDK00000000000001 00:26:00.818 Model Number: SPDK bdev Controller 00:26:00.818 Firmware Version: 24.01.1 00:26:00.818 Recommended Arb Burst: 6 00:26:00.818 IEEE OUI Identifier: e4 d2 5c 00:26:00.818 Multi-path I/O 00:26:00.818 May have multiple subsystem ports: Yes 00:26:00.818 May have multiple controllers: Yes 00:26:00.818 Associated with SR-IOV VF: No 00:26:00.818 Max Data Transfer Size: 131072 00:26:00.818 Max Number of Namespaces: 32 00:26:00.818 Max Number of I/O Queues: 127 00:26:00.818 NVMe Specification Version (VS): 1.3 00:26:00.818 NVMe Specification Version (Identify): 1.3 00:26:00.818 Maximum Queue Entries: 128 00:26:00.818 Contiguous Queues Required: Yes 00:26:00.818 Arbitration Mechanisms Supported 00:26:00.818 Weighted Round Robin: Not Supported 00:26:00.818 Vendor Specific: Not Supported 00:26:00.818 Reset Timeout: 15000 ms 00:26:00.818 Doorbell Stride: 4 bytes 00:26:00.818 NVM Subsystem Reset: Not Supported 00:26:00.818 Command Sets Supported 00:26:00.818 NVM Command Set: Supported 00:26:00.818 Boot Partition: Not Supported 00:26:00.818 Memory Page Size Minimum: 4096 bytes 00:26:00.818 Memory Page Size Maximum: 4096 bytes 00:26:00.818 Persistent Memory Region: Not Supported 00:26:00.818 Optional Asynchronous Events Supported 00:26:00.818 Namespace Attribute Notices: Supported 00:26:00.818 Firmware Activation Notices: Not Supported 00:26:00.818 ANA Change Notices: Not Supported 00:26:00.818 PLE Aggregate Log Change Notices: Not Supported 00:26:00.818 LBA Status Info Alert Notices: Not Supported 00:26:00.818 EGE Aggregate Log Change Notices: Not Supported 00:26:00.818 Normal NVM Subsystem Shutdown event: Not Supported 00:26:00.818 Zone Descriptor Change Notices: Not Supported 00:26:00.818 Discovery Log Change Notices: Not Supported 00:26:00.818 Controller Attributes 00:26:00.818 128-bit Host Identifier: Supported 00:26:00.818 Non-Operational Permissive Mode: Not Supported 00:26:00.818 NVM Sets: Not Supported 00:26:00.818 Read Recovery Levels: Not Supported 00:26:00.818 Endurance Groups: Not Supported 00:26:00.818 Predictable Latency Mode: Not Supported 00:26:00.818 Traffic Based Keep ALive: Not Supported 00:26:00.818 Namespace Granularity: Not Supported 00:26:00.818 SQ Associations: Not Supported 00:26:00.818 UUID List: Not Supported 00:26:00.818 Multi-Domain Subsystem: Not Supported 00:26:00.818 Fixed Capacity Management: Not Supported 00:26:00.818 Variable Capacity Management: Not Supported 00:26:00.818 Delete Endurance Group: Not Supported 00:26:00.818 Delete NVM Set: Not Supported 00:26:00.818 Extended LBA Formats Supported: Not Supported 00:26:00.818 Flexible Data Placement Supported: Not Supported 00:26:00.818 00:26:00.818 Controller Memory Buffer Support 00:26:00.818 ================================ 00:26:00.818 Supported: No 00:26:00.818 00:26:00.818 Persistent Memory Region Support 00:26:00.818 ================================ 00:26:00.818 Supported: No 00:26:00.818 00:26:00.818 Admin Command Set Attributes 00:26:00.818 ============================ 00:26:00.818 Security Send/Receive: Not Supported 00:26:00.818 Format NVM: Not Supported 00:26:00.819 Firmware Activate/Download: Not Supported 00:26:00.819 Namespace Management: Not Supported 00:26:00.819 Device Self-Test: Not Supported 00:26:00.819 Directives: Not Supported 00:26:00.819 NVMe-MI: Not Supported 00:26:00.819 Virtualization Management: Not Supported 00:26:00.819 Doorbell Buffer Config: Not Supported 00:26:00.819 Get LBA Status Capability: Not Supported 00:26:00.819 Command & Feature Lockdown Capability: Not Supported 00:26:00.819 Abort Command Limit: 4 00:26:00.819 Async Event Request Limit: 4 00:26:00.819 Number of Firmware Slots: N/A 00:26:00.819 Firmware Slot 1 Read-Only: N/A 00:26:00.819 Firmware Activation Without Reset: N/A 00:26:00.819 Multiple Update Detection Support: N/A 00:26:00.819 Firmware Update Granularity: No Information Provided 00:26:00.819 Per-Namespace SMART Log: No 00:26:00.819 Asymmetric Namespace Access Log Page: Not Supported 00:26:00.819 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:00.819 Command Effects Log Page: Supported 00:26:00.819 Get Log Page Extended Data: Supported 00:26:00.819 Telemetry Log Pages: Not Supported 00:26:00.819 Persistent Event Log Pages: Not Supported 00:26:00.819 Supported Log Pages Log Page: May Support 00:26:00.819 Commands Supported & Effects Log Page: Not Supported 00:26:00.819 Feature Identifiers & Effects Log Page:May Support 00:26:00.819 NVMe-MI Commands & Effects Log Page: May Support 00:26:00.819 Data Area 4 for Telemetry Log: Not Supported 00:26:00.819 Error Log Page Entries Supported: 128 00:26:00.819 Keep Alive: Supported 00:26:00.819 Keep Alive Granularity: 10000 ms 00:26:00.819 00:26:00.819 NVM Command Set Attributes 00:26:00.819 ========================== 00:26:00.819 Submission Queue Entry Size 00:26:00.819 Max: 64 00:26:00.819 Min: 64 00:26:00.819 Completion Queue Entry Size 00:26:00.819 Max: 16 00:26:00.819 Min: 16 00:26:00.819 Number of Namespaces: 32 00:26:00.819 Compare Command: Supported 00:26:00.819 Write Uncorrectable Command: Not Supported 00:26:00.819 Dataset Management Command: Supported 00:26:00.819 Write Zeroes Command: Supported 00:26:00.819 Set Features Save Field: Not Supported 00:26:00.819 Reservations: Supported 00:26:00.819 Timestamp: Not Supported 00:26:00.819 Copy: Supported 00:26:00.819 Volatile Write Cache: Present 00:26:00.819 Atomic Write Unit (Normal): 1 00:26:00.819 Atomic Write Unit (PFail): 1 00:26:00.819 Atomic Compare & Write Unit: 1 00:26:00.819 Fused Compare & Write: Supported 00:26:00.819 Scatter-Gather List 00:26:00.819 SGL Command Set: Supported 00:26:00.819 SGL Keyed: Supported 00:26:00.819 SGL Bit Bucket Descriptor: Not Supported 00:26:00.819 SGL Metadata Pointer: Not Supported 00:26:00.819 Oversized SGL: Not Supported 00:26:00.819 SGL Metadata Address: Not Supported 00:26:00.819 SGL Offset: Supported 00:26:00.819 Transport SGL Data Block: Not Supported 00:26:00.819 Replay Protected Memory Block: Not Supported 00:26:00.819 00:26:00.819 Firmware Slot Information 00:26:00.819 ========================= 00:26:00.819 Active slot: 1 00:26:00.819 Slot 1 Firmware Revision: 24.01.1 00:26:00.819 00:26:00.819 00:26:00.819 Commands Supported and Effects 00:26:00.819 ============================== 00:26:00.819 Admin Commands 00:26:00.819 -------------- 00:26:00.819 Get Log Page (02h): Supported 00:26:00.819 Identify (06h): Supported 00:26:00.819 Abort (08h): Supported 00:26:00.819 Set Features (09h): Supported 00:26:00.819 Get Features (0Ah): Supported 00:26:00.819 Asynchronous Event Request (0Ch): Supported 00:26:00.819 Keep Alive (18h): Supported 00:26:00.819 I/O Commands 00:26:00.819 ------------ 00:26:00.819 Flush (00h): Supported LBA-Change 00:26:00.819 Write (01h): Supported LBA-Change 00:26:00.819 Read (02h): Supported 00:26:00.819 Compare (05h): Supported 00:26:00.819 Write Zeroes (08h): Supported LBA-Change 00:26:00.819 Dataset Management (09h): Supported LBA-Change 00:26:00.819 Copy (19h): Supported LBA-Change 00:26:00.819 Unknown (79h): Supported LBA-Change 00:26:00.819 Unknown (7Ah): Supported 00:26:00.819 00:26:00.819 Error Log 00:26:00.819 ========= 00:26:00.819 00:26:00.819 Arbitration 00:26:00.819 =========== 00:26:00.819 Arbitration Burst: 1 00:26:00.819 00:26:00.819 Power Management 00:26:00.819 ================ 00:26:00.819 Number of Power States: 1 00:26:00.819 Current Power State: Power State #0 00:26:00.819 Power State #0: 00:26:00.819 Max Power: 0.00 W 00:26:00.819 Non-Operational State: Operational 00:26:00.819 Entry Latency: Not Reported 00:26:00.819 Exit Latency: Not Reported 00:26:00.819 Relative Read Throughput: 0 00:26:00.819 Relative Read Latency: 0 00:26:00.819 Relative Write Throughput: 0 00:26:00.819 Relative Write Latency: 0 00:26:00.819 Idle Power: Not Reported 00:26:00.819 Active Power: Not Reported 00:26:00.819 Non-Operational Permissive Mode: Not Supported 00:26:00.819 00:26:00.819 Health Information 00:26:00.819 ================== 00:26:00.819 Critical Warnings: 00:26:00.819 Available Spare Space: OK 00:26:00.819 Temperature: OK 00:26:00.819 Device Reliability: OK 00:26:00.819 Read Only: No 00:26:00.819 Volatile Memory Backup: OK 00:26:00.819 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:00.819 Temperature Threshold: [2024-11-27 02:37:25.324219] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324239] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1ae62f0) 00:26:00.819 [2024-11-27 02:37:25.324250] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.819 [2024-11-27 02:37:25.324271] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f860, cid 7, qid 0 00:26:00.819 [2024-11-27 02:37:25.324414] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.819 [2024-11-27 02:37:25.324426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.819 [2024-11-27 02:37:25.324433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324439] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f860) on tqpair=0x1ae62f0 00:26:00.819 [2024-11-27 02:37:25.324478] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:00.819 [2024-11-27 02:37:25.324499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.819 [2024-11-27 02:37:25.324510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.819 [2024-11-27 02:37:25.324520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.819 [2024-11-27 02:37:25.324538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.819 [2024-11-27 02:37:25.324552] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.819 [2024-11-27 02:37:25.324576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.819 [2024-11-27 02:37:25.324597] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.819 [2024-11-27 02:37:25.324711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.819 [2024-11-27 02:37:25.324724] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.819 [2024-11-27 02:37:25.324731] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324738] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.819 [2024-11-27 02:37:25.324750] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324757] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324763] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.819 [2024-11-27 02:37:25.324773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.819 [2024-11-27 02:37:25.324798] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.819 [2024-11-27 02:37:25.324901] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.819 [2024-11-27 02:37:25.324912] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.819 [2024-11-27 02:37:25.324919] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324925] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.819 [2024-11-27 02:37:25.324933] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:00.819 [2024-11-27 02:37:25.324941] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:00.819 [2024-11-27 02:37:25.324956] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324964] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.819 [2024-11-27 02:37:25.324974] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.819 [2024-11-27 02:37:25.324984] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.819 [2024-11-27 02:37:25.325005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.819 [2024-11-27 02:37:25.325135] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.819 [2024-11-27 02:37:25.325149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.325155] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325162] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.325179] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325188] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325194] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.325204] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.325224] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.325336] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.325350] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.325356] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325363] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.325380] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325388] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325395] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.325405] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.325425] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.325507] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.325521] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.325537] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325544] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.325562] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325570] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325576] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.325587] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.325608] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.325687] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.325698] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.325704] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325711] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.325727] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325735] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.325755] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.325775] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.325904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.325918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.325924] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325930] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.325947] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325956] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.325962] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.325972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.325991] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.326106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.326119] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.326126] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326132] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.326149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326158] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.326174] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.326193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.326269] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.326282] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.326289] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326295] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.326313] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326328] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.326338] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.326357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.326459] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.326473] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.326479] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326486] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.326502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326510] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.326516] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1ae62f0) 00:26:00.820 [2024-11-27 02:37:25.330534] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:00.820 [2024-11-27 02:37:25.330568] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1b3f2e0, cid 3, qid 0 00:26:00.820 [2024-11-27 02:37:25.330716] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:00.820 [2024-11-27 02:37:25.330730] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:00.820 [2024-11-27 02:37:25.330737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:00.820 [2024-11-27 02:37:25.330743] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1b3f2e0) on tqpair=0x1ae62f0 00:26:00.820 [2024-11-27 02:37:25.330757] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:26:00.820 0 Kelvin (-273 Celsius) 00:26:00.820 Available Spare: 0% 00:26:00.820 Available Spare Threshold: 0% 00:26:00.820 Life Percentage Used: 0% 00:26:00.820 Data Units Read: 0 00:26:00.820 Data Units Written: 0 00:26:00.820 Host Read Commands: 0 00:26:00.820 Host Write Commands: 0 00:26:00.820 Controller Busy Time: 0 minutes 00:26:00.820 Power Cycles: 0 00:26:00.820 Power On Hours: 0 hours 00:26:00.820 Unsafe Shutdowns: 0 00:26:00.820 Unrecoverable Media Errors: 0 00:26:00.820 Lifetime Error Log Entries: 0 00:26:00.820 Warning Temperature Time: 0 minutes 00:26:00.820 Critical Temperature Time: 0 minutes 00:26:00.820 00:26:00.820 Number of Queues 00:26:00.820 ================ 00:26:00.820 Number of I/O Submission Queues: 127 00:26:00.820 Number of I/O Completion Queues: 127 00:26:00.820 00:26:00.820 Active Namespaces 00:26:00.820 ================= 00:26:00.820 Namespace ID:1 00:26:00.820 Error Recovery Timeout: Unlimited 00:26:00.820 Command Set Identifier: NVM (00h) 00:26:00.820 Deallocate: Supported 00:26:00.820 Deallocated/Unwritten Error: Not Supported 00:26:00.820 Deallocated Read Value: Unknown 00:26:00.820 Deallocate in Write Zeroes: Not Supported 00:26:00.820 Deallocated Guard Field: 0xFFFF 00:26:00.820 Flush: Supported 00:26:00.820 Reservation: Supported 00:26:00.820 Namespace Sharing Capabilities: Multiple Controllers 00:26:00.820 Size (in LBAs): 131072 (0GiB) 00:26:00.820 Capacity (in LBAs): 131072 (0GiB) 00:26:00.820 Utilization (in LBAs): 131072 (0GiB) 00:26:00.820 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:00.820 EUI64: ABCDEF0123456789 00:26:00.820 UUID: ef888a74-2fb7-4923-9a20-cca8b185a376 00:26:00.820 Thin Provisioning: Not Supported 00:26:00.820 Per-NS Atomic Units: Yes 00:26:00.820 Atomic Boundary Size (Normal): 0 00:26:00.820 Atomic Boundary Size (PFail): 0 00:26:00.820 Atomic Boundary Offset: 0 00:26:00.820 Maximum Single Source Range Length: 65535 00:26:00.820 Maximum Copy Length: 65535 00:26:00.820 Maximum Source Range Count: 1 00:26:00.820 NGUID/EUI64 Never Reused: No 00:26:00.820 Namespace Write Protected: No 00:26:00.820 Number of LBA Formats: 1 00:26:00.820 Current LBA Format: LBA Format #00 00:26:00.820 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:00.820 00:26:00.820 02:37:25 -- host/identify.sh@51 -- # sync 00:26:00.820 02:37:25 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:00.820 02:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.820 02:37:25 -- common/autotest_common.sh@10 -- # set +x 00:26:00.820 02:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.820 02:37:25 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:00.821 02:37:25 -- host/identify.sh@56 -- # nvmftestfini 00:26:00.821 02:37:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:00.821 02:37:25 -- nvmf/common.sh@116 -- # sync 00:26:00.821 02:37:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:00.821 02:37:25 -- nvmf/common.sh@119 -- # set +e 00:26:00.821 02:37:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:00.821 02:37:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:00.821 rmmod nvme_tcp 00:26:00.821 rmmod nvme_fabrics 00:26:00.821 rmmod nvme_keyring 00:26:00.821 02:37:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:00.821 02:37:25 -- nvmf/common.sh@123 -- # set -e 00:26:00.821 02:37:25 -- nvmf/common.sh@124 -- # return 0 00:26:00.821 02:37:25 -- nvmf/common.sh@477 -- # '[' -n 2156582 ']' 00:26:00.821 02:37:25 -- nvmf/common.sh@478 -- # killprocess 2156582 00:26:00.821 02:37:25 -- common/autotest_common.sh@936 -- # '[' -z 2156582 ']' 00:26:00.821 02:37:25 -- common/autotest_common.sh@940 -- # kill -0 2156582 00:26:00.821 02:37:25 -- common/autotest_common.sh@941 -- # uname 00:26:00.821 02:37:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:00.821 02:37:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2156582 00:26:01.081 02:37:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:01.081 02:37:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:01.081 02:37:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2156582' 00:26:01.081 killing process with pid 2156582 00:26:01.081 02:37:25 -- common/autotest_common.sh@955 -- # kill 2156582 00:26:01.081 [2024-11-27 02:37:25.469831] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:01.081 02:37:25 -- common/autotest_common.sh@960 -- # wait 2156582 00:26:01.341 02:37:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:01.341 02:37:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:01.341 02:37:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:01.341 02:37:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:01.341 02:37:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:01.341 02:37:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.341 02:37:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.341 02:37:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.249 02:37:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:03.249 00:26:03.249 real 0m6.233s 00:26:03.249 user 0m7.395s 00:26:03.249 sys 0m1.906s 00:26:03.249 02:37:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:03.249 02:37:27 -- common/autotest_common.sh@10 -- # set +x 00:26:03.249 ************************************ 00:26:03.249 END TEST nvmf_identify 00:26:03.249 ************************************ 00:26:03.249 02:37:27 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:03.249 02:37:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.249 02:37:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.249 02:37:27 -- common/autotest_common.sh@10 -- # set +x 00:26:03.249 ************************************ 00:26:03.249 START TEST nvmf_perf 00:26:03.249 ************************************ 00:26:03.249 02:37:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:03.249 * Looking for test storage... 00:26:03.249 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.249 02:37:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.249 02:37:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.249 02:37:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:03.508 02:37:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:03.508 02:37:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:03.508 02:37:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:03.508 02:37:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:03.508 02:37:27 -- scripts/common.sh@335 -- # IFS=.-: 00:26:03.508 02:37:27 -- scripts/common.sh@335 -- # read -ra ver1 00:26:03.508 02:37:27 -- scripts/common.sh@336 -- # IFS=.-: 00:26:03.508 02:37:27 -- scripts/common.sh@336 -- # read -ra ver2 00:26:03.508 02:37:27 -- scripts/common.sh@337 -- # local 'op=<' 00:26:03.508 02:37:27 -- scripts/common.sh@339 -- # ver1_l=2 00:26:03.508 02:37:27 -- scripts/common.sh@340 -- # ver2_l=1 00:26:03.508 02:37:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:03.508 02:37:27 -- scripts/common.sh@343 -- # case "$op" in 00:26:03.508 02:37:27 -- scripts/common.sh@344 -- # : 1 00:26:03.508 02:37:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:03.508 02:37:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:03.508 02:37:27 -- scripts/common.sh@364 -- # decimal 1 00:26:03.508 02:37:27 -- scripts/common.sh@352 -- # local d=1 00:26:03.508 02:37:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:03.508 02:37:27 -- scripts/common.sh@354 -- # echo 1 00:26:03.508 02:37:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:03.508 02:37:27 -- scripts/common.sh@365 -- # decimal 2 00:26:03.508 02:37:27 -- scripts/common.sh@352 -- # local d=2 00:26:03.508 02:37:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:03.508 02:37:27 -- scripts/common.sh@354 -- # echo 2 00:26:03.508 02:37:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:03.508 02:37:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:03.508 02:37:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:03.508 02:37:27 -- scripts/common.sh@367 -- # return 0 00:26:03.508 02:37:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:03.508 02:37:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:03.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.508 --rc genhtml_branch_coverage=1 00:26:03.508 --rc genhtml_function_coverage=1 00:26:03.508 --rc genhtml_legend=1 00:26:03.508 --rc geninfo_all_blocks=1 00:26:03.508 --rc geninfo_unexecuted_blocks=1 00:26:03.508 00:26:03.508 ' 00:26:03.508 02:37:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:03.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.508 --rc genhtml_branch_coverage=1 00:26:03.508 --rc genhtml_function_coverage=1 00:26:03.508 --rc genhtml_legend=1 00:26:03.508 --rc geninfo_all_blocks=1 00:26:03.508 --rc geninfo_unexecuted_blocks=1 00:26:03.508 00:26:03.508 ' 00:26:03.508 02:37:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:03.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.508 --rc genhtml_branch_coverage=1 00:26:03.508 --rc genhtml_function_coverage=1 00:26:03.508 --rc genhtml_legend=1 00:26:03.508 --rc geninfo_all_blocks=1 00:26:03.508 --rc geninfo_unexecuted_blocks=1 00:26:03.508 00:26:03.508 ' 00:26:03.508 02:37:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:03.508 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.508 --rc genhtml_branch_coverage=1 00:26:03.508 --rc genhtml_function_coverage=1 00:26:03.508 --rc genhtml_legend=1 00:26:03.508 --rc geninfo_all_blocks=1 00:26:03.509 --rc geninfo_unexecuted_blocks=1 00:26:03.509 00:26:03.509 ' 00:26:03.509 02:37:27 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.509 02:37:27 -- nvmf/common.sh@7 -- # uname -s 00:26:03.509 02:37:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.509 02:37:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.509 02:37:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.509 02:37:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.509 02:37:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.509 02:37:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.509 02:37:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.509 02:37:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.509 02:37:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.509 02:37:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.509 02:37:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.509 02:37:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.509 02:37:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.509 02:37:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.509 02:37:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.509 02:37:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:03.509 02:37:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.509 02:37:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.509 02:37:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.509 02:37:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.509 02:37:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.509 02:37:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.509 02:37:27 -- paths/export.sh@5 -- # export PATH 00:26:03.509 02:37:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.509 02:37:27 -- nvmf/common.sh@46 -- # : 0 00:26:03.509 02:37:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:03.509 02:37:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:03.509 02:37:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:03.509 02:37:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.509 02:37:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.509 02:37:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:03.509 02:37:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:03.509 02:37:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:03.509 02:37:27 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:03.509 02:37:27 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:03.509 02:37:27 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:03.509 02:37:27 -- host/perf.sh@17 -- # nvmftestinit 00:26:03.509 02:37:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:03.509 02:37:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:03.509 02:37:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:03.509 02:37:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:03.509 02:37:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:03.509 02:37:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:03.509 02:37:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:03.509 02:37:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.509 02:37:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:03.509 02:37:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:03.509 02:37:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:03.509 02:37:27 -- common/autotest_common.sh@10 -- # set +x 00:26:05.416 02:37:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:05.416 02:37:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:05.416 02:37:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:05.416 02:37:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:05.416 02:37:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:05.416 02:37:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:05.416 02:37:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:05.416 02:37:30 -- nvmf/common.sh@294 -- # net_devs=() 00:26:05.416 02:37:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:05.416 02:37:30 -- nvmf/common.sh@295 -- # e810=() 00:26:05.416 02:37:30 -- nvmf/common.sh@295 -- # local -ga e810 00:26:05.416 02:37:30 -- nvmf/common.sh@296 -- # x722=() 00:26:05.416 02:37:30 -- nvmf/common.sh@296 -- # local -ga x722 00:26:05.416 02:37:30 -- nvmf/common.sh@297 -- # mlx=() 00:26:05.416 02:37:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:05.416 02:37:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:05.416 02:37:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:05.416 02:37:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:05.416 02:37:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.416 02:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:05.416 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:05.416 02:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.416 02:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:05.416 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:05.416 02:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.416 02:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.416 02:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.416 02:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:05.416 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:05.416 02:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.416 02:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.416 02:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.416 02:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.416 02:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:05.416 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:05.416 02:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.416 02:37:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:05.416 02:37:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:05.416 02:37:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:05.416 02:37:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:05.416 02:37:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:05.416 02:37:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:05.416 02:37:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:05.416 02:37:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:05.416 02:37:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:05.416 02:37:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:05.416 02:37:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:05.416 02:37:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:05.416 02:37:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:05.416 02:37:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:05.416 02:37:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:05.416 02:37:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:05.675 02:37:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:05.675 02:37:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:05.675 02:37:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:05.675 02:37:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:05.675 02:37:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:05.675 02:37:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:05.675 02:37:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:05.675 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:05.675 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.141 ms 00:26:05.675 00:26:05.675 --- 10.0.0.2 ping statistics --- 00:26:05.675 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.675 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:26:05.675 02:37:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:05.675 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:05.675 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:26:05.675 00:26:05.675 --- 10.0.0.1 ping statistics --- 00:26:05.675 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.675 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:26:05.675 02:37:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:05.675 02:37:30 -- nvmf/common.sh@410 -- # return 0 00:26:05.675 02:37:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:05.675 02:37:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:05.675 02:37:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:05.675 02:37:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:05.675 02:37:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:05.675 02:37:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:05.675 02:37:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:05.675 02:37:30 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:05.675 02:37:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:05.675 02:37:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:05.675 02:37:30 -- common/autotest_common.sh@10 -- # set +x 00:26:05.675 02:37:30 -- nvmf/common.sh@469 -- # nvmfpid=2158815 00:26:05.675 02:37:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:05.675 02:37:30 -- nvmf/common.sh@470 -- # waitforlisten 2158815 00:26:05.675 02:37:30 -- common/autotest_common.sh@829 -- # '[' -z 2158815 ']' 00:26:05.675 02:37:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.675 02:37:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.675 02:37:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.675 02:37:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.675 02:37:30 -- common/autotest_common.sh@10 -- # set +x 00:26:05.675 [2024-11-27 02:37:30.209996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:05.675 [2024-11-27 02:37:30.210096] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.675 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.675 [2024-11-27 02:37:30.280540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:05.935 [2024-11-27 02:37:30.371364] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.935 [2024-11-27 02:37:30.371543] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.935 [2024-11-27 02:37:30.371563] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.935 [2024-11-27 02:37:30.371576] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.935 [2024-11-27 02:37:30.371636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.935 [2024-11-27 02:37:30.371686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:05.935 [2024-11-27 02:37:30.371734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:05.935 [2024-11-27 02:37:30.371737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:06.872 02:37:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.872 02:37:31 -- common/autotest_common.sh@862 -- # return 0 00:26:06.872 02:37:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:06.872 02:37:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:06.872 02:37:31 -- common/autotest_common.sh@10 -- # set +x 00:26:06.872 02:37:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:06.872 02:37:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:06.872 02:37:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:10.252 02:37:34 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:10.252 02:37:34 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:10.252 02:37:34 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:10.252 02:37:34 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:10.252 02:37:34 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:10.252 02:37:34 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:10.252 02:37:34 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:10.252 02:37:34 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:10.252 02:37:34 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:10.510 [2024-11-27 02:37:35.100225] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:10.510 02:37:35 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:10.769 02:37:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:10.769 02:37:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:11.027 02:37:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:11.027 02:37:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:11.286 02:37:35 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:11.544 [2024-11-27 02:37:36.112007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:11.544 02:37:36 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:11.803 02:37:36 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:11.803 02:37:36 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:11.803 02:37:36 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:11.803 02:37:36 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:13.181 Initializing NVMe Controllers 00:26:13.181 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:13.181 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:13.181 Initialization complete. Launching workers. 00:26:13.181 ======================================================== 00:26:13.181 Latency(us) 00:26:13.181 Device Information : IOPS MiB/s Average min max 00:26:13.181 PCIE (0000:88:00.0) NSID 1 from core 0: 85563.91 334.23 373.35 43.32 8262.49 00:26:13.181 ======================================================== 00:26:13.181 Total : 85563.91 334.23 373.35 43.32 8262.49 00:26:13.181 00:26:13.181 02:37:37 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:13.181 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.558 Initializing NVMe Controllers 00:26:14.558 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:14.558 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:14.558 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:14.558 Initialization complete. Launching workers. 00:26:14.558 ======================================================== 00:26:14.558 Latency(us) 00:26:14.558 Device Information : IOPS MiB/s Average min max 00:26:14.558 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 89.00 0.35 11645.09 134.36 45783.13 00:26:14.558 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 54.00 0.21 19045.30 7034.77 48814.90 00:26:14.558 ======================================================== 00:26:14.558 Total : 143.00 0.56 14439.57 134.36 48814.90 00:26:14.558 00:26:14.558 02:37:38 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:14.558 EAL: No free 2048 kB hugepages reported on node 1 00:26:15.933 Initializing NVMe Controllers 00:26:15.933 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:15.933 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:15.933 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:15.933 Initialization complete. Launching workers. 00:26:15.933 ======================================================== 00:26:15.933 Latency(us) 00:26:15.933 Device Information : IOPS MiB/s Average min max 00:26:15.933 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8735.40 34.12 3663.26 560.93 7724.49 00:26:15.933 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3932.93 15.36 8140.10 5119.64 16185.37 00:26:15.933 ======================================================== 00:26:15.933 Total : 12668.32 49.49 5053.11 560.93 16185.37 00:26:15.933 00:26:15.933 02:37:40 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:15.933 02:37:40 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:15.933 02:37:40 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:15.933 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.474 Initializing NVMe Controllers 00:26:18.474 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.474 Controller IO queue size 128, less than required. 00:26:18.474 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.474 Controller IO queue size 128, less than required. 00:26:18.474 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.474 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:18.474 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:18.474 Initialization complete. Launching workers. 00:26:18.474 ======================================================== 00:26:18.474 Latency(us) 00:26:18.474 Device Information : IOPS MiB/s Average min max 00:26:18.474 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1724.94 431.23 74939.05 46798.57 110201.91 00:26:18.474 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 584.98 146.24 227701.94 68758.53 382137.86 00:26:18.474 ======================================================== 00:26:18.474 Total : 2309.92 577.48 113625.76 46798.57 382137.86 00:26:18.474 00:26:18.474 02:37:42 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:18.474 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.474 No valid NVMe controllers or AIO or URING devices found 00:26:18.474 Initializing NVMe Controllers 00:26:18.474 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.474 Controller IO queue size 128, less than required. 00:26:18.474 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.474 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:18.474 Controller IO queue size 128, less than required. 00:26:18.474 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:18.474 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:18.474 WARNING: Some requested NVMe devices were skipped 00:26:18.474 02:37:42 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:18.474 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.008 Initializing NVMe Controllers 00:26:21.008 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:21.008 Controller IO queue size 128, less than required. 00:26:21.008 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.008 Controller IO queue size 128, less than required. 00:26:21.008 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:21.008 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:21.008 Initialization complete. Launching workers. 00:26:21.008 00:26:21.008 ==================== 00:26:21.008 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:21.008 TCP transport: 00:26:21.008 polls: 8906 00:26:21.008 idle_polls: 6003 00:26:21.008 sock_completions: 2903 00:26:21.008 nvme_completions: 5435 00:26:21.008 submitted_requests: 8402 00:26:21.008 queued_requests: 1 00:26:21.008 00:26:21.008 ==================== 00:26:21.008 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:21.008 TCP transport: 00:26:21.008 polls: 12338 00:26:21.008 idle_polls: 8743 00:26:21.008 sock_completions: 3595 00:26:21.008 nvme_completions: 6232 00:26:21.008 submitted_requests: 9513 00:26:21.008 queued_requests: 1 00:26:21.008 ======================================================== 00:26:21.008 Latency(us) 00:26:21.008 Device Information : IOPS MiB/s Average min max 00:26:21.009 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1421.98 355.49 92666.00 56265.72 155849.92 00:26:21.009 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1620.90 405.23 79465.08 49652.35 112416.35 00:26:21.009 ======================================================== 00:26:21.009 Total : 3042.88 760.72 85634.04 49652.35 155849.92 00:26:21.009 00:26:21.009 02:37:45 -- host/perf.sh@66 -- # sync 00:26:21.009 02:37:45 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:21.267 02:37:45 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:21.267 02:37:45 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:21.267 02:37:45 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:25.451 02:37:49 -- host/perf.sh@72 -- # ls_guid=f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92 00:26:25.451 02:37:49 -- host/perf.sh@73 -- # get_lvs_free_mb f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92 00:26:25.451 02:37:49 -- common/autotest_common.sh@1353 -- # local lvs_uuid=f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92 00:26:25.451 02:37:49 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:25.451 02:37:49 -- common/autotest_common.sh@1355 -- # local fc 00:26:25.451 02:37:49 -- common/autotest_common.sh@1356 -- # local cs 00:26:25.451 02:37:49 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:25.451 02:37:49 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:25.451 { 00:26:25.451 "uuid": "f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92", 00:26:25.451 "name": "lvs_0", 00:26:25.451 "base_bdev": "Nvme0n1", 00:26:25.451 "total_data_clusters": 238234, 00:26:25.451 "free_clusters": 238234, 00:26:25.451 "block_size": 512, 00:26:25.451 "cluster_size": 4194304 00:26:25.451 } 00:26:25.451 ]' 00:26:25.451 02:37:49 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92") .free_clusters' 00:26:25.451 02:37:49 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:25.451 02:37:49 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92") .cluster_size' 00:26:25.451 02:37:49 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:25.451 02:37:49 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:25.451 02:37:49 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:25.451 952936 00:26:25.451 02:37:49 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:25.451 02:37:49 -- host/perf.sh@78 -- # free_mb=20480 00:26:25.451 02:37:49 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92 lbd_0 20480 00:26:25.451 02:37:49 -- host/perf.sh@80 -- # lb_guid=69ef61fa-8c63-493d-8be2-d1deaa49babf 00:26:25.451 02:37:49 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 69ef61fa-8c63-493d-8be2-d1deaa49babf lvs_n_0 00:26:26.385 02:37:50 -- host/perf.sh@83 -- # ls_nested_guid=be36d4fa-56c8-4ec4-a06c-93faa75eb8ec 00:26:26.385 02:37:50 -- host/perf.sh@84 -- # get_lvs_free_mb be36d4fa-56c8-4ec4-a06c-93faa75eb8ec 00:26:26.385 02:37:50 -- common/autotest_common.sh@1353 -- # local lvs_uuid=be36d4fa-56c8-4ec4-a06c-93faa75eb8ec 00:26:26.385 02:37:50 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:26.385 02:37:50 -- common/autotest_common.sh@1355 -- # local fc 00:26:26.385 02:37:50 -- common/autotest_common.sh@1356 -- # local cs 00:26:26.385 02:37:50 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:26.385 02:37:50 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:26.385 { 00:26:26.385 "uuid": "f7d4632c-de6e-41f6-ab8d-1cce6dbe5b92", 00:26:26.385 "name": "lvs_0", 00:26:26.385 "base_bdev": "Nvme0n1", 00:26:26.385 "total_data_clusters": 238234, 00:26:26.385 "free_clusters": 233114, 00:26:26.385 "block_size": 512, 00:26:26.385 "cluster_size": 4194304 00:26:26.385 }, 00:26:26.385 { 00:26:26.385 "uuid": "be36d4fa-56c8-4ec4-a06c-93faa75eb8ec", 00:26:26.385 "name": "lvs_n_0", 00:26:26.385 "base_bdev": "69ef61fa-8c63-493d-8be2-d1deaa49babf", 00:26:26.385 "total_data_clusters": 5114, 00:26:26.385 "free_clusters": 5114, 00:26:26.385 "block_size": 512, 00:26:26.385 "cluster_size": 4194304 00:26:26.385 } 00:26:26.385 ]' 00:26:26.385 02:37:50 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="be36d4fa-56c8-4ec4-a06c-93faa75eb8ec") .free_clusters' 00:26:26.643 02:37:51 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:26.643 02:37:51 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="be36d4fa-56c8-4ec4-a06c-93faa75eb8ec") .cluster_size' 00:26:26.643 02:37:51 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:26.643 02:37:51 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:26.643 02:37:51 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:26.643 20456 00:26:26.643 02:37:51 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:26.643 02:37:51 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u be36d4fa-56c8-4ec4-a06c-93faa75eb8ec lbd_nest_0 20456 00:26:26.902 02:37:51 -- host/perf.sh@88 -- # lb_nested_guid=65319651-6d16-4225-9b6e-f3e2bde04537 00:26:26.902 02:37:51 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:27.160 02:37:51 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:27.160 02:37:51 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 65319651-6d16-4225-9b6e-f3e2bde04537 00:26:27.417 02:37:51 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:27.675 02:37:52 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:27.675 02:37:52 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:27.675 02:37:52 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:27.675 02:37:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:27.675 02:37:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:27.675 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.869 Initializing NVMe Controllers 00:26:39.869 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:39.869 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:39.869 Initialization complete. Launching workers. 00:26:39.869 ======================================================== 00:26:39.869 Latency(us) 00:26:39.869 Device Information : IOPS MiB/s Average min max 00:26:39.869 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.70 0.02 21036.41 168.17 48565.10 00:26:39.869 ======================================================== 00:26:39.869 Total : 47.70 0.02 21036.41 168.17 48565.10 00:26:39.869 00:26:39.869 02:38:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:39.869 02:38:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:39.869 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.834 Initializing NVMe Controllers 00:26:49.834 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:49.834 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:49.834 Initialization complete. Launching workers. 00:26:49.834 ======================================================== 00:26:49.834 Latency(us) 00:26:49.834 Device Information : IOPS MiB/s Average min max 00:26:49.834 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.37 10.30 12139.65 5083.18 47845.65 00:26:49.834 ======================================================== 00:26:49.834 Total : 82.37 10.30 12139.65 5083.18 47845.65 00:26:49.834 00:26:49.834 02:38:12 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:49.834 02:38:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:49.834 02:38:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:49.834 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.797 Initializing NVMe Controllers 00:26:59.797 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:59.797 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:59.797 Initialization complete. Launching workers. 00:26:59.798 ======================================================== 00:26:59.798 Latency(us) 00:26:59.798 Device Information : IOPS MiB/s Average min max 00:26:59.798 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7873.20 3.84 4064.18 431.54 10579.77 00:26:59.798 ======================================================== 00:26:59.798 Total : 7873.20 3.84 4064.18 431.54 10579.77 00:26:59.798 00:26:59.798 02:38:23 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:59.798 02:38:23 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:59.798 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.766 Initializing NVMe Controllers 00:27:09.766 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:09.766 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:09.766 Initialization complete. Launching workers. 00:27:09.766 ======================================================== 00:27:09.766 Latency(us) 00:27:09.766 Device Information : IOPS MiB/s Average min max 00:27:09.766 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3395.70 424.46 9427.90 1437.67 20033.63 00:27:09.766 ======================================================== 00:27:09.766 Total : 3395.70 424.46 9427.90 1437.67 20033.63 00:27:09.766 00:27:09.766 02:38:33 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:09.766 02:38:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:09.766 02:38:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:09.766 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.833 Initializing NVMe Controllers 00:27:19.833 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:19.833 Controller IO queue size 128, less than required. 00:27:19.833 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:19.833 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:19.833 Initialization complete. Launching workers. 00:27:19.833 ======================================================== 00:27:19.833 Latency(us) 00:27:19.833 Device Information : IOPS MiB/s Average min max 00:27:19.833 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12064.70 5.89 10616.26 1756.78 23924.55 00:27:19.833 ======================================================== 00:27:19.833 Total : 12064.70 5.89 10616.26 1756.78 23924.55 00:27:19.833 00:27:19.833 02:38:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:19.833 02:38:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:19.833 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.800 Initializing NVMe Controllers 00:27:29.800 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:29.800 Controller IO queue size 128, less than required. 00:27:29.800 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:29.800 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:29.800 Initialization complete. Launching workers. 00:27:29.800 ======================================================== 00:27:29.800 Latency(us) 00:27:29.800 Device Information : IOPS MiB/s Average min max 00:27:29.800 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1172.60 146.58 110149.43 9861.32 246616.12 00:27:29.800 ======================================================== 00:27:29.800 Total : 1172.60 146.58 110149.43 9861.32 246616.12 00:27:29.800 00:27:29.800 02:38:54 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:30.058 02:38:54 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 65319651-6d16-4225-9b6e-f3e2bde04537 00:27:30.623 02:38:55 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:31.188 02:38:55 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 69ef61fa-8c63-493d-8be2-d1deaa49babf 00:27:31.447 02:38:55 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:31.705 02:38:56 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:31.705 02:38:56 -- host/perf.sh@114 -- # nvmftestfini 00:27:31.705 02:38:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:31.705 02:38:56 -- nvmf/common.sh@116 -- # sync 00:27:31.705 02:38:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:31.705 02:38:56 -- nvmf/common.sh@119 -- # set +e 00:27:31.705 02:38:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:31.705 02:38:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:31.705 rmmod nvme_tcp 00:27:31.705 rmmod nvme_fabrics 00:27:31.705 rmmod nvme_keyring 00:27:31.705 02:38:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:31.705 02:38:56 -- nvmf/common.sh@123 -- # set -e 00:27:31.705 02:38:56 -- nvmf/common.sh@124 -- # return 0 00:27:31.705 02:38:56 -- nvmf/common.sh@477 -- # '[' -n 2158815 ']' 00:27:31.705 02:38:56 -- nvmf/common.sh@478 -- # killprocess 2158815 00:27:31.705 02:38:56 -- common/autotest_common.sh@936 -- # '[' -z 2158815 ']' 00:27:31.705 02:38:56 -- common/autotest_common.sh@940 -- # kill -0 2158815 00:27:31.705 02:38:56 -- common/autotest_common.sh@941 -- # uname 00:27:31.705 02:38:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:31.705 02:38:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2158815 00:27:31.705 02:38:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:31.705 02:38:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:31.705 02:38:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2158815' 00:27:31.705 killing process with pid 2158815 00:27:31.705 02:38:56 -- common/autotest_common.sh@955 -- # kill 2158815 00:27:31.705 02:38:56 -- common/autotest_common.sh@960 -- # wait 2158815 00:27:33.604 02:38:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:33.604 02:38:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:33.604 02:38:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:33.604 02:38:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:33.604 02:38:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:33.604 02:38:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:33.604 02:38:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:33.604 02:38:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:35.505 02:38:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:35.505 00:27:35.505 real 1m32.099s 00:27:35.505 user 5m38.886s 00:27:35.505 sys 0m15.496s 00:27:35.505 02:38:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:35.505 02:38:59 -- common/autotest_common.sh@10 -- # set +x 00:27:35.505 ************************************ 00:27:35.505 END TEST nvmf_perf 00:27:35.505 ************************************ 00:27:35.505 02:38:59 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:35.505 02:38:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:35.505 02:38:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:35.505 02:38:59 -- common/autotest_common.sh@10 -- # set +x 00:27:35.505 ************************************ 00:27:35.505 START TEST nvmf_fio_host 00:27:35.505 ************************************ 00:27:35.505 02:38:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:35.505 * Looking for test storage... 00:27:35.505 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:35.505 02:38:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:35.505 02:38:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:35.505 02:38:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:35.505 02:39:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:35.505 02:39:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:35.505 02:39:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:35.505 02:39:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:35.505 02:39:00 -- scripts/common.sh@335 -- # IFS=.-: 00:27:35.505 02:39:00 -- scripts/common.sh@335 -- # read -ra ver1 00:27:35.505 02:39:00 -- scripts/common.sh@336 -- # IFS=.-: 00:27:35.505 02:39:00 -- scripts/common.sh@336 -- # read -ra ver2 00:27:35.505 02:39:00 -- scripts/common.sh@337 -- # local 'op=<' 00:27:35.505 02:39:00 -- scripts/common.sh@339 -- # ver1_l=2 00:27:35.505 02:39:00 -- scripts/common.sh@340 -- # ver2_l=1 00:27:35.505 02:39:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:35.505 02:39:00 -- scripts/common.sh@343 -- # case "$op" in 00:27:35.505 02:39:00 -- scripts/common.sh@344 -- # : 1 00:27:35.505 02:39:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:35.505 02:39:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:35.505 02:39:00 -- scripts/common.sh@364 -- # decimal 1 00:27:35.505 02:39:00 -- scripts/common.sh@352 -- # local d=1 00:27:35.505 02:39:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:35.505 02:39:00 -- scripts/common.sh@354 -- # echo 1 00:27:35.505 02:39:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:35.505 02:39:00 -- scripts/common.sh@365 -- # decimal 2 00:27:35.505 02:39:00 -- scripts/common.sh@352 -- # local d=2 00:27:35.505 02:39:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:35.505 02:39:00 -- scripts/common.sh@354 -- # echo 2 00:27:35.505 02:39:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:35.505 02:39:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:35.505 02:39:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:35.505 02:39:00 -- scripts/common.sh@367 -- # return 0 00:27:35.505 02:39:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:35.505 02:39:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:35.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.505 --rc genhtml_branch_coverage=1 00:27:35.505 --rc genhtml_function_coverage=1 00:27:35.505 --rc genhtml_legend=1 00:27:35.505 --rc geninfo_all_blocks=1 00:27:35.505 --rc geninfo_unexecuted_blocks=1 00:27:35.505 00:27:35.505 ' 00:27:35.505 02:39:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:35.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.505 --rc genhtml_branch_coverage=1 00:27:35.505 --rc genhtml_function_coverage=1 00:27:35.505 --rc genhtml_legend=1 00:27:35.505 --rc geninfo_all_blocks=1 00:27:35.505 --rc geninfo_unexecuted_blocks=1 00:27:35.505 00:27:35.505 ' 00:27:35.505 02:39:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:35.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.505 --rc genhtml_branch_coverage=1 00:27:35.506 --rc genhtml_function_coverage=1 00:27:35.506 --rc genhtml_legend=1 00:27:35.506 --rc geninfo_all_blocks=1 00:27:35.506 --rc geninfo_unexecuted_blocks=1 00:27:35.506 00:27:35.506 ' 00:27:35.506 02:39:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:35.506 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:35.506 --rc genhtml_branch_coverage=1 00:27:35.506 --rc genhtml_function_coverage=1 00:27:35.506 --rc genhtml_legend=1 00:27:35.506 --rc geninfo_all_blocks=1 00:27:35.506 --rc geninfo_unexecuted_blocks=1 00:27:35.506 00:27:35.506 ' 00:27:35.506 02:39:00 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:35.506 02:39:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:35.506 02:39:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:35.506 02:39:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:35.506 02:39:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@5 -- # export PATH 00:27:35.506 02:39:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:35.506 02:39:00 -- nvmf/common.sh@7 -- # uname -s 00:27:35.506 02:39:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:35.506 02:39:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:35.506 02:39:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:35.506 02:39:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:35.506 02:39:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:35.506 02:39:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:35.506 02:39:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:35.506 02:39:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:35.506 02:39:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:35.506 02:39:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:35.506 02:39:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:35.506 02:39:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:35.506 02:39:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:35.506 02:39:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:35.506 02:39:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:35.506 02:39:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:35.506 02:39:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:35.506 02:39:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:35.506 02:39:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:35.506 02:39:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- paths/export.sh@5 -- # export PATH 00:27:35.506 02:39:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:35.506 02:39:00 -- nvmf/common.sh@46 -- # : 0 00:27:35.506 02:39:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:35.506 02:39:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:35.506 02:39:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:35.506 02:39:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:35.506 02:39:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:35.506 02:39:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:35.506 02:39:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:35.506 02:39:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:35.506 02:39:00 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:35.506 02:39:00 -- host/fio.sh@14 -- # nvmftestinit 00:27:35.506 02:39:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:35.506 02:39:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:35.506 02:39:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:35.506 02:39:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:35.506 02:39:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:35.506 02:39:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:35.506 02:39:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:35.506 02:39:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:35.506 02:39:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:35.506 02:39:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:35.506 02:39:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:35.506 02:39:00 -- common/autotest_common.sh@10 -- # set +x 00:27:37.410 02:39:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:37.410 02:39:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:37.410 02:39:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:37.410 02:39:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:37.410 02:39:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:37.410 02:39:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:37.410 02:39:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:37.410 02:39:02 -- nvmf/common.sh@294 -- # net_devs=() 00:27:37.410 02:39:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:37.410 02:39:02 -- nvmf/common.sh@295 -- # e810=() 00:27:37.410 02:39:02 -- nvmf/common.sh@295 -- # local -ga e810 00:27:37.410 02:39:02 -- nvmf/common.sh@296 -- # x722=() 00:27:37.410 02:39:02 -- nvmf/common.sh@296 -- # local -ga x722 00:27:37.410 02:39:02 -- nvmf/common.sh@297 -- # mlx=() 00:27:37.410 02:39:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:37.410 02:39:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:37.410 02:39:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:37.410 02:39:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:37.410 02:39:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.410 02:39:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:37.410 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:37.410 02:39:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:37.410 02:39:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:37.410 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:37.410 02:39:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.410 02:39:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.410 02:39:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.410 02:39:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:37.410 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:37.410 02:39:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.410 02:39:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:37.410 02:39:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:37.410 02:39:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:37.410 02:39:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:37.410 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:37.410 02:39:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:37.410 02:39:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:37.410 02:39:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:37.410 02:39:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:37.410 02:39:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:37.410 02:39:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:37.410 02:39:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:37.410 02:39:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:37.410 02:39:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:37.410 02:39:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:37.410 02:39:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:37.410 02:39:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:37.410 02:39:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:37.410 02:39:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:37.410 02:39:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:37.668 02:39:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:37.668 02:39:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:37.668 02:39:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:37.668 02:39:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:37.668 02:39:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:37.668 02:39:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:37.668 02:39:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:37.668 02:39:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:37.668 02:39:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:37.668 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:37.668 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:27:37.668 00:27:37.668 --- 10.0.0.2 ping statistics --- 00:27:37.668 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.668 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:27:37.668 02:39:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:37.668 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:37.668 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:27:37.668 00:27:37.668 --- 10.0.0.1 ping statistics --- 00:27:37.668 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:37.668 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:27:37.668 02:39:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:37.668 02:39:02 -- nvmf/common.sh@410 -- # return 0 00:27:37.668 02:39:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:37.668 02:39:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:37.668 02:39:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:37.668 02:39:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:37.668 02:39:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:37.668 02:39:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:37.668 02:39:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:37.668 02:39:02 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:37.668 02:39:02 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:37.668 02:39:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:37.668 02:39:02 -- common/autotest_common.sh@10 -- # set +x 00:27:37.668 02:39:02 -- host/fio.sh@24 -- # nvmfpid=2171389 00:27:37.668 02:39:02 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:37.668 02:39:02 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:37.668 02:39:02 -- host/fio.sh@28 -- # waitforlisten 2171389 00:27:37.668 02:39:02 -- common/autotest_common.sh@829 -- # '[' -z 2171389 ']' 00:27:37.668 02:39:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:37.668 02:39:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:37.668 02:39:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:37.668 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:37.668 02:39:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:37.668 02:39:02 -- common/autotest_common.sh@10 -- # set +x 00:27:37.668 [2024-11-27 02:39:02.241988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:37.668 [2024-11-27 02:39:02.242068] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:37.668 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.926 [2024-11-27 02:39:02.307329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:37.926 [2024-11-27 02:39:02.397090] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:37.926 [2024-11-27 02:39:02.397241] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:37.926 [2024-11-27 02:39:02.397259] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:37.926 [2024-11-27 02:39:02.397271] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:37.926 [2024-11-27 02:39:02.397358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:37.926 [2024-11-27 02:39:02.397403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:37.926 [2024-11-27 02:39:02.397466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:37.926 [2024-11-27 02:39:02.397468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:38.858 02:39:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:38.858 02:39:03 -- common/autotest_common.sh@862 -- # return 0 00:27:38.858 02:39:03 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:38.858 [2024-11-27 02:39:03.462029] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:38.858 02:39:03 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:38.858 02:39:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:38.858 02:39:03 -- common/autotest_common.sh@10 -- # set +x 00:27:39.115 02:39:03 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:39.372 Malloc1 00:27:39.372 02:39:03 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:39.630 02:39:04 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:39.888 02:39:04 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:40.145 [2024-11-27 02:39:04.525313] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:40.145 02:39:04 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:40.403 02:39:04 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:40.403 02:39:04 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.403 02:39:04 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.403 02:39:04 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:40.403 02:39:04 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:40.403 02:39:04 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:40.403 02:39:04 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.403 02:39:04 -- common/autotest_common.sh@1330 -- # shift 00:27:40.403 02:39:04 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:40.403 02:39:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.403 02:39:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.403 02:39:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:40.403 02:39:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:40.403 02:39:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:40.403 02:39:04 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:40.403 02:39:04 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:40.403 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:40.403 fio-3.35 00:27:40.403 Starting 1 thread 00:27:40.661 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.188 00:27:43.188 test: (groupid=0, jobs=1): err= 0: pid=2171882: Wed Nov 27 02:39:07 2024 00:27:43.188 read: IOPS=9510, BW=37.2MiB/s (39.0MB/s)(74.5MiB/2006msec) 00:27:43.188 slat (usec): min=2, max=129, avg= 2.69, stdev= 1.78 00:27:43.188 clat (usec): min=2442, max=12372, avg=7411.37, stdev=544.06 00:27:43.188 lat (usec): min=2461, max=12374, avg=7414.06, stdev=543.98 00:27:43.188 clat percentiles (usec): 00:27:43.188 | 1.00th=[ 6194], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 6980], 00:27:43.188 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:27:43.188 | 70.00th=[ 7701], 80.00th=[ 7832], 90.00th=[ 8029], 95.00th=[ 8225], 00:27:43.188 | 99.00th=[ 8586], 99.50th=[ 8848], 99.90th=[10421], 99.95th=[11600], 00:27:43.188 | 99.99th=[12387] 00:27:43.188 bw ( KiB/s): min=36952, max=38768, per=99.96%, avg=38030.00, stdev=766.95, samples=4 00:27:43.188 iops : min= 9238, max= 9692, avg=9507.50, stdev=191.74, samples=4 00:27:43.188 write: IOPS=9520, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec); 0 zone resets 00:27:43.188 slat (usec): min=2, max=119, avg= 2.79, stdev= 1.68 00:27:43.188 clat (usec): min=1043, max=11981, avg=5984.69, stdev=492.99 00:27:43.188 lat (usec): min=1050, max=11984, avg=5987.48, stdev=492.97 00:27:43.188 clat percentiles (usec): 00:27:43.188 | 1.00th=[ 4948], 5.00th=[ 5276], 10.00th=[ 5473], 20.00th=[ 5604], 00:27:43.188 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:27:43.188 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6652], 00:27:43.188 | 99.00th=[ 7046], 99.50th=[ 7177], 99.90th=[10421], 99.95th=[11731], 00:27:43.188 | 99.99th=[11994] 00:27:43.189 bw ( KiB/s): min=37848, max=38304, per=99.97%, avg=38070.00, stdev=235.28, samples=4 00:27:43.189 iops : min= 9462, max= 9576, avg=9517.50, stdev=58.82, samples=4 00:27:43.189 lat (msec) : 2=0.03%, 4=0.11%, 10=99.74%, 20=0.12% 00:27:43.189 cpu : usr=64.49%, sys=33.57%, ctx=54, majf=0, minf=36 00:27:43.189 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:43.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:43.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:43.189 issued rwts: total=19079,19098,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:43.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:43.189 00:27:43.189 Run status group 0 (all jobs): 00:27:43.189 READ: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.5MiB (78.1MB), run=2006-2006msec 00:27:43.189 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:27:43.189 02:39:07 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:43.189 02:39:07 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:43.189 02:39:07 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:43.189 02:39:07 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:43.189 02:39:07 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:43.189 02:39:07 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:43.189 02:39:07 -- common/autotest_common.sh@1330 -- # shift 00:27:43.189 02:39:07 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:43.189 02:39:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:43.189 02:39:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:43.189 02:39:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:43.189 02:39:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:43.189 02:39:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:43.189 02:39:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:43.189 02:39:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:43.189 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:43.189 fio-3.35 00:27:43.189 Starting 1 thread 00:27:43.189 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.717 00:27:45.717 test: (groupid=0, jobs=1): err= 0: pid=2172475: Wed Nov 27 02:39:09 2024 00:27:45.717 read: IOPS=8698, BW=136MiB/s (143MB/s)(273MiB/2005msec) 00:27:45.717 slat (nsec): min=2991, max=94905, avg=3887.20, stdev=1926.81 00:27:45.717 clat (usec): min=253, max=19053, avg=8510.22, stdev=1953.38 00:27:45.717 lat (usec): min=263, max=19056, avg=8514.10, stdev=1953.46 00:27:45.717 clat percentiles (usec): 00:27:45.717 | 1.00th=[ 4621], 5.00th=[ 5407], 10.00th=[ 5932], 20.00th=[ 6718], 00:27:45.717 | 30.00th=[ 7308], 40.00th=[ 7898], 50.00th=[ 8455], 60.00th=[ 9110], 00:27:45.717 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[10945], 95.00th=[11469], 00:27:45.717 | 99.00th=[13042], 99.50th=[13698], 99.90th=[14877], 99.95th=[15008], 00:27:45.717 | 99.99th=[15795] 00:27:45.717 bw ( KiB/s): min=61056, max=80160, per=51.56%, avg=71760.00, stdev=8496.05, samples=4 00:27:45.717 iops : min= 3816, max= 5010, avg=4485.00, stdev=531.00, samples=4 00:27:45.717 write: IOPS=5185, BW=81.0MiB/s (85.0MB/s)(146MiB/1807msec); 0 zone resets 00:27:45.717 slat (usec): min=30, max=198, avg=35.02, stdev= 6.37 00:27:45.717 clat (usec): min=5841, max=20980, avg=10767.27, stdev=1897.38 00:27:45.717 lat (usec): min=5877, max=21016, avg=10802.28, stdev=1897.90 00:27:45.717 clat percentiles (usec): 00:27:45.717 | 1.00th=[ 7242], 5.00th=[ 8160], 10.00th=[ 8586], 20.00th=[ 9241], 00:27:45.717 | 30.00th=[ 9634], 40.00th=[10159], 50.00th=[10552], 60.00th=[10945], 00:27:45.717 | 70.00th=[11469], 80.00th=[12256], 90.00th=[13304], 95.00th=[14091], 00:27:45.717 | 99.00th=[16188], 99.50th=[16909], 99.90th=[18220], 99.95th=[19268], 00:27:45.717 | 99.99th=[21103] 00:27:45.717 bw ( KiB/s): min=64864, max=84096, per=90.35%, avg=74960.00, stdev=8652.10, samples=4 00:27:45.717 iops : min= 4054, max= 5256, avg=4685.00, stdev=540.76, samples=4 00:27:45.717 lat (usec) : 500=0.01% 00:27:45.717 lat (msec) : 4=0.17%, 10=61.19%, 20=38.63%, 50=0.01% 00:27:45.717 cpu : usr=77.96%, sys=20.80%, ctx=36, majf=0, minf=62 00:27:45.717 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:45.717 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:45.717 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:45.717 issued rwts: total=17441,9370,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:45.717 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:45.717 00:27:45.717 Run status group 0 (all jobs): 00:27:45.717 READ: bw=136MiB/s (143MB/s), 136MiB/s-136MiB/s (143MB/s-143MB/s), io=273MiB (286MB), run=2005-2005msec 00:27:45.717 WRITE: bw=81.0MiB/s (85.0MB/s), 81.0MiB/s-81.0MiB/s (85.0MB/s-85.0MB/s), io=146MiB (154MB), run=1807-1807msec 00:27:45.717 02:39:09 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:45.717 02:39:10 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:45.717 02:39:10 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:45.717 02:39:10 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:45.717 02:39:10 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:45.717 02:39:10 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:45.717 02:39:10 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:45.717 02:39:10 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:45.717 02:39:10 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:45.717 02:39:10 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:45.717 02:39:10 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:45.717 02:39:10 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:48.997 Nvme0n1 00:27:48.997 02:39:13 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:52.279 02:39:16 -- host/fio.sh@53 -- # ls_guid=089f438a-93bf-4118-85d7-2b90db5bd0f4 00:27:52.279 02:39:16 -- host/fio.sh@54 -- # get_lvs_free_mb 089f438a-93bf-4118-85d7-2b90db5bd0f4 00:27:52.279 02:39:16 -- common/autotest_common.sh@1353 -- # local lvs_uuid=089f438a-93bf-4118-85d7-2b90db5bd0f4 00:27:52.279 02:39:16 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:52.279 02:39:16 -- common/autotest_common.sh@1355 -- # local fc 00:27:52.279 02:39:16 -- common/autotest_common.sh@1356 -- # local cs 00:27:52.279 02:39:16 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:52.279 02:39:16 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:52.279 { 00:27:52.279 "uuid": "089f438a-93bf-4118-85d7-2b90db5bd0f4", 00:27:52.279 "name": "lvs_0", 00:27:52.279 "base_bdev": "Nvme0n1", 00:27:52.279 "total_data_clusters": 930, 00:27:52.279 "free_clusters": 930, 00:27:52.279 "block_size": 512, 00:27:52.279 "cluster_size": 1073741824 00:27:52.279 } 00:27:52.279 ]' 00:27:52.279 02:39:16 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="089f438a-93bf-4118-85d7-2b90db5bd0f4") .free_clusters' 00:27:52.279 02:39:16 -- common/autotest_common.sh@1358 -- # fc=930 00:27:52.279 02:39:16 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="089f438a-93bf-4118-85d7-2b90db5bd0f4") .cluster_size' 00:27:52.279 02:39:16 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:52.279 02:39:16 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:52.279 02:39:16 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:52.279 952320 00:27:52.279 02:39:16 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:52.537 27123b7a-b73c-4d62-a0d5-59d025534361 00:27:52.537 02:39:16 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:52.795 02:39:17 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:53.053 02:39:17 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:53.310 02:39:17 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:53.310 02:39:17 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:53.310 02:39:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:53.310 02:39:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:53.310 02:39:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:53.310 02:39:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:53.310 02:39:17 -- common/autotest_common.sh@1330 -- # shift 00:27:53.310 02:39:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:53.310 02:39:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:53.310 02:39:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:53.310 02:39:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:53.310 02:39:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:53.311 02:39:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:53.311 02:39:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:53.311 02:39:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:53.311 02:39:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:53.568 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:53.568 fio-3.35 00:27:53.568 Starting 1 thread 00:27:53.568 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.094 00:27:56.094 test: (groupid=0, jobs=1): err= 0: pid=2174121: Wed Nov 27 02:39:20 2024 00:27:56.094 read: IOPS=6199, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2007msec) 00:27:56.094 slat (usec): min=2, max=193, avg= 2.80, stdev= 2.64 00:27:56.094 clat (usec): min=1143, max=171050, avg=11307.93, stdev=11447.44 00:27:56.094 lat (usec): min=1147, max=171085, avg=11310.73, stdev=11447.84 00:27:56.094 clat percentiles (msec): 00:27:56.094 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:27:56.094 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:56.094 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:27:56.094 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:56.094 | 99.99th=[ 171] 00:27:56.094 bw ( KiB/s): min=17096, max=27544, per=99.81%, avg=24752.00, stdev=5107.89, samples=4 00:27:56.094 iops : min= 4274, max= 6886, avg=6188.00, stdev=1276.97, samples=4 00:27:56.094 write: IOPS=6190, BW=24.2MiB/s (25.4MB/s)(48.5MiB/2007msec); 0 zone resets 00:27:56.094 slat (usec): min=2, max=151, avg= 2.87, stdev= 2.14 00:27:56.094 clat (usec): min=298, max=168829, avg=9157.67, stdev=10748.35 00:27:56.094 lat (usec): min=301, max=168837, avg=9160.54, stdev=10748.72 00:27:56.094 clat percentiles (msec): 00:27:56.094 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:27:56.094 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:56.094 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:27:56.094 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:27:56.094 | 99.99th=[ 169] 00:27:56.094 bw ( KiB/s): min=18152, max=27200, per=99.87%, avg=24730.00, stdev=4391.66, samples=4 00:27:56.094 iops : min= 4538, max= 6800, avg=6182.50, stdev=1097.91, samples=4 00:27:56.094 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:56.094 lat (msec) : 2=0.02%, 4=0.14%, 10=63.86%, 20=35.44%, 250=0.51% 00:27:56.094 cpu : usr=63.81%, sys=34.65%, ctx=106, majf=0, minf=36 00:27:56.094 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:56.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:56.094 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:56.094 issued rwts: total=12443,12425,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:56.094 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:56.094 00:27:56.094 Run status group 0 (all jobs): 00:27:56.094 READ: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (51.0MB), run=2007-2007msec 00:27:56.094 WRITE: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.5MiB (50.9MB), run=2007-2007msec 00:27:56.094 02:39:20 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:56.352 02:39:20 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:57.286 02:39:21 -- host/fio.sh@64 -- # ls_nested_guid=80438540-4fef-443f-86c7-a8d73afed79e 00:27:57.286 02:39:21 -- host/fio.sh@65 -- # get_lvs_free_mb 80438540-4fef-443f-86c7-a8d73afed79e 00:27:57.286 02:39:21 -- common/autotest_common.sh@1353 -- # local lvs_uuid=80438540-4fef-443f-86c7-a8d73afed79e 00:27:57.286 02:39:21 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:57.286 02:39:21 -- common/autotest_common.sh@1355 -- # local fc 00:27:57.286 02:39:21 -- common/autotest_common.sh@1356 -- # local cs 00:27:57.286 02:39:21 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:57.544 02:39:22 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:57.544 { 00:27:57.544 "uuid": "089f438a-93bf-4118-85d7-2b90db5bd0f4", 00:27:57.544 "name": "lvs_0", 00:27:57.544 "base_bdev": "Nvme0n1", 00:27:57.544 "total_data_clusters": 930, 00:27:57.544 "free_clusters": 0, 00:27:57.544 "block_size": 512, 00:27:57.544 "cluster_size": 1073741824 00:27:57.544 }, 00:27:57.544 { 00:27:57.544 "uuid": "80438540-4fef-443f-86c7-a8d73afed79e", 00:27:57.544 "name": "lvs_n_0", 00:27:57.544 "base_bdev": "27123b7a-b73c-4d62-a0d5-59d025534361", 00:27:57.544 "total_data_clusters": 237847, 00:27:57.544 "free_clusters": 237847, 00:27:57.544 "block_size": 512, 00:27:57.544 "cluster_size": 4194304 00:27:57.544 } 00:27:57.544 ]' 00:27:57.544 02:39:22 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="80438540-4fef-443f-86c7-a8d73afed79e") .free_clusters' 00:27:57.544 02:39:22 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:57.544 02:39:22 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="80438540-4fef-443f-86c7-a8d73afed79e") .cluster_size' 00:27:57.801 02:39:22 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:57.801 02:39:22 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:57.801 02:39:22 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:57.801 951388 00:27:57.801 02:39:22 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:58.366 82f3825b-f6fa-423b-bb30-9791ddb2c0ae 00:27:58.366 02:39:22 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:58.624 02:39:23 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:58.881 02:39:23 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:59.139 02:39:23 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.139 02:39:23 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.139 02:39:23 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:59.139 02:39:23 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:59.139 02:39:23 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:59.139 02:39:23 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.139 02:39:23 -- common/autotest_common.sh@1330 -- # shift 00:27:59.139 02:39:23 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:59.139 02:39:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.139 02:39:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.139 02:39:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.139 02:39:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.139 02:39:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.139 02:39:23 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:59.139 02:39:23 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.397 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:59.397 fio-3.35 00:27:59.397 Starting 1 thread 00:27:59.397 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.926 00:28:01.926 test: (groupid=0, jobs=1): err= 0: pid=2174925: Wed Nov 27 02:39:26 2024 00:28:01.926 read: IOPS=6234, BW=24.4MiB/s (25.5MB/s)(48.9MiB/2008msec) 00:28:01.926 slat (nsec): min=1857, max=170350, avg=2460.71, stdev=2230.38 00:28:01.926 clat (usec): min=4140, max=18242, avg=11242.66, stdev=967.33 00:28:01.926 lat (usec): min=4150, max=18245, avg=11245.12, stdev=967.22 00:28:01.926 clat percentiles (usec): 00:28:01.926 | 1.00th=[ 8979], 5.00th=[ 9765], 10.00th=[10028], 20.00th=[10552], 00:28:01.926 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11207], 60.00th=[11469], 00:28:01.926 | 70.00th=[11731], 80.00th=[11994], 90.00th=[12387], 95.00th=[12780], 00:28:01.926 | 99.00th=[13304], 99.50th=[13566], 99.90th=[16319], 99.95th=[17171], 00:28:01.926 | 99.99th=[18220] 00:28:01.926 bw ( KiB/s): min=23464, max=25744, per=99.83%, avg=24896.00, stdev=1001.82, samples=4 00:28:01.926 iops : min= 5866, max= 6436, avg=6224.00, stdev=250.46, samples=4 00:28:01.926 write: IOPS=6227, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2008msec); 0 zone resets 00:28:01.926 slat (nsec): min=1937, max=133443, avg=2538.36, stdev=1628.42 00:28:01.926 clat (usec): min=2053, max=16994, avg=9107.11, stdev=838.82 00:28:01.926 lat (usec): min=2062, max=16996, avg=9109.65, stdev=838.79 00:28:01.926 clat percentiles (usec): 00:28:01.926 | 1.00th=[ 7242], 5.00th=[ 7832], 10.00th=[ 8160], 20.00th=[ 8455], 00:28:01.926 | 30.00th=[ 8717], 40.00th=[ 8848], 50.00th=[ 9110], 60.00th=[ 9241], 00:28:01.926 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10028], 95.00th=[10290], 00:28:01.926 | 99.00th=[10945], 99.50th=[11207], 99.90th=[15270], 99.95th=[16712], 00:28:01.926 | 99.99th=[16909] 00:28:01.926 bw ( KiB/s): min=24552, max=25112, per=99.95%, avg=24898.00, stdev=242.77, samples=4 00:28:01.926 iops : min= 6138, max= 6278, avg=6224.50, stdev=60.69, samples=4 00:28:01.926 lat (msec) : 4=0.04%, 10=48.63%, 20=51.33% 00:28:01.926 cpu : usr=64.42%, sys=34.08%, ctx=106, majf=0, minf=36 00:28:01.926 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:01.926 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:01.926 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:01.926 issued rwts: total=12519,12505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:01.926 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:01.926 00:28:01.926 Run status group 0 (all jobs): 00:28:01.926 READ: bw=24.4MiB/s (25.5MB/s), 24.4MiB/s-24.4MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.3MB), run=2008-2008msec 00:28:01.926 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.2MB), run=2008-2008msec 00:28:01.926 02:39:26 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:01.926 02:39:26 -- host/fio.sh@74 -- # sync 00:28:01.926 02:39:26 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:06.159 02:39:30 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:06.159 02:39:30 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:09.438 02:39:33 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:09.438 02:39:33 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:11.339 02:39:35 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:11.339 02:39:35 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:11.339 02:39:35 -- host/fio.sh@86 -- # nvmftestfini 00:28:11.339 02:39:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:11.339 02:39:35 -- nvmf/common.sh@116 -- # sync 00:28:11.339 02:39:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:11.339 02:39:35 -- nvmf/common.sh@119 -- # set +e 00:28:11.339 02:39:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:11.339 02:39:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:11.339 rmmod nvme_tcp 00:28:11.339 rmmod nvme_fabrics 00:28:11.339 rmmod nvme_keyring 00:28:11.339 02:39:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:11.339 02:39:35 -- nvmf/common.sh@123 -- # set -e 00:28:11.339 02:39:35 -- nvmf/common.sh@124 -- # return 0 00:28:11.339 02:39:35 -- nvmf/common.sh@477 -- # '[' -n 2171389 ']' 00:28:11.339 02:39:35 -- nvmf/common.sh@478 -- # killprocess 2171389 00:28:11.339 02:39:35 -- common/autotest_common.sh@936 -- # '[' -z 2171389 ']' 00:28:11.339 02:39:35 -- common/autotest_common.sh@940 -- # kill -0 2171389 00:28:11.339 02:39:35 -- common/autotest_common.sh@941 -- # uname 00:28:11.339 02:39:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:11.339 02:39:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2171389 00:28:11.339 02:39:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:11.339 02:39:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:11.339 02:39:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2171389' 00:28:11.339 killing process with pid 2171389 00:28:11.339 02:39:35 -- common/autotest_common.sh@955 -- # kill 2171389 00:28:11.339 02:39:35 -- common/autotest_common.sh@960 -- # wait 2171389 00:28:11.339 02:39:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:11.339 02:39:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:11.339 02:39:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:11.339 02:39:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:11.339 02:39:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:11.339 02:39:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:11.339 02:39:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:11.339 02:39:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:13.874 02:39:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:13.874 00:28:13.874 real 0m38.080s 00:28:13.874 user 2m26.903s 00:28:13.874 sys 0m6.690s 00:28:13.874 02:39:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:13.874 02:39:38 -- common/autotest_common.sh@10 -- # set +x 00:28:13.874 ************************************ 00:28:13.874 END TEST nvmf_fio_host 00:28:13.874 ************************************ 00:28:13.874 02:39:38 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:13.874 02:39:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:13.874 02:39:38 -- common/autotest_common.sh@10 -- # set +x 00:28:13.874 ************************************ 00:28:13.874 START TEST nvmf_failover 00:28:13.874 ************************************ 00:28:13.874 02:39:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:13.874 * Looking for test storage... 00:28:13.874 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:13.874 02:39:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:13.874 02:39:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:13.874 02:39:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:13.874 02:39:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:13.874 02:39:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:13.874 02:39:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:13.874 02:39:38 -- scripts/common.sh@335 -- # IFS=.-: 00:28:13.874 02:39:38 -- scripts/common.sh@335 -- # read -ra ver1 00:28:13.874 02:39:38 -- scripts/common.sh@336 -- # IFS=.-: 00:28:13.874 02:39:38 -- scripts/common.sh@336 -- # read -ra ver2 00:28:13.874 02:39:38 -- scripts/common.sh@337 -- # local 'op=<' 00:28:13.874 02:39:38 -- scripts/common.sh@339 -- # ver1_l=2 00:28:13.874 02:39:38 -- scripts/common.sh@340 -- # ver2_l=1 00:28:13.874 02:39:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:13.874 02:39:38 -- scripts/common.sh@343 -- # case "$op" in 00:28:13.874 02:39:38 -- scripts/common.sh@344 -- # : 1 00:28:13.874 02:39:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:13.874 02:39:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:13.874 02:39:38 -- scripts/common.sh@364 -- # decimal 1 00:28:13.874 02:39:38 -- scripts/common.sh@352 -- # local d=1 00:28:13.874 02:39:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:13.874 02:39:38 -- scripts/common.sh@354 -- # echo 1 00:28:13.874 02:39:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:13.874 02:39:38 -- scripts/common.sh@365 -- # decimal 2 00:28:13.874 02:39:38 -- scripts/common.sh@352 -- # local d=2 00:28:13.874 02:39:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:13.874 02:39:38 -- scripts/common.sh@354 -- # echo 2 00:28:13.874 02:39:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:13.874 02:39:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:13.874 02:39:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:13.874 02:39:38 -- scripts/common.sh@367 -- # return 0 00:28:13.874 02:39:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:13.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.874 --rc genhtml_branch_coverage=1 00:28:13.874 --rc genhtml_function_coverage=1 00:28:13.874 --rc genhtml_legend=1 00:28:13.874 --rc geninfo_all_blocks=1 00:28:13.874 --rc geninfo_unexecuted_blocks=1 00:28:13.874 00:28:13.874 ' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:13.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.874 --rc genhtml_branch_coverage=1 00:28:13.874 --rc genhtml_function_coverage=1 00:28:13.874 --rc genhtml_legend=1 00:28:13.874 --rc geninfo_all_blocks=1 00:28:13.874 --rc geninfo_unexecuted_blocks=1 00:28:13.874 00:28:13.874 ' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:13.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.874 --rc genhtml_branch_coverage=1 00:28:13.874 --rc genhtml_function_coverage=1 00:28:13.874 --rc genhtml_legend=1 00:28:13.874 --rc geninfo_all_blocks=1 00:28:13.874 --rc geninfo_unexecuted_blocks=1 00:28:13.874 00:28:13.874 ' 00:28:13.874 02:39:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:13.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.874 --rc genhtml_branch_coverage=1 00:28:13.874 --rc genhtml_function_coverage=1 00:28:13.874 --rc genhtml_legend=1 00:28:13.874 --rc geninfo_all_blocks=1 00:28:13.874 --rc geninfo_unexecuted_blocks=1 00:28:13.874 00:28:13.874 ' 00:28:13.874 02:39:38 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:13.874 02:39:38 -- nvmf/common.sh@7 -- # uname -s 00:28:13.874 02:39:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:13.874 02:39:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:13.874 02:39:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:13.874 02:39:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:13.874 02:39:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:13.874 02:39:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:13.874 02:39:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:13.874 02:39:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:13.874 02:39:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:13.874 02:39:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:13.874 02:39:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.874 02:39:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.874 02:39:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:13.874 02:39:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:13.874 02:39:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:13.874 02:39:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.874 02:39:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.874 02:39:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.874 02:39:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.874 02:39:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.874 02:39:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.874 02:39:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.874 02:39:38 -- paths/export.sh@5 -- # export PATH 00:28:13.874 02:39:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.874 02:39:38 -- nvmf/common.sh@46 -- # : 0 00:28:13.874 02:39:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:13.874 02:39:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:13.874 02:39:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:13.874 02:39:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:13.874 02:39:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:13.874 02:39:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:13.874 02:39:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:13.874 02:39:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:13.874 02:39:38 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:13.874 02:39:38 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:13.874 02:39:38 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:13.874 02:39:38 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:13.874 02:39:38 -- host/failover.sh@18 -- # nvmftestinit 00:28:13.874 02:39:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:13.874 02:39:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:13.874 02:39:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:13.874 02:39:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:13.874 02:39:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:13.874 02:39:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:13.875 02:39:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:13.875 02:39:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:13.875 02:39:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:13.875 02:39:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:13.875 02:39:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:13.875 02:39:38 -- common/autotest_common.sh@10 -- # set +x 00:28:15.781 02:39:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:15.781 02:39:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:15.781 02:39:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:15.781 02:39:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:15.781 02:39:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:15.781 02:39:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:15.781 02:39:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:15.781 02:39:40 -- nvmf/common.sh@294 -- # net_devs=() 00:28:15.781 02:39:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:15.781 02:39:40 -- nvmf/common.sh@295 -- # e810=() 00:28:15.781 02:39:40 -- nvmf/common.sh@295 -- # local -ga e810 00:28:15.781 02:39:40 -- nvmf/common.sh@296 -- # x722=() 00:28:15.781 02:39:40 -- nvmf/common.sh@296 -- # local -ga x722 00:28:15.782 02:39:40 -- nvmf/common.sh@297 -- # mlx=() 00:28:15.782 02:39:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:15.782 02:39:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:15.782 02:39:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.782 02:39:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:15.782 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:15.782 02:39:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.782 02:39:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:15.782 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:15.782 02:39:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.782 02:39:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.782 02:39:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.782 02:39:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:15.782 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:15.782 02:39:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.782 02:39:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.782 02:39:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.782 02:39:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:15.782 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:15.782 02:39:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:15.782 02:39:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:15.782 02:39:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:15.782 02:39:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:15.782 02:39:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:15.782 02:39:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:15.782 02:39:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:15.782 02:39:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:15.782 02:39:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:15.782 02:39:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:15.782 02:39:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:15.782 02:39:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:15.782 02:39:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:15.782 02:39:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:15.782 02:39:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:15.782 02:39:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:15.782 02:39:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:15.782 02:39:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:15.782 02:39:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:15.782 02:39:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:15.782 02:39:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:15.782 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:15.782 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:28:15.782 00:28:15.782 --- 10.0.0.2 ping statistics --- 00:28:15.782 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.782 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:28:15.782 02:39:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:15.782 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:15.782 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:28:15.782 00:28:15.782 --- 10.0.0.1 ping statistics --- 00:28:15.782 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.782 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:28:15.782 02:39:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:15.782 02:39:40 -- nvmf/common.sh@410 -- # return 0 00:28:15.782 02:39:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:15.782 02:39:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:15.782 02:39:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:15.782 02:39:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:15.782 02:39:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:15.782 02:39:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:15.782 02:39:40 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:15.782 02:39:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:15.782 02:39:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:15.782 02:39:40 -- common/autotest_common.sh@10 -- # set +x 00:28:15.782 02:39:40 -- nvmf/common.sh@469 -- # nvmfpid=2178233 00:28:15.782 02:39:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:15.782 02:39:40 -- nvmf/common.sh@470 -- # waitforlisten 2178233 00:28:15.782 02:39:40 -- common/autotest_common.sh@829 -- # '[' -z 2178233 ']' 00:28:15.782 02:39:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:15.782 02:39:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:15.782 02:39:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:15.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:15.782 02:39:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:15.782 02:39:40 -- common/autotest_common.sh@10 -- # set +x 00:28:15.782 [2024-11-27 02:39:40.412274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:15.782 [2024-11-27 02:39:40.412374] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:16.040 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.040 [2024-11-27 02:39:40.483124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:16.040 [2024-11-27 02:39:40.574231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:16.040 [2024-11-27 02:39:40.574401] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:16.040 [2024-11-27 02:39:40.574421] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:16.040 [2024-11-27 02:39:40.574435] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:16.040 [2024-11-27 02:39:40.574551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:16.040 [2024-11-27 02:39:40.574600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:16.040 [2024-11-27 02:39:40.574603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:16.972 02:39:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:16.972 02:39:41 -- common/autotest_common.sh@862 -- # return 0 00:28:16.972 02:39:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:16.972 02:39:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:16.972 02:39:41 -- common/autotest_common.sh@10 -- # set +x 00:28:16.972 02:39:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:16.972 02:39:41 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:17.230 [2024-11-27 02:39:41.629197] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:17.230 02:39:41 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:17.488 Malloc0 00:28:17.488 02:39:41 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:17.746 02:39:42 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:18.003 02:39:42 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:18.261 [2024-11-27 02:39:42.661177] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:18.261 02:39:42 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:18.517 [2024-11-27 02:39:42.913963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:18.517 02:39:42 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:18.773 [2024-11-27 02:39:43.182963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:18.773 02:39:43 -- host/failover.sh@31 -- # bdevperf_pid=2178666 00:28:18.774 02:39:43 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:18.774 02:39:43 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:18.774 02:39:43 -- host/failover.sh@34 -- # waitforlisten 2178666 /var/tmp/bdevperf.sock 00:28:18.774 02:39:43 -- common/autotest_common.sh@829 -- # '[' -z 2178666 ']' 00:28:18.774 02:39:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:18.774 02:39:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:18.774 02:39:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:18.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:18.774 02:39:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:18.774 02:39:43 -- common/autotest_common.sh@10 -- # set +x 00:28:19.705 02:39:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:19.705 02:39:44 -- common/autotest_common.sh@862 -- # return 0 00:28:19.705 02:39:44 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:19.963 NVMe0n1 00:28:19.963 02:39:44 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:20.221 00:28:20.222 02:39:44 -- host/failover.sh@39 -- # run_test_pid=2178814 00:28:20.222 02:39:44 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:20.222 02:39:44 -- host/failover.sh@41 -- # sleep 1 00:28:21.594 02:39:45 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:21.594 [2024-11-27 02:39:46.058602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.058993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 [2024-11-27 02:39:46.059153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b10180 is same with the state(5) to be set 00:28:21.594 02:39:46 -- host/failover.sh@45 -- # sleep 3 00:28:24.871 02:39:49 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:24.871 00:28:24.871 02:39:49 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:25.129 [2024-11-27 02:39:49.735883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.735946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.735970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.735982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.735994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 [2024-11-27 02:39:49.736494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b11530 is same with the state(5) to be set 00:28:25.129 02:39:49 -- host/failover.sh@50 -- # sleep 3 00:28:28.411 02:39:52 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.411 [2024-11-27 02:39:53.038056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:28.669 02:39:53 -- host/failover.sh@55 -- # sleep 1 00:28:29.601 02:39:54 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:29.859 [2024-11-27 02:39:54.294814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.294996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 [2024-11-27 02:39:54.295285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cc75e0 is same with the state(5) to be set 00:28:29.859 02:39:54 -- host/failover.sh@59 -- # wait 2178814 00:28:36.423 0 00:28:36.423 02:39:59 -- host/failover.sh@61 -- # killprocess 2178666 00:28:36.423 02:39:59 -- common/autotest_common.sh@936 -- # '[' -z 2178666 ']' 00:28:36.423 02:39:59 -- common/autotest_common.sh@940 -- # kill -0 2178666 00:28:36.423 02:39:59 -- common/autotest_common.sh@941 -- # uname 00:28:36.423 02:39:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:36.423 02:39:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2178666 00:28:36.423 02:40:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:36.423 02:40:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:36.423 02:40:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2178666' 00:28:36.423 killing process with pid 2178666 00:28:36.423 02:40:00 -- common/autotest_common.sh@955 -- # kill 2178666 00:28:36.423 02:40:00 -- common/autotest_common.sh@960 -- # wait 2178666 00:28:36.423 02:40:00 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:36.423 [2024-11-27 02:39:43.238590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:36.423 [2024-11-27 02:39:43.238675] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2178666 ] 00:28:36.423 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.423 [2024-11-27 02:39:43.298772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:36.423 [2024-11-27 02:39:43.382580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:36.423 Running I/O for 15 seconds... 00:28:36.423 [2024-11-27 02:39:46.059446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.423 [2024-11-27 02:39:46.059489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.423 [2024-11-27 02:39:46.059517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.423 [2024-11-27 02:39:46.059541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.423 [2024-11-27 02:39:46.059560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.423 [2024-11-27 02:39:46.059575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.423 [2024-11-27 02:39:46.059590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.423 [2024-11-27 02:39:46.059604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:117432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.059977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.059990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:117688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.424 [2024-11-27 02:39:46.060665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.424 [2024-11-27 02:39:46.060721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.424 [2024-11-27 02:39:46.060750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.424 [2024-11-27 02:39:46.060765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.060779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.060808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.060836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.060865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.060893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.060922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.060958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.060974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.060989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:117816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:117144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:117176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:117216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:117224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.425 [2024-11-27 02:39:46.061705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:117848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:117856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:117880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:117888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.425 [2024-11-27 02:39:46.061953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:117904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.425 [2024-11-27 02:39:46.061967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.061982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.061995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:117368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:117920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:117944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:117968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:117976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:118016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:118040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.426 [2024-11-27 02:39:46.062864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.062983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.062998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.426 [2024-11-27 02:39:46.063152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.426 [2024-11-27 02:39:46.063166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:46.063324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf1c70 is same with the state(5) to be set 00:28:36.427 [2024-11-27 02:39:46.063357] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:36.427 [2024-11-27 02:39:46.063369] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:36.427 [2024-11-27 02:39:46.063381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117664 len:8 PRP1 0x0 PRP2 0x0 00:28:36.427 [2024-11-27 02:39:46.063393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063460] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xcf1c70 was disconnected and freed. reset controller. 00:28:36.427 [2024-11-27 02:39:46.063487] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:36.427 [2024-11-27 02:39:46.063546] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.427 [2024-11-27 02:39:46.063567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.427 [2024-11-27 02:39:46.063596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.427 [2024-11-27 02:39:46.063623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.427 [2024-11-27 02:39:46.063652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:46.063667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:36.427 [2024-11-27 02:39:46.066039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:36.427 [2024-11-27 02:39:46.066079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd2600 (9): Bad file descriptor 00:28:36.427 [2024-11-27 02:39:46.182446] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:36.427 [2024-11-27 02:39:49.736679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:18248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:18264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:18280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:18304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:18328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.736958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:18344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.736986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:17760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:17776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:17784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:17824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:17848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:17896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:18384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.427 [2024-11-27 02:39:49.737327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:18392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.427 [2024-11-27 02:39:49.737354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:18400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.427 [2024-11-27 02:39:49.737409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:18416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.427 [2024-11-27 02:39:49.737436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.427 [2024-11-27 02:39:49.737450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:18424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.427 [2024-11-27 02:39:49.737463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:18440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:18448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:18464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:18472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:18496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:18504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:18512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:18520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.737921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:18544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:18552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.737984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.737999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:17904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:17944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:17952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:17968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:17984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:17992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:18568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:18584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:18600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.428 [2024-11-27 02:39:49.738373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:18616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.428 [2024-11-27 02:39:49.738428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.428 [2024-11-27 02:39:49.738442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:18624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.738455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:18640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:18664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:18672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.738652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:18680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:18704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.738774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:18712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:18720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:18728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.738909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:18008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:18040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.738966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.738992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:18048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:18072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:18096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:18104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:18128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:18736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:18744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:18752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:18768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:18784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:18800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:18816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:18824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.429 [2024-11-27 02:39:49.739575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:18832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:18144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:18176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.429 [2024-11-27 02:39:49.739734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:18184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.429 [2024-11-27 02:39:49.739748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.739776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.739816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.739858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:18840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.739896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:18848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.739924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:18856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.739956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.739970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:18864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.739985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:18872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:18888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:18896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:18904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:18912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:18920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:18928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:18936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:18952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:18960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:18968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:18976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:18984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:18992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.430 [2024-11-27 02:39:49.740443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:18288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:18312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:18336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:49.740670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdea90 is same with the state(5) to be set 00:28:36.430 [2024-11-27 02:39:49.740706] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:36.430 [2024-11-27 02:39:49.740724] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:36.430 [2024-11-27 02:39:49.740736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18352 len:8 PRP1 0x0 PRP2 0x0 00:28:36.430 [2024-11-27 02:39:49.740749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740822] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xcdea90 was disconnected and freed. reset controller. 00:28:36.430 [2024-11-27 02:39:49.740841] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:36.430 [2024-11-27 02:39:49.740892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.430 [2024-11-27 02:39:49.740912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740928] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.430 [2024-11-27 02:39:49.740942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.430 [2024-11-27 02:39:49.740969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.740983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.430 [2024-11-27 02:39:49.740997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.430 [2024-11-27 02:39:49.741011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:36.430 [2024-11-27 02:39:49.743367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:36.430 [2024-11-27 02:39:49.743409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd2600 (9): Bad file descriptor 00:28:36.430 [2024-11-27 02:39:49.856231] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:36.430 [2024-11-27 02:39:54.295416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.430 [2024-11-27 02:39:54.295458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:7568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:7592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:7608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:7616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:8256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:8264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:8280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:8320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:7632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:7640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.295979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:7656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.295993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:7688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:7696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:7728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:7776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:7792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:7832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:7840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:7864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:7880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:7904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:8344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:8384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:8400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:8408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.431 [2024-11-27 02:39:54.296592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:8416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.431 [2024-11-27 02:39:54.296622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:8424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.431 [2024-11-27 02:39:54.296651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:8432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:8440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.431 [2024-11-27 02:39:54.296711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.431 [2024-11-27 02:39:54.296727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.431 [2024-11-27 02:39:54.296742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:8456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:8464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.296800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:7920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:7928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:7976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:7984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.296976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.296992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:7992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:8000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:8480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:8488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:8496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:8504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:8512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:8520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:8536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:8552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:8032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:8056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:8192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:8200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:8568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.432 [2024-11-27 02:39:54.297768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:8584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.432 [2024-11-27 02:39:54.297855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.432 [2024-11-27 02:39:54.297885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.297906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.297920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:8608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.297934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.297949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:8616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.297962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.297977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:8624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.297990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:8640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:8648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:8656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:8664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:8672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:8680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:8696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:8704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:8712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:8720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:8728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:8744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:8760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:8768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:8776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:8784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:8792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:8800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:8808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:8816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:8824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:8840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:8848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.298879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:8856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:8872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.298984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.298999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:8880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.299014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.299030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:8888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.299044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.299059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:36.433 [2024-11-27 02:39:54.299073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.299088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.299103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.433 [2024-11-27 02:39:54.299125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:8208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.433 [2024-11-27 02:39:54.299140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:8216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:8232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:8240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:8248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:8272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:8296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:8312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:8328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:8360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:36.434 [2024-11-27 02:39:54.299591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf3c50 is same with the state(5) to be set 00:28:36.434 [2024-11-27 02:39:54.299625] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:36.434 [2024-11-27 02:39:54.299642] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:36.434 [2024-11-27 02:39:54.299655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8392 len:8 PRP1 0x0 PRP2 0x0 00:28:36.434 [2024-11-27 02:39:54.299669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299729] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xcf3c50 was disconnected and freed. reset controller. 00:28:36.434 [2024-11-27 02:39:54.299748] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:36.434 [2024-11-27 02:39:54.299784] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.434 [2024-11-27 02:39:54.299807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299835] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.434 [2024-11-27 02:39:54.299849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.434 [2024-11-27 02:39:54.299877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.434 [2024-11-27 02:39:54.299904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.434 [2024-11-27 02:39:54.299919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:36.434 [2024-11-27 02:39:54.302171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:36.434 [2024-11-27 02:39:54.302210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd2600 (9): Bad file descriptor 00:28:36.434 [2024-11-27 02:39:54.457985] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:36.434 00:28:36.434 Latency(us) 00:28:36.434 [2024-11-27T01:40:01.069Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:36.434 [2024-11-27T01:40:01.069Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:36.434 Verification LBA range: start 0x0 length 0x4000 00:28:36.434 NVMe0n1 : 15.01 12683.53 49.55 1514.45 0.00 8999.04 618.95 16311.18 00:28:36.434 [2024-11-27T01:40:01.069Z] =================================================================================================================== 00:28:36.434 [2024-11-27T01:40:01.069Z] Total : 12683.53 49.55 1514.45 0.00 8999.04 618.95 16311.18 00:28:36.434 Received shutdown signal, test time was about 15.000000 seconds 00:28:36.434 00:28:36.434 Latency(us) 00:28:36.434 [2024-11-27T01:40:01.069Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:36.434 [2024-11-27T01:40:01.069Z] =================================================================================================================== 00:28:36.434 [2024-11-27T01:40:01.069Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:36.434 02:40:00 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:36.434 02:40:00 -- host/failover.sh@65 -- # count=3 00:28:36.434 02:40:00 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:36.434 02:40:00 -- host/failover.sh@73 -- # bdevperf_pid=2180708 00:28:36.434 02:40:00 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:36.434 02:40:00 -- host/failover.sh@75 -- # waitforlisten 2180708 /var/tmp/bdevperf.sock 00:28:36.434 02:40:00 -- common/autotest_common.sh@829 -- # '[' -z 2180708 ']' 00:28:36.434 02:40:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:36.434 02:40:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:36.434 02:40:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:36.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:36.434 02:40:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:36.434 02:40:00 -- common/autotest_common.sh@10 -- # set +x 00:28:36.692 02:40:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:36.692 02:40:01 -- common/autotest_common.sh@862 -- # return 0 00:28:36.692 02:40:01 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:36.949 [2024-11-27 02:40:01.494697] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:36.949 02:40:01 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:37.206 [2024-11-27 02:40:01.743387] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:37.206 02:40:01 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:37.770 NVMe0n1 00:28:37.770 02:40:02 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:38.028 00:28:38.028 02:40:02 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:38.592 00:28:38.593 02:40:02 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:38.593 02:40:02 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:38.593 02:40:03 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:38.850 02:40:03 -- host/failover.sh@87 -- # sleep 3 00:28:42.129 02:40:06 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:42.129 02:40:06 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:42.129 02:40:06 -- host/failover.sh@90 -- # run_test_pid=2181408 00:28:42.129 02:40:06 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:42.129 02:40:06 -- host/failover.sh@92 -- # wait 2181408 00:28:43.502 0 00:28:43.502 02:40:07 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:43.502 [2024-11-27 02:40:00.293070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:43.502 [2024-11-27 02:40:00.293169] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2180708 ] 00:28:43.502 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.502 [2024-11-27 02:40:00.351613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:43.502 [2024-11-27 02:40:00.432931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:43.502 [2024-11-27 02:40:03.447888] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:43.502 [2024-11-27 02:40:03.447975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.502 [2024-11-27 02:40:03.448000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.502 [2024-11-27 02:40:03.448017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.502 [2024-11-27 02:40:03.448031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.502 [2024-11-27 02:40:03.448046] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.502 [2024-11-27 02:40:03.448060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.502 [2024-11-27 02:40:03.448074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.502 [2024-11-27 02:40:03.448088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.502 [2024-11-27 02:40:03.448112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.502 [2024-11-27 02:40:03.448150] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.502 [2024-11-27 02:40:03.448182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e4a600 (9): Bad file descriptor 00:28:43.502 [2024-11-27 02:40:03.500670] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.502 Running I/O for 1 seconds... 00:28:43.502 00:28:43.502 Latency(us) 00:28:43.502 [2024-11-27T01:40:08.137Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:43.502 [2024-11-27T01:40:08.137Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:43.502 Verification LBA range: start 0x0 length 0x4000 00:28:43.503 NVMe0n1 : 1.01 12811.75 50.05 0.00 0.00 9939.72 1165.08 15728.64 00:28:43.503 [2024-11-27T01:40:08.138Z] =================================================================================================================== 00:28:43.503 [2024-11-27T01:40:08.138Z] Total : 12811.75 50.05 0.00 0.00 9939.72 1165.08 15728.64 00:28:43.503 02:40:07 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:43.503 02:40:07 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:43.503 02:40:08 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:43.760 02:40:08 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:43.760 02:40:08 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:44.017 02:40:08 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.275 02:40:08 -- host/failover.sh@101 -- # sleep 3 00:28:47.653 02:40:11 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:47.653 02:40:11 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:47.653 02:40:12 -- host/failover.sh@108 -- # killprocess 2180708 00:28:47.653 02:40:12 -- common/autotest_common.sh@936 -- # '[' -z 2180708 ']' 00:28:47.653 02:40:12 -- common/autotest_common.sh@940 -- # kill -0 2180708 00:28:47.653 02:40:12 -- common/autotest_common.sh@941 -- # uname 00:28:47.653 02:40:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:47.653 02:40:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2180708 00:28:47.653 02:40:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:47.653 02:40:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:47.653 02:40:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2180708' 00:28:47.653 killing process with pid 2180708 00:28:47.653 02:40:12 -- common/autotest_common.sh@955 -- # kill 2180708 00:28:47.653 02:40:12 -- common/autotest_common.sh@960 -- # wait 2180708 00:28:47.910 02:40:12 -- host/failover.sh@110 -- # sync 00:28:47.911 02:40:12 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:48.168 02:40:12 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:48.168 02:40:12 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:48.168 02:40:12 -- host/failover.sh@116 -- # nvmftestfini 00:28:48.168 02:40:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:48.168 02:40:12 -- nvmf/common.sh@116 -- # sync 00:28:48.168 02:40:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:48.168 02:40:12 -- nvmf/common.sh@119 -- # set +e 00:28:48.168 02:40:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:48.168 02:40:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:48.168 rmmod nvme_tcp 00:28:48.168 rmmod nvme_fabrics 00:28:48.168 rmmod nvme_keyring 00:28:48.168 02:40:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:48.168 02:40:12 -- nvmf/common.sh@123 -- # set -e 00:28:48.168 02:40:12 -- nvmf/common.sh@124 -- # return 0 00:28:48.168 02:40:12 -- nvmf/common.sh@477 -- # '[' -n 2178233 ']' 00:28:48.168 02:40:12 -- nvmf/common.sh@478 -- # killprocess 2178233 00:28:48.168 02:40:12 -- common/autotest_common.sh@936 -- # '[' -z 2178233 ']' 00:28:48.168 02:40:12 -- common/autotest_common.sh@940 -- # kill -0 2178233 00:28:48.168 02:40:12 -- common/autotest_common.sh@941 -- # uname 00:28:48.168 02:40:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:48.168 02:40:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2178233 00:28:48.168 02:40:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:48.168 02:40:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:48.168 02:40:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2178233' 00:28:48.168 killing process with pid 2178233 00:28:48.169 02:40:12 -- common/autotest_common.sh@955 -- # kill 2178233 00:28:48.169 02:40:12 -- common/autotest_common.sh@960 -- # wait 2178233 00:28:48.427 02:40:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:48.427 02:40:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:48.427 02:40:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:48.427 02:40:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:48.427 02:40:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:48.427 02:40:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:48.427 02:40:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:48.428 02:40:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:50.961 02:40:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:50.962 00:28:50.962 real 0m37.037s 00:28:50.962 user 2m11.113s 00:28:50.962 sys 0m5.940s 00:28:50.962 02:40:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:50.962 02:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:50.962 ************************************ 00:28:50.962 END TEST nvmf_failover 00:28:50.962 ************************************ 00:28:50.962 02:40:15 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:50.962 02:40:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:50.962 02:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:50.962 ************************************ 00:28:50.962 START TEST nvmf_discovery 00:28:50.962 ************************************ 00:28:50.962 02:40:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:50.962 * Looking for test storage... 00:28:50.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:50.962 02:40:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:50.962 02:40:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:50.962 02:40:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:50.962 02:40:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:50.962 02:40:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:50.962 02:40:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:50.962 02:40:15 -- scripts/common.sh@335 -- # IFS=.-: 00:28:50.962 02:40:15 -- scripts/common.sh@335 -- # read -ra ver1 00:28:50.962 02:40:15 -- scripts/common.sh@336 -- # IFS=.-: 00:28:50.962 02:40:15 -- scripts/common.sh@336 -- # read -ra ver2 00:28:50.962 02:40:15 -- scripts/common.sh@337 -- # local 'op=<' 00:28:50.962 02:40:15 -- scripts/common.sh@339 -- # ver1_l=2 00:28:50.962 02:40:15 -- scripts/common.sh@340 -- # ver2_l=1 00:28:50.962 02:40:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:50.962 02:40:15 -- scripts/common.sh@343 -- # case "$op" in 00:28:50.962 02:40:15 -- scripts/common.sh@344 -- # : 1 00:28:50.962 02:40:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:50.962 02:40:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:50.962 02:40:15 -- scripts/common.sh@364 -- # decimal 1 00:28:50.962 02:40:15 -- scripts/common.sh@352 -- # local d=1 00:28:50.962 02:40:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:50.962 02:40:15 -- scripts/common.sh@354 -- # echo 1 00:28:50.962 02:40:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:50.962 02:40:15 -- scripts/common.sh@365 -- # decimal 2 00:28:50.962 02:40:15 -- scripts/common.sh@352 -- # local d=2 00:28:50.962 02:40:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:50.962 02:40:15 -- scripts/common.sh@354 -- # echo 2 00:28:50.962 02:40:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:50.962 02:40:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:50.962 02:40:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:50.962 02:40:15 -- scripts/common.sh@367 -- # return 0 00:28:50.962 02:40:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:50.962 --rc genhtml_branch_coverage=1 00:28:50.962 --rc genhtml_function_coverage=1 00:28:50.962 --rc genhtml_legend=1 00:28:50.962 --rc geninfo_all_blocks=1 00:28:50.962 --rc geninfo_unexecuted_blocks=1 00:28:50.962 00:28:50.962 ' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:50.962 --rc genhtml_branch_coverage=1 00:28:50.962 --rc genhtml_function_coverage=1 00:28:50.962 --rc genhtml_legend=1 00:28:50.962 --rc geninfo_all_blocks=1 00:28:50.962 --rc geninfo_unexecuted_blocks=1 00:28:50.962 00:28:50.962 ' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:50.962 --rc genhtml_branch_coverage=1 00:28:50.962 --rc genhtml_function_coverage=1 00:28:50.962 --rc genhtml_legend=1 00:28:50.962 --rc geninfo_all_blocks=1 00:28:50.962 --rc geninfo_unexecuted_blocks=1 00:28:50.962 00:28:50.962 ' 00:28:50.962 02:40:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:50.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:50.962 --rc genhtml_branch_coverage=1 00:28:50.962 --rc genhtml_function_coverage=1 00:28:50.962 --rc genhtml_legend=1 00:28:50.962 --rc geninfo_all_blocks=1 00:28:50.962 --rc geninfo_unexecuted_blocks=1 00:28:50.962 00:28:50.962 ' 00:28:50.962 02:40:15 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:50.962 02:40:15 -- nvmf/common.sh@7 -- # uname -s 00:28:50.962 02:40:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:50.962 02:40:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:50.962 02:40:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:50.962 02:40:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:50.962 02:40:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:50.962 02:40:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:50.962 02:40:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:50.962 02:40:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:50.962 02:40:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:50.962 02:40:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:50.962 02:40:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:50.962 02:40:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:50.962 02:40:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:50.962 02:40:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:50.962 02:40:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:50.962 02:40:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:50.962 02:40:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:50.962 02:40:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:50.962 02:40:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:50.962 02:40:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:50.962 02:40:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:50.962 02:40:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:50.962 02:40:15 -- paths/export.sh@5 -- # export PATH 00:28:50.962 02:40:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:50.962 02:40:15 -- nvmf/common.sh@46 -- # : 0 00:28:50.962 02:40:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:50.962 02:40:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:50.962 02:40:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:50.962 02:40:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:50.962 02:40:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:50.962 02:40:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:50.962 02:40:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:50.962 02:40:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:50.962 02:40:15 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:50.962 02:40:15 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:50.962 02:40:15 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:50.962 02:40:15 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:50.962 02:40:15 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:50.962 02:40:15 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:50.962 02:40:15 -- host/discovery.sh@25 -- # nvmftestinit 00:28:50.962 02:40:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:50.962 02:40:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:50.962 02:40:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:50.962 02:40:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:50.962 02:40:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:50.962 02:40:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:50.962 02:40:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:50.962 02:40:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:50.962 02:40:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:50.962 02:40:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:50.962 02:40:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:50.962 02:40:15 -- common/autotest_common.sh@10 -- # set +x 00:28:52.865 02:40:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:52.865 02:40:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:52.865 02:40:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:52.865 02:40:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:52.865 02:40:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:52.865 02:40:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:52.865 02:40:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:52.865 02:40:17 -- nvmf/common.sh@294 -- # net_devs=() 00:28:52.865 02:40:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:52.865 02:40:17 -- nvmf/common.sh@295 -- # e810=() 00:28:52.865 02:40:17 -- nvmf/common.sh@295 -- # local -ga e810 00:28:52.865 02:40:17 -- nvmf/common.sh@296 -- # x722=() 00:28:52.865 02:40:17 -- nvmf/common.sh@296 -- # local -ga x722 00:28:52.865 02:40:17 -- nvmf/common.sh@297 -- # mlx=() 00:28:52.865 02:40:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:52.865 02:40:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:52.865 02:40:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:52.865 02:40:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:52.865 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:52.865 02:40:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:52.865 02:40:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:52.865 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:52.865 02:40:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:52.865 02:40:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:52.865 02:40:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:52.865 02:40:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:52.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:52.865 02:40:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:52.865 02:40:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:52.865 02:40:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:52.865 02:40:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:52.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:52.865 02:40:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:52.865 02:40:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:52.865 02:40:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:52.865 02:40:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:52.865 02:40:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:52.865 02:40:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:52.865 02:40:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:52.865 02:40:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:52.865 02:40:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:52.865 02:40:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:52.865 02:40:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:52.865 02:40:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:52.865 02:40:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:52.865 02:40:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:52.865 02:40:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:52.865 02:40:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:52.865 02:40:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:52.865 02:40:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:52.865 02:40:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:52.865 02:40:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:52.865 02:40:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:52.865 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:52.865 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:28:52.865 00:28:52.865 --- 10.0.0.2 ping statistics --- 00:28:52.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:52.865 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:28:52.865 02:40:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:52.865 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:52.865 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:28:52.865 00:28:52.865 --- 10.0.0.1 ping statistics --- 00:28:52.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:52.865 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:28:52.865 02:40:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:52.865 02:40:17 -- nvmf/common.sh@410 -- # return 0 00:28:52.865 02:40:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:52.865 02:40:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:52.865 02:40:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:52.865 02:40:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:52.865 02:40:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:52.865 02:40:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:52.865 02:40:17 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:52.865 02:40:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:52.865 02:40:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:52.865 02:40:17 -- common/autotest_common.sh@10 -- # set +x 00:28:52.865 02:40:17 -- nvmf/common.sh@469 -- # nvmfpid=2184173 00:28:52.865 02:40:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:52.865 02:40:17 -- nvmf/common.sh@470 -- # waitforlisten 2184173 00:28:52.865 02:40:17 -- common/autotest_common.sh@829 -- # '[' -z 2184173 ']' 00:28:52.865 02:40:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:52.865 02:40:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:52.866 02:40:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:52.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:52.866 02:40:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:52.866 02:40:17 -- common/autotest_common.sh@10 -- # set +x 00:28:52.866 [2024-11-27 02:40:17.437468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:52.866 [2024-11-27 02:40:17.437550] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:52.866 EAL: No free 2048 kB hugepages reported on node 1 00:28:53.124 [2024-11-27 02:40:17.505475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:53.124 [2024-11-27 02:40:17.595050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:53.124 [2024-11-27 02:40:17.595224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:53.124 [2024-11-27 02:40:17.595244] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:53.124 [2024-11-27 02:40:17.595259] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:53.124 [2024-11-27 02:40:17.595289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:54.058 02:40:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:54.058 02:40:18 -- common/autotest_common.sh@862 -- # return 0 00:28:54.058 02:40:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:54.058 02:40:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:54.058 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.058 02:40:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:54.058 02:40:18 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:54.058 02:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.058 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.058 [2024-11-27 02:40:18.476130] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:54.058 02:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.058 02:40:18 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:54.058 02:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.058 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.058 [2024-11-27 02:40:18.484290] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:54.058 02:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.058 02:40:18 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:54.058 02:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.058 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.058 null0 00:28:54.058 02:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.058 02:40:18 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:54.058 02:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.058 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.058 null1 00:28:54.059 02:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.059 02:40:18 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:54.059 02:40:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.059 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.059 02:40:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.059 02:40:18 -- host/discovery.sh@45 -- # hostpid=2184326 00:28:54.059 02:40:18 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:54.059 02:40:18 -- host/discovery.sh@46 -- # waitforlisten 2184326 /tmp/host.sock 00:28:54.059 02:40:18 -- common/autotest_common.sh@829 -- # '[' -z 2184326 ']' 00:28:54.059 02:40:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:54.059 02:40:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:54.059 02:40:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:54.059 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:54.059 02:40:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:54.059 02:40:18 -- common/autotest_common.sh@10 -- # set +x 00:28:54.059 [2024-11-27 02:40:18.556904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:54.059 [2024-11-27 02:40:18.556979] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2184326 ] 00:28:54.059 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.059 [2024-11-27 02:40:18.622284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:54.317 [2024-11-27 02:40:18.711702] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:54.317 [2024-11-27 02:40:18.711858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:54.882 02:40:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:54.882 02:40:19 -- common/autotest_common.sh@862 -- # return 0 00:28:54.882 02:40:19 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:54.882 02:40:19 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:54.882 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.882 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.139 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@72 -- # notify_id=0 00:28:55.140 02:40:19 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # sort 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:55.140 02:40:19 -- host/discovery.sh@79 -- # get_bdev_list 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # sort 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:55.140 02:40:19 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # sort 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:55.140 02:40:19 -- host/discovery.sh@83 -- # get_bdev_list 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # sort 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:55.140 02:40:19 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # sort 00:28:55.140 02:40:19 -- host/discovery.sh@59 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.140 02:40:19 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:55.140 02:40:19 -- host/discovery.sh@87 -- # get_bdev_list 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:55.140 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:55.140 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # sort 00:28:55.140 02:40:19 -- host/discovery.sh@55 -- # xargs 00:28:55.140 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:55.398 02:40:19 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:55.398 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.398 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.398 [2024-11-27 02:40:19.787920] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.398 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:55.398 02:40:19 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:55.398 02:40:19 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:55.398 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.398 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.398 02:40:19 -- host/discovery.sh@59 -- # sort 00:28:55.398 02:40:19 -- host/discovery.sh@59 -- # xargs 00:28:55.398 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:55.398 02:40:19 -- host/discovery.sh@93 -- # get_bdev_list 00:28:55.398 02:40:19 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:55.398 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.398 02:40:19 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:55.398 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.398 02:40:19 -- host/discovery.sh@55 -- # sort 00:28:55.398 02:40:19 -- host/discovery.sh@55 -- # xargs 00:28:55.398 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:55.398 02:40:19 -- host/discovery.sh@94 -- # get_notification_count 00:28:55.398 02:40:19 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:55.398 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.398 02:40:19 -- host/discovery.sh@74 -- # jq '. | length' 00:28:55.398 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.398 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@74 -- # notification_count=0 00:28:55.398 02:40:19 -- host/discovery.sh@75 -- # notify_id=0 00:28:55.398 02:40:19 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:55.398 02:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.398 02:40:19 -- common/autotest_common.sh@10 -- # set +x 00:28:55.398 02:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.398 02:40:19 -- host/discovery.sh@100 -- # sleep 1 00:28:55.963 [2024-11-27 02:40:20.535239] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:55.963 [2024-11-27 02:40:20.535298] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:55.963 [2024-11-27 02:40:20.535325] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:56.221 [2024-11-27 02:40:20.622589] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:56.221 [2024-11-27 02:40:20.726395] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:56.221 [2024-11-27 02:40:20.726422] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:56.480 02:40:20 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:56.480 02:40:20 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:56.480 02:40:20 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:56.480 02:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.480 02:40:20 -- host/discovery.sh@59 -- # sort 00:28:56.480 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:28:56.480 02:40:20 -- host/discovery.sh@59 -- # xargs 00:28:56.480 02:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.480 02:40:20 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:56.480 02:40:20 -- host/discovery.sh@102 -- # get_bdev_list 00:28:56.480 02:40:20 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.480 02:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.480 02:40:20 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:56.480 02:40:20 -- common/autotest_common.sh@10 -- # set +x 00:28:56.480 02:40:20 -- host/discovery.sh@55 -- # sort 00:28:56.480 02:40:20 -- host/discovery.sh@55 -- # xargs 00:28:56.480 02:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:56.480 02:40:21 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:56.480 02:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.480 02:40:21 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:56.480 02:40:21 -- common/autotest_common.sh@10 -- # set +x 00:28:56.480 02:40:21 -- host/discovery.sh@63 -- # sort -n 00:28:56.480 02:40:21 -- host/discovery.sh@63 -- # xargs 00:28:56.480 02:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@104 -- # get_notification_count 00:28:56.480 02:40:21 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:56.480 02:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.480 02:40:21 -- common/autotest_common.sh@10 -- # set +x 00:28:56.480 02:40:21 -- host/discovery.sh@74 -- # jq '. | length' 00:28:56.480 02:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@74 -- # notification_count=1 00:28:56.480 02:40:21 -- host/discovery.sh@75 -- # notify_id=1 00:28:56.480 02:40:21 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:56.480 02:40:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.480 02:40:21 -- common/autotest_common.sh@10 -- # set +x 00:28:56.480 02:40:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.480 02:40:21 -- host/discovery.sh@109 -- # sleep 1 00:28:57.853 02:40:22 -- host/discovery.sh@110 -- # get_bdev_list 00:28:57.853 02:40:22 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.853 02:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.853 02:40:22 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.853 02:40:22 -- common/autotest_common.sh@10 -- # set +x 00:28:57.854 02:40:22 -- host/discovery.sh@55 -- # sort 00:28:57.854 02:40:22 -- host/discovery.sh@55 -- # xargs 00:28:57.854 02:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.854 02:40:22 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:57.854 02:40:22 -- host/discovery.sh@111 -- # get_notification_count 00:28:57.854 02:40:22 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:57.854 02:40:22 -- host/discovery.sh@74 -- # jq '. | length' 00:28:57.854 02:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.854 02:40:22 -- common/autotest_common.sh@10 -- # set +x 00:28:57.854 02:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.854 02:40:22 -- host/discovery.sh@74 -- # notification_count=1 00:28:57.854 02:40:22 -- host/discovery.sh@75 -- # notify_id=2 00:28:57.854 02:40:22 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:57.854 02:40:22 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:57.854 02:40:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.854 02:40:22 -- common/autotest_common.sh@10 -- # set +x 00:28:57.854 [2024-11-27 02:40:22.191076] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:57.854 [2024-11-27 02:40:22.192015] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:57.854 [2024-11-27 02:40:22.192054] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:57.854 02:40:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.854 02:40:22 -- host/discovery.sh@117 -- # sleep 1 00:28:57.854 [2024-11-27 02:40:22.318425] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:57.854 [2024-11-27 02:40:22.380996] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:57.854 [2024-11-27 02:40:22.381021] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:57.854 [2024-11-27 02:40:22.381032] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:58.785 02:40:23 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:58.785 02:40:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:58.785 02:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.785 02:40:23 -- common/autotest_common.sh@10 -- # set +x 00:28:58.785 02:40:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:58.785 02:40:23 -- host/discovery.sh@59 -- # sort 00:28:58.785 02:40:23 -- host/discovery.sh@59 -- # xargs 00:28:58.785 02:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@119 -- # get_bdev_list 00:28:58.785 02:40:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.785 02:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.785 02:40:23 -- common/autotest_common.sh@10 -- # set +x 00:28:58.785 02:40:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:58.785 02:40:23 -- host/discovery.sh@55 -- # sort 00:28:58.785 02:40:23 -- host/discovery.sh@55 -- # xargs 00:28:58.785 02:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:58.785 02:40:23 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:58.785 02:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.785 02:40:23 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:58.785 02:40:23 -- common/autotest_common.sh@10 -- # set +x 00:28:58.785 02:40:23 -- host/discovery.sh@63 -- # sort -n 00:28:58.785 02:40:23 -- host/discovery.sh@63 -- # xargs 00:28:58.785 02:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@121 -- # get_notification_count 00:28:58.785 02:40:23 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:58.785 02:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.785 02:40:23 -- host/discovery.sh@74 -- # jq '. | length' 00:28:58.785 02:40:23 -- common/autotest_common.sh@10 -- # set +x 00:28:58.785 02:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@74 -- # notification_count=0 00:28:58.785 02:40:23 -- host/discovery.sh@75 -- # notify_id=2 00:28:58.785 02:40:23 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:58.785 02:40:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.785 02:40:23 -- common/autotest_common.sh@10 -- # set +x 00:28:58.785 [2024-11-27 02:40:23.363457] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:58.785 [2024-11-27 02:40:23.363492] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:58.785 02:40:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.785 02:40:23 -- host/discovery.sh@127 -- # sleep 1 00:28:58.785 [2024-11-27 02:40:23.370314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:58.786 [2024-11-27 02:40:23.370348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:58.786 [2024-11-27 02:40:23.370366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:58.786 [2024-11-27 02:40:23.370381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:58.786 [2024-11-27 02:40:23.370396] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:58.786 [2024-11-27 02:40:23.370411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:58.786 [2024-11-27 02:40:23.370426] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:58.786 [2024-11-27 02:40:23.370440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:58.786 [2024-11-27 02:40:23.370455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:58.786 [2024-11-27 02:40:23.380317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:58.786 [2024-11-27 02:40:23.390363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:58.786 [2024-11-27 02:40:23.390576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.390682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.390709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:58.786 [2024-11-27 02:40:23.390725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:58.786 [2024-11-27 02:40:23.390748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:58.786 [2024-11-27 02:40:23.390793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:58.786 [2024-11-27 02:40:23.390813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:58.786 [2024-11-27 02:40:23.390828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:58.786 [2024-11-27 02:40:23.390848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:58.786 [2024-11-27 02:40:23.400443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:58.786 [2024-11-27 02:40:23.400632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.400756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.400782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:58.786 [2024-11-27 02:40:23.400798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:58.786 [2024-11-27 02:40:23.400820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:58.786 [2024-11-27 02:40:23.400858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:58.786 [2024-11-27 02:40:23.400876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:58.786 [2024-11-27 02:40:23.400890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:58.786 [2024-11-27 02:40:23.400926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:58.786 [2024-11-27 02:40:23.410520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:58.786 [2024-11-27 02:40:23.410748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.410895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:58.786 [2024-11-27 02:40:23.410924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:58.786 [2024-11-27 02:40:23.410942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:58.786 [2024-11-27 02:40:23.410966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:58.786 [2024-11-27 02:40:23.411013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:58.786 [2024-11-27 02:40:23.411034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:58.786 [2024-11-27 02:40:23.411049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:58.786 [2024-11-27 02:40:23.411070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:59.043 [2024-11-27 02:40:23.420628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:59.043 [2024-11-27 02:40:23.420820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.421001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.421027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:59.044 [2024-11-27 02:40:23.421043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:59.044 [2024-11-27 02:40:23.421066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:59.044 [2024-11-27 02:40:23.421098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:59.044 [2024-11-27 02:40:23.421115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:59.044 [2024-11-27 02:40:23.421128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:59.044 [2024-11-27 02:40:23.421146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:59.044 [2024-11-27 02:40:23.430717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:59.044 [2024-11-27 02:40:23.430934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.431066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.431092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:59.044 [2024-11-27 02:40:23.431108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:59.044 [2024-11-27 02:40:23.431130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:59.044 [2024-11-27 02:40:23.431172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:59.044 [2024-11-27 02:40:23.431211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:59.044 [2024-11-27 02:40:23.431228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:59.044 [2024-11-27 02:40:23.431250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:59.044 [2024-11-27 02:40:23.440814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:59.044 [2024-11-27 02:40:23.441000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.441130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:59.044 [2024-11-27 02:40:23.441171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf19b80 with addr=10.0.0.2, port=4420 00:28:59.044 [2024-11-27 02:40:23.441187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf19b80 is same with the state(5) to be set 00:28:59.044 [2024-11-27 02:40:23.441209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf19b80 (9): Bad file descriptor 00:28:59.044 [2024-11-27 02:40:23.441240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:59.044 [2024-11-27 02:40:23.441257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:59.044 [2024-11-27 02:40:23.441270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:59.044 [2024-11-27 02:40:23.441288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:59.044 [2024-11-27 02:40:23.450267] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:59.044 [2024-11-27 02:40:23.450298] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:59.975 02:40:24 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:59.975 02:40:24 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:59.975 02:40:24 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:59.975 02:40:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.975 02:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:59.975 02:40:24 -- host/discovery.sh@59 -- # sort 00:28:59.975 02:40:24 -- host/discovery.sh@59 -- # xargs 00:28:59.975 02:40:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.975 02:40:24 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:59.975 02:40:24 -- host/discovery.sh@129 -- # get_bdev_list 00:28:59.975 02:40:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.975 02:40:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.975 02:40:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.975 02:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:59.976 02:40:24 -- host/discovery.sh@55 -- # sort 00:28:59.976 02:40:24 -- host/discovery.sh@55 -- # xargs 00:28:59.976 02:40:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:59.976 02:40:24 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:59.976 02:40:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.976 02:40:24 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:59.976 02:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:59.976 02:40:24 -- host/discovery.sh@63 -- # sort -n 00:28:59.976 02:40:24 -- host/discovery.sh@63 -- # xargs 00:28:59.976 02:40:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@131 -- # get_notification_count 00:28:59.976 02:40:24 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:59.976 02:40:24 -- host/discovery.sh@74 -- # jq '. | length' 00:28:59.976 02:40:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.976 02:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:59.976 02:40:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@74 -- # notification_count=0 00:28:59.976 02:40:24 -- host/discovery.sh@75 -- # notify_id=2 00:28:59.976 02:40:24 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:59.976 02:40:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.976 02:40:24 -- common/autotest_common.sh@10 -- # set +x 00:28:59.976 02:40:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.976 02:40:24 -- host/discovery.sh@135 -- # sleep 1 00:29:01.349 02:40:25 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:01.349 02:40:25 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:01.349 02:40:25 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:01.349 02:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.349 02:40:25 -- host/discovery.sh@59 -- # sort 00:29:01.349 02:40:25 -- common/autotest_common.sh@10 -- # set +x 00:29:01.349 02:40:25 -- host/discovery.sh@59 -- # xargs 00:29:01.349 02:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.349 02:40:25 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:01.349 02:40:25 -- host/discovery.sh@137 -- # get_bdev_list 00:29:01.349 02:40:25 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.349 02:40:25 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.349 02:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.349 02:40:25 -- common/autotest_common.sh@10 -- # set +x 00:29:01.349 02:40:25 -- host/discovery.sh@55 -- # sort 00:29:01.349 02:40:25 -- host/discovery.sh@55 -- # xargs 00:29:01.349 02:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.349 02:40:25 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:01.349 02:40:25 -- host/discovery.sh@138 -- # get_notification_count 00:29:01.349 02:40:25 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:01.349 02:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.349 02:40:25 -- host/discovery.sh@74 -- # jq '. | length' 00:29:01.349 02:40:25 -- common/autotest_common.sh@10 -- # set +x 00:29:01.349 02:40:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.349 02:40:25 -- host/discovery.sh@74 -- # notification_count=2 00:29:01.349 02:40:25 -- host/discovery.sh@75 -- # notify_id=4 00:29:01.349 02:40:25 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:01.349 02:40:25 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:01.349 02:40:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.349 02:40:25 -- common/autotest_common.sh@10 -- # set +x 00:29:02.280 [2024-11-27 02:40:26.701312] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:02.280 [2024-11-27 02:40:26.701339] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:02.280 [2024-11-27 02:40:26.701363] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:02.280 [2024-11-27 02:40:26.788686] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:02.537 [2024-11-27 02:40:27.096508] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:02.537 [2024-11-27 02:40:27.096556] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:02.537 02:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.537 02:40:27 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.537 02:40:27 -- common/autotest_common.sh@650 -- # local es=0 00:29:02.537 02:40:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.537 02:40:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:02.537 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.537 02:40:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:02.537 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.537 02:40:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.537 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.537 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.537 request: 00:29:02.537 { 00:29:02.537 "name": "nvme", 00:29:02.537 "trtype": "tcp", 00:29:02.537 "traddr": "10.0.0.2", 00:29:02.537 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:02.537 "adrfam": "ipv4", 00:29:02.537 "trsvcid": "8009", 00:29:02.537 "wait_for_attach": true, 00:29:02.537 "method": "bdev_nvme_start_discovery", 00:29:02.537 "req_id": 1 00:29:02.537 } 00:29:02.537 Got JSON-RPC error response 00:29:02.537 response: 00:29:02.537 { 00:29:02.537 "code": -17, 00:29:02.537 "message": "File exists" 00:29:02.537 } 00:29:02.537 02:40:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:02.537 02:40:27 -- common/autotest_common.sh@653 -- # es=1 00:29:02.537 02:40:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:02.537 02:40:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:02.537 02:40:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:02.537 02:40:27 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:02.537 02:40:27 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:02.537 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.537 02:40:27 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:02.537 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.537 02:40:27 -- host/discovery.sh@67 -- # sort 00:29:02.537 02:40:27 -- host/discovery.sh@67 -- # xargs 00:29:02.537 02:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.537 02:40:27 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:02.537 02:40:27 -- host/discovery.sh@147 -- # get_bdev_list 00:29:02.537 02:40:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.537 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.537 02:40:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.537 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.537 02:40:27 -- host/discovery.sh@55 -- # sort 00:29:02.537 02:40:27 -- host/discovery.sh@55 -- # xargs 00:29:02.537 02:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.795 02:40:27 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:02.795 02:40:27 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.795 02:40:27 -- common/autotest_common.sh@650 -- # local es=0 00:29:02.795 02:40:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.795 02:40:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.795 02:40:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:02.795 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.795 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.795 request: 00:29:02.795 { 00:29:02.795 "name": "nvme_second", 00:29:02.795 "trtype": "tcp", 00:29:02.795 "traddr": "10.0.0.2", 00:29:02.795 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:02.795 "adrfam": "ipv4", 00:29:02.795 "trsvcid": "8009", 00:29:02.795 "wait_for_attach": true, 00:29:02.795 "method": "bdev_nvme_start_discovery", 00:29:02.795 "req_id": 1 00:29:02.795 } 00:29:02.795 Got JSON-RPC error response 00:29:02.795 response: 00:29:02.795 { 00:29:02.795 "code": -17, 00:29:02.795 "message": "File exists" 00:29:02.795 } 00:29:02.795 02:40:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:02.795 02:40:27 -- common/autotest_common.sh@653 -- # es=1 00:29:02.795 02:40:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:02.795 02:40:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:02.795 02:40:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:02.795 02:40:27 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:02.795 02:40:27 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:02.795 02:40:27 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:02.795 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.795 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.795 02:40:27 -- host/discovery.sh@67 -- # sort 00:29:02.795 02:40:27 -- host/discovery.sh@67 -- # xargs 00:29:02.795 02:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.795 02:40:27 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:02.795 02:40:27 -- host/discovery.sh@153 -- # get_bdev_list 00:29:02.795 02:40:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.795 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.795 02:40:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.795 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:02.795 02:40:27 -- host/discovery.sh@55 -- # sort 00:29:02.795 02:40:27 -- host/discovery.sh@55 -- # xargs 00:29:02.795 02:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.795 02:40:27 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:02.795 02:40:27 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:02.795 02:40:27 -- common/autotest_common.sh@650 -- # local es=0 00:29:02.795 02:40:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:02.795 02:40:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:02.795 02:40:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:02.795 02:40:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:02.795 02:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.795 02:40:27 -- common/autotest_common.sh@10 -- # set +x 00:29:03.728 [2024-11-27 02:40:28.292810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.728 [2024-11-27 02:40:28.293017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.728 [2024-11-27 02:40:28.293045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf35f80 with addr=10.0.0.2, port=8010 00:29:03.728 [2024-11-27 02:40:28.293071] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:03.728 [2024-11-27 02:40:28.293085] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:03.728 [2024-11-27 02:40:28.293098] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:04.666 [2024-11-27 02:40:29.295172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.666 [2024-11-27 02:40:29.295314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:04.666 [2024-11-27 02:40:29.295344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf50830 with addr=10.0.0.2, port=8010 00:29:04.666 [2024-11-27 02:40:29.295366] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:04.666 [2024-11-27 02:40:29.295380] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:04.666 [2024-11-27 02:40:29.295394] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:06.058 [2024-11-27 02:40:30.297458] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:06.058 request: 00:29:06.058 { 00:29:06.058 "name": "nvme_second", 00:29:06.058 "trtype": "tcp", 00:29:06.058 "traddr": "10.0.0.2", 00:29:06.058 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:06.058 "adrfam": "ipv4", 00:29:06.058 "trsvcid": "8010", 00:29:06.058 "attach_timeout_ms": 3000, 00:29:06.058 "method": "bdev_nvme_start_discovery", 00:29:06.058 "req_id": 1 00:29:06.058 } 00:29:06.058 Got JSON-RPC error response 00:29:06.058 response: 00:29:06.058 { 00:29:06.058 "code": -110, 00:29:06.058 "message": "Connection timed out" 00:29:06.058 } 00:29:06.058 02:40:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:06.058 02:40:30 -- common/autotest_common.sh@653 -- # es=1 00:29:06.058 02:40:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:06.058 02:40:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:06.058 02:40:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:06.058 02:40:30 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:06.058 02:40:30 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:06.058 02:40:30 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:06.058 02:40:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.058 02:40:30 -- common/autotest_common.sh@10 -- # set +x 00:29:06.058 02:40:30 -- host/discovery.sh@67 -- # sort 00:29:06.058 02:40:30 -- host/discovery.sh@67 -- # xargs 00:29:06.058 02:40:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.058 02:40:30 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:06.058 02:40:30 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:06.058 02:40:30 -- host/discovery.sh@162 -- # kill 2184326 00:29:06.058 02:40:30 -- host/discovery.sh@163 -- # nvmftestfini 00:29:06.058 02:40:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:06.058 02:40:30 -- nvmf/common.sh@116 -- # sync 00:29:06.058 02:40:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:06.058 02:40:30 -- nvmf/common.sh@119 -- # set +e 00:29:06.058 02:40:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:06.058 02:40:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:06.058 rmmod nvme_tcp 00:29:06.058 rmmod nvme_fabrics 00:29:06.058 rmmod nvme_keyring 00:29:06.058 02:40:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:06.058 02:40:30 -- nvmf/common.sh@123 -- # set -e 00:29:06.058 02:40:30 -- nvmf/common.sh@124 -- # return 0 00:29:06.058 02:40:30 -- nvmf/common.sh@477 -- # '[' -n 2184173 ']' 00:29:06.058 02:40:30 -- nvmf/common.sh@478 -- # killprocess 2184173 00:29:06.058 02:40:30 -- common/autotest_common.sh@936 -- # '[' -z 2184173 ']' 00:29:06.058 02:40:30 -- common/autotest_common.sh@940 -- # kill -0 2184173 00:29:06.058 02:40:30 -- common/autotest_common.sh@941 -- # uname 00:29:06.058 02:40:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:06.058 02:40:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2184173 00:29:06.058 02:40:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:06.058 02:40:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:06.058 02:40:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2184173' 00:29:06.058 killing process with pid 2184173 00:29:06.058 02:40:30 -- common/autotest_common.sh@955 -- # kill 2184173 00:29:06.058 02:40:30 -- common/autotest_common.sh@960 -- # wait 2184173 00:29:06.058 02:40:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:06.058 02:40:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:06.058 02:40:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:06.058 02:40:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:06.058 02:40:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:06.058 02:40:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:06.058 02:40:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:06.058 02:40:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:08.593 02:40:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:08.593 00:29:08.593 real 0m17.600s 00:29:08.593 user 0m27.404s 00:29:08.593 sys 0m2.809s 00:29:08.593 02:40:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:08.593 02:40:32 -- common/autotest_common.sh@10 -- # set +x 00:29:08.593 ************************************ 00:29:08.593 END TEST nvmf_discovery 00:29:08.593 ************************************ 00:29:08.594 02:40:32 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:08.594 02:40:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:08.594 02:40:32 -- common/autotest_common.sh@10 -- # set +x 00:29:08.594 ************************************ 00:29:08.594 START TEST nvmf_discovery_remove_ifc 00:29:08.594 ************************************ 00:29:08.594 02:40:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:08.594 * Looking for test storage... 00:29:08.594 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:08.594 02:40:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:08.594 02:40:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:08.594 02:40:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:08.594 02:40:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:08.594 02:40:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:08.594 02:40:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:08.594 02:40:32 -- scripts/common.sh@335 -- # IFS=.-: 00:29:08.594 02:40:32 -- scripts/common.sh@335 -- # read -ra ver1 00:29:08.594 02:40:32 -- scripts/common.sh@336 -- # IFS=.-: 00:29:08.594 02:40:32 -- scripts/common.sh@336 -- # read -ra ver2 00:29:08.594 02:40:32 -- scripts/common.sh@337 -- # local 'op=<' 00:29:08.594 02:40:32 -- scripts/common.sh@339 -- # ver1_l=2 00:29:08.594 02:40:32 -- scripts/common.sh@340 -- # ver2_l=1 00:29:08.594 02:40:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:08.594 02:40:32 -- scripts/common.sh@343 -- # case "$op" in 00:29:08.594 02:40:32 -- scripts/common.sh@344 -- # : 1 00:29:08.594 02:40:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:08.594 02:40:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:08.594 02:40:32 -- scripts/common.sh@364 -- # decimal 1 00:29:08.594 02:40:32 -- scripts/common.sh@352 -- # local d=1 00:29:08.594 02:40:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:08.594 02:40:32 -- scripts/common.sh@354 -- # echo 1 00:29:08.594 02:40:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:08.594 02:40:32 -- scripts/common.sh@365 -- # decimal 2 00:29:08.594 02:40:32 -- scripts/common.sh@352 -- # local d=2 00:29:08.594 02:40:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:08.594 02:40:32 -- scripts/common.sh@354 -- # echo 2 00:29:08.594 02:40:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:08.594 02:40:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:08.594 02:40:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:08.594 02:40:32 -- scripts/common.sh@367 -- # return 0 00:29:08.594 02:40:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:08.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:08.594 --rc genhtml_branch_coverage=1 00:29:08.594 --rc genhtml_function_coverage=1 00:29:08.594 --rc genhtml_legend=1 00:29:08.594 --rc geninfo_all_blocks=1 00:29:08.594 --rc geninfo_unexecuted_blocks=1 00:29:08.594 00:29:08.594 ' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:08.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:08.594 --rc genhtml_branch_coverage=1 00:29:08.594 --rc genhtml_function_coverage=1 00:29:08.594 --rc genhtml_legend=1 00:29:08.594 --rc geninfo_all_blocks=1 00:29:08.594 --rc geninfo_unexecuted_blocks=1 00:29:08.594 00:29:08.594 ' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:08.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:08.594 --rc genhtml_branch_coverage=1 00:29:08.594 --rc genhtml_function_coverage=1 00:29:08.594 --rc genhtml_legend=1 00:29:08.594 --rc geninfo_all_blocks=1 00:29:08.594 --rc geninfo_unexecuted_blocks=1 00:29:08.594 00:29:08.594 ' 00:29:08.594 02:40:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:08.594 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:08.594 --rc genhtml_branch_coverage=1 00:29:08.594 --rc genhtml_function_coverage=1 00:29:08.594 --rc genhtml_legend=1 00:29:08.594 --rc geninfo_all_blocks=1 00:29:08.594 --rc geninfo_unexecuted_blocks=1 00:29:08.594 00:29:08.594 ' 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:08.594 02:40:32 -- nvmf/common.sh@7 -- # uname -s 00:29:08.594 02:40:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:08.594 02:40:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:08.594 02:40:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:08.594 02:40:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:08.594 02:40:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:08.594 02:40:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:08.594 02:40:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:08.594 02:40:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:08.594 02:40:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:08.594 02:40:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:08.594 02:40:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:08.594 02:40:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:08.594 02:40:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:08.594 02:40:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:08.594 02:40:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:08.594 02:40:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:08.594 02:40:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:08.594 02:40:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:08.594 02:40:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:08.594 02:40:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.594 02:40:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.594 02:40:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.594 02:40:32 -- paths/export.sh@5 -- # export PATH 00:29:08.594 02:40:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.594 02:40:32 -- nvmf/common.sh@46 -- # : 0 00:29:08.594 02:40:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:08.594 02:40:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:08.594 02:40:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:08.594 02:40:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:08.594 02:40:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:08.594 02:40:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:08.594 02:40:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:08.594 02:40:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:08.594 02:40:32 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:08.594 02:40:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:08.594 02:40:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:08.594 02:40:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:08.594 02:40:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:08.594 02:40:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:08.594 02:40:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:08.594 02:40:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:08.594 02:40:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:08.594 02:40:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:08.594 02:40:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:08.594 02:40:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:08.594 02:40:32 -- common/autotest_common.sh@10 -- # set +x 00:29:10.528 02:40:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:10.528 02:40:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:10.528 02:40:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:10.528 02:40:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:10.528 02:40:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:10.528 02:40:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:10.528 02:40:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:10.528 02:40:34 -- nvmf/common.sh@294 -- # net_devs=() 00:29:10.528 02:40:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:10.528 02:40:34 -- nvmf/common.sh@295 -- # e810=() 00:29:10.528 02:40:34 -- nvmf/common.sh@295 -- # local -ga e810 00:29:10.528 02:40:34 -- nvmf/common.sh@296 -- # x722=() 00:29:10.528 02:40:34 -- nvmf/common.sh@296 -- # local -ga x722 00:29:10.528 02:40:34 -- nvmf/common.sh@297 -- # mlx=() 00:29:10.528 02:40:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:10.528 02:40:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:10.528 02:40:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:10.528 02:40:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:10.528 02:40:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:10.528 02:40:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:10.528 02:40:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:10.528 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:10.528 02:40:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:10.528 02:40:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:10.528 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:10.528 02:40:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:10.528 02:40:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:10.528 02:40:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:10.528 02:40:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:10.528 02:40:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:10.528 02:40:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:10.528 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:10.528 02:40:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:10.528 02:40:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:10.528 02:40:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:10.528 02:40:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:10.528 02:40:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:10.528 02:40:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:10.528 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:10.528 02:40:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:10.528 02:40:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:10.528 02:40:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:10.528 02:40:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:10.528 02:40:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:10.528 02:40:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:10.528 02:40:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:10.529 02:40:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:10.529 02:40:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:10.529 02:40:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:10.529 02:40:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:10.529 02:40:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:10.529 02:40:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:10.529 02:40:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:10.529 02:40:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:10.529 02:40:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:10.529 02:40:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:10.529 02:40:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:10.529 02:40:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:10.529 02:40:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:10.529 02:40:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:10.529 02:40:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:10.529 02:40:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:10.529 02:40:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:10.529 02:40:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:10.529 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:10.529 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:29:10.529 00:29:10.529 --- 10.0.0.2 ping statistics --- 00:29:10.529 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:10.529 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:29:10.529 02:40:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:10.529 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:10.529 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:29:10.529 00:29:10.529 --- 10.0.0.1 ping statistics --- 00:29:10.529 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:10.529 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:29:10.529 02:40:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:10.529 02:40:35 -- nvmf/common.sh@410 -- # return 0 00:29:10.529 02:40:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:10.529 02:40:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:10.529 02:40:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:10.529 02:40:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:10.529 02:40:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:10.529 02:40:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:10.529 02:40:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:10.529 02:40:35 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:10.529 02:40:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:10.529 02:40:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:10.529 02:40:35 -- common/autotest_common.sh@10 -- # set +x 00:29:10.529 02:40:35 -- nvmf/common.sh@469 -- # nvmfpid=2187806 00:29:10.529 02:40:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:10.529 02:40:35 -- nvmf/common.sh@470 -- # waitforlisten 2187806 00:29:10.529 02:40:35 -- common/autotest_common.sh@829 -- # '[' -z 2187806 ']' 00:29:10.529 02:40:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:10.529 02:40:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:10.529 02:40:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:10.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:10.529 02:40:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:10.529 02:40:35 -- common/autotest_common.sh@10 -- # set +x 00:29:10.529 [2024-11-27 02:40:35.086021] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:10.529 [2024-11-27 02:40:35.086112] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:10.529 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.529 [2024-11-27 02:40:35.158291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:10.787 [2024-11-27 02:40:35.243874] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:10.787 [2024-11-27 02:40:35.244047] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:10.787 [2024-11-27 02:40:35.244065] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:10.787 [2024-11-27 02:40:35.244078] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:10.787 [2024-11-27 02:40:35.244106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:11.722 02:40:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:11.722 02:40:36 -- common/autotest_common.sh@862 -- # return 0 00:29:11.722 02:40:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:11.722 02:40:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:11.722 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:11.722 02:40:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:11.722 02:40:36 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:11.722 02:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.722 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:11.722 [2024-11-27 02:40:36.155448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:11.722 [2024-11-27 02:40:36.163675] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:11.722 null0 00:29:11.722 [2024-11-27 02:40:36.195617] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:11.722 02:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.722 02:40:36 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2187961 00:29:11.722 02:40:36 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2187961 /tmp/host.sock 00:29:11.722 02:40:36 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:11.722 02:40:36 -- common/autotest_common.sh@829 -- # '[' -z 2187961 ']' 00:29:11.722 02:40:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:11.722 02:40:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:11.722 02:40:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:11.722 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:11.722 02:40:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:11.722 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:11.722 [2024-11-27 02:40:36.258803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:11.722 [2024-11-27 02:40:36.258883] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2187961 ] 00:29:11.722 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.722 [2024-11-27 02:40:36.319552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:11.980 [2024-11-27 02:40:36.408583] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:11.980 [2024-11-27 02:40:36.408756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:11.980 02:40:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:11.980 02:40:36 -- common/autotest_common.sh@862 -- # return 0 00:29:11.980 02:40:36 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:11.980 02:40:36 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:11.980 02:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.980 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:11.980 02:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.980 02:40:36 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:11.980 02:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.980 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:11.980 02:40:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.980 02:40:36 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:11.980 02:40:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.980 02:40:36 -- common/autotest_common.sh@10 -- # set +x 00:29:13.353 [2024-11-27 02:40:37.613154] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:13.353 [2024-11-27 02:40:37.613192] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:13.353 [2024-11-27 02:40:37.613219] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:13.353 [2024-11-27 02:40:37.699477] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:13.353 [2024-11-27 02:40:37.884574] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:13.353 [2024-11-27 02:40:37.884623] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:13.353 [2024-11-27 02:40:37.884664] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:13.353 [2024-11-27 02:40:37.884689] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:13.353 [2024-11-27 02:40:37.884714] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:13.353 02:40:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:13.353 02:40:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:13.353 02:40:37 -- common/autotest_common.sh@10 -- # set +x 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:13.353 [2024-11-27 02:40:37.891459] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xb7e4b0 was disconnected and freed. delete nvme_qpair. 00:29:13.353 02:40:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:13.353 02:40:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:13.353 02:40:37 -- common/autotest_common.sh@10 -- # set +x 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:13.353 02:40:37 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:13.353 02:40:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.611 02:40:38 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:13.611 02:40:38 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:14.544 02:40:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:14.544 02:40:39 -- common/autotest_common.sh@10 -- # set +x 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:14.544 02:40:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:14.544 02:40:39 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:15.483 02:40:40 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:15.483 02:40:40 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.483 02:40:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.484 02:40:40 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:15.484 02:40:40 -- common/autotest_common.sh@10 -- # set +x 00:29:15.484 02:40:40 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:15.484 02:40:40 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:15.484 02:40:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.484 02:40:40 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:15.484 02:40:40 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:16.855 02:40:41 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:16.855 02:40:41 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:16.856 02:40:41 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:16.856 02:40:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.856 02:40:41 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:16.856 02:40:41 -- common/autotest_common.sh@10 -- # set +x 00:29:16.856 02:40:41 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:16.856 02:40:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.856 02:40:41 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:16.856 02:40:41 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:17.789 02:40:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:17.789 02:40:42 -- common/autotest_common.sh@10 -- # set +x 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:17.789 02:40:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.789 02:40:42 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:17.790 02:40:42 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:18.724 02:40:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:18.724 02:40:43 -- common/autotest_common.sh@10 -- # set +x 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:18.724 02:40:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:18.724 02:40:43 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:18.724 [2024-11-27 02:40:43.325543] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:18.724 [2024-11-27 02:40:43.325620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:18.724 [2024-11-27 02:40:43.325658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:18.724 [2024-11-27 02:40:43.325674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:18.724 [2024-11-27 02:40:43.325686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:18.724 [2024-11-27 02:40:43.325699] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:18.724 [2024-11-27 02:40:43.325711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:18.724 [2024-11-27 02:40:43.325725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:18.724 [2024-11-27 02:40:43.325738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:18.724 [2024-11-27 02:40:43.325751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:18.724 [2024-11-27 02:40:43.325771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:18.724 [2024-11-27 02:40:43.325784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb45790 is same with the state(5) to be set 00:29:18.724 [2024-11-27 02:40:43.335560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb45790 (9): Bad file descriptor 00:29:18.724 [2024-11-27 02:40:43.345608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:19.658 02:40:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.658 02:40:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.658 02:40:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.658 02:40:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.658 02:40:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.658 02:40:44 -- common/autotest_common.sh@10 -- # set +x 00:29:19.658 02:40:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.916 [2024-11-27 02:40:44.372552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:20.850 [2024-11-27 02:40:45.396855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:20.850 [2024-11-27 02:40:45.396914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb45790 with addr=10.0.0.2, port=4420 00:29:20.850 [2024-11-27 02:40:45.396938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb45790 is same with the state(5) to be set 00:29:20.850 [2024-11-27 02:40:45.396973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:20.850 [2024-11-27 02:40:45.396991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:20.850 [2024-11-27 02:40:45.397005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:20.850 [2024-11-27 02:40:45.397020] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:20.850 [2024-11-27 02:40:45.397434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb45790 (9): Bad file descriptor 00:29:20.850 [2024-11-27 02:40:45.397477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:20.850 [2024-11-27 02:40:45.397519] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:20.850 [2024-11-27 02:40:45.397589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.850 [2024-11-27 02:40:45.397612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.850 [2024-11-27 02:40:45.397629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.850 [2024-11-27 02:40:45.397642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.850 [2024-11-27 02:40:45.397655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.850 [2024-11-27 02:40:45.397668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.850 [2024-11-27 02:40:45.397681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.850 [2024-11-27 02:40:45.397694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.850 [2024-11-27 02:40:45.397707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.850 [2024-11-27 02:40:45.397720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.850 [2024-11-27 02:40:45.397740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:20.850 [2024-11-27 02:40:45.397975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb44c40 (9): Bad file descriptor 00:29:20.850 [2024-11-27 02:40:45.398996] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:20.850 [2024-11-27 02:40:45.399024] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:20.850 02:40:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.850 02:40:45 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.850 02:40:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:21.817 02:40:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.817 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.817 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.817 02:40:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.817 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.817 02:40:46 -- common/autotest_common.sh@10 -- # set +x 00:29:21.817 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.817 02:40:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:22.076 02:40:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.076 02:40:46 -- common/autotest_common.sh@10 -- # set +x 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:22.076 02:40:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:22.076 02:40:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.009 [2024-11-27 02:40:47.449296] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:23.009 [2024-11-27 02:40:47.449324] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:23.009 [2024-11-27 02:40:47.449349] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.009 02:40:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.009 02:40:47 -- common/autotest_common.sh@10 -- # set +x 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.009 02:40:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.009 [2024-11-27 02:40:47.576774] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:23.009 02:40:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.266 [2024-11-27 02:40:47.760955] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:23.267 [2024-11-27 02:40:47.761008] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:23.267 [2024-11-27 02:40:47.761045] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:23.267 [2024-11-27 02:40:47.761069] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:23.267 [2024-11-27 02:40:47.761083] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:23.267 [2024-11-27 02:40:47.768154] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xb62c20 was disconnected and freed. delete nvme_qpair. 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.199 02:40:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.199 02:40:48 -- common/autotest_common.sh@10 -- # set +x 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.199 02:40:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:24.199 02:40:48 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2187961 00:29:24.199 02:40:48 -- common/autotest_common.sh@936 -- # '[' -z 2187961 ']' 00:29:24.199 02:40:48 -- common/autotest_common.sh@940 -- # kill -0 2187961 00:29:24.199 02:40:48 -- common/autotest_common.sh@941 -- # uname 00:29:24.199 02:40:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:24.199 02:40:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2187961 00:29:24.199 02:40:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:24.199 02:40:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:24.199 02:40:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2187961' 00:29:24.199 killing process with pid 2187961 00:29:24.199 02:40:48 -- common/autotest_common.sh@955 -- # kill 2187961 00:29:24.199 02:40:48 -- common/autotest_common.sh@960 -- # wait 2187961 00:29:24.457 02:40:48 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:24.457 02:40:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:24.457 02:40:48 -- nvmf/common.sh@116 -- # sync 00:29:24.457 02:40:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:24.457 02:40:48 -- nvmf/common.sh@119 -- # set +e 00:29:24.457 02:40:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:24.457 02:40:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:24.457 rmmod nvme_tcp 00:29:24.457 rmmod nvme_fabrics 00:29:24.457 rmmod nvme_keyring 00:29:24.457 02:40:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:24.457 02:40:48 -- nvmf/common.sh@123 -- # set -e 00:29:24.457 02:40:48 -- nvmf/common.sh@124 -- # return 0 00:29:24.457 02:40:48 -- nvmf/common.sh@477 -- # '[' -n 2187806 ']' 00:29:24.457 02:40:48 -- nvmf/common.sh@478 -- # killprocess 2187806 00:29:24.457 02:40:48 -- common/autotest_common.sh@936 -- # '[' -z 2187806 ']' 00:29:24.457 02:40:48 -- common/autotest_common.sh@940 -- # kill -0 2187806 00:29:24.457 02:40:48 -- common/autotest_common.sh@941 -- # uname 00:29:24.457 02:40:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:24.457 02:40:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2187806 00:29:24.457 02:40:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:24.457 02:40:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:24.457 02:40:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2187806' 00:29:24.457 killing process with pid 2187806 00:29:24.457 02:40:48 -- common/autotest_common.sh@955 -- # kill 2187806 00:29:24.457 02:40:48 -- common/autotest_common.sh@960 -- # wait 2187806 00:29:24.716 02:40:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:24.716 02:40:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:24.716 02:40:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:24.716 02:40:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:24.716 02:40:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:24.716 02:40:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:24.716 02:40:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:24.716 02:40:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:26.618 02:40:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:26.618 00:29:26.618 real 0m18.502s 00:29:26.618 user 0m25.716s 00:29:26.618 sys 0m2.991s 00:29:26.618 02:40:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:26.618 02:40:51 -- common/autotest_common.sh@10 -- # set +x 00:29:26.618 ************************************ 00:29:26.618 END TEST nvmf_discovery_remove_ifc 00:29:26.618 ************************************ 00:29:26.877 02:40:51 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:26.877 02:40:51 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:26.877 02:40:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:26.877 02:40:51 -- common/autotest_common.sh@10 -- # set +x 00:29:26.877 ************************************ 00:29:26.877 START TEST nvmf_digest 00:29:26.877 ************************************ 00:29:26.877 02:40:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:26.877 * Looking for test storage... 00:29:26.877 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:26.877 02:40:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:26.877 02:40:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:26.877 02:40:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:26.877 02:40:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:26.877 02:40:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:26.877 02:40:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:26.877 02:40:51 -- scripts/common.sh@335 -- # IFS=.-: 00:29:26.877 02:40:51 -- scripts/common.sh@335 -- # read -ra ver1 00:29:26.877 02:40:51 -- scripts/common.sh@336 -- # IFS=.-: 00:29:26.877 02:40:51 -- scripts/common.sh@336 -- # read -ra ver2 00:29:26.877 02:40:51 -- scripts/common.sh@337 -- # local 'op=<' 00:29:26.877 02:40:51 -- scripts/common.sh@339 -- # ver1_l=2 00:29:26.877 02:40:51 -- scripts/common.sh@340 -- # ver2_l=1 00:29:26.877 02:40:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:26.877 02:40:51 -- scripts/common.sh@343 -- # case "$op" in 00:29:26.877 02:40:51 -- scripts/common.sh@344 -- # : 1 00:29:26.877 02:40:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:26.877 02:40:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:26.877 02:40:51 -- scripts/common.sh@364 -- # decimal 1 00:29:26.877 02:40:51 -- scripts/common.sh@352 -- # local d=1 00:29:26.877 02:40:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:26.877 02:40:51 -- scripts/common.sh@354 -- # echo 1 00:29:26.877 02:40:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:26.877 02:40:51 -- scripts/common.sh@365 -- # decimal 2 00:29:26.877 02:40:51 -- scripts/common.sh@352 -- # local d=2 00:29:26.877 02:40:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:26.877 02:40:51 -- scripts/common.sh@354 -- # echo 2 00:29:26.877 02:40:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:26.877 02:40:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:26.877 02:40:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:26.877 02:40:51 -- scripts/common.sh@367 -- # return 0 00:29:26.877 02:40:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:26.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:26.877 --rc genhtml_branch_coverage=1 00:29:26.877 --rc genhtml_function_coverage=1 00:29:26.877 --rc genhtml_legend=1 00:29:26.877 --rc geninfo_all_blocks=1 00:29:26.877 --rc geninfo_unexecuted_blocks=1 00:29:26.877 00:29:26.877 ' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:26.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:26.877 --rc genhtml_branch_coverage=1 00:29:26.877 --rc genhtml_function_coverage=1 00:29:26.877 --rc genhtml_legend=1 00:29:26.877 --rc geninfo_all_blocks=1 00:29:26.877 --rc geninfo_unexecuted_blocks=1 00:29:26.877 00:29:26.877 ' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:26.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:26.877 --rc genhtml_branch_coverage=1 00:29:26.877 --rc genhtml_function_coverage=1 00:29:26.877 --rc genhtml_legend=1 00:29:26.877 --rc geninfo_all_blocks=1 00:29:26.877 --rc geninfo_unexecuted_blocks=1 00:29:26.877 00:29:26.877 ' 00:29:26.877 02:40:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:26.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:26.877 --rc genhtml_branch_coverage=1 00:29:26.877 --rc genhtml_function_coverage=1 00:29:26.877 --rc genhtml_legend=1 00:29:26.877 --rc geninfo_all_blocks=1 00:29:26.877 --rc geninfo_unexecuted_blocks=1 00:29:26.877 00:29:26.877 ' 00:29:26.877 02:40:51 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:26.877 02:40:51 -- nvmf/common.sh@7 -- # uname -s 00:29:26.877 02:40:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:26.877 02:40:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:26.877 02:40:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:26.877 02:40:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:26.877 02:40:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:26.877 02:40:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:26.877 02:40:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:26.877 02:40:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:26.878 02:40:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:26.878 02:40:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:26.878 02:40:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:26.878 02:40:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:26.878 02:40:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:26.878 02:40:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:26.878 02:40:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:26.878 02:40:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:26.878 02:40:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:26.878 02:40:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:26.878 02:40:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:26.878 02:40:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.878 02:40:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.878 02:40:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.878 02:40:51 -- paths/export.sh@5 -- # export PATH 00:29:26.878 02:40:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:26.878 02:40:51 -- nvmf/common.sh@46 -- # : 0 00:29:26.878 02:40:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:26.878 02:40:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:26.878 02:40:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:26.878 02:40:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:26.878 02:40:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:26.878 02:40:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:26.878 02:40:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:26.878 02:40:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:26.878 02:40:51 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:26.878 02:40:51 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:26.878 02:40:51 -- host/digest.sh@16 -- # runtime=2 00:29:26.878 02:40:51 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:26.878 02:40:51 -- host/digest.sh@132 -- # nvmftestinit 00:29:26.878 02:40:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:26.878 02:40:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:26.878 02:40:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:26.878 02:40:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:26.878 02:40:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:26.878 02:40:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:26.878 02:40:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:26.878 02:40:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:26.878 02:40:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:26.878 02:40:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:26.878 02:40:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:26.878 02:40:51 -- common/autotest_common.sh@10 -- # set +x 00:29:29.408 02:40:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:29.408 02:40:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:29.408 02:40:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:29.408 02:40:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:29.408 02:40:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:29.408 02:40:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:29.408 02:40:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:29.408 02:40:53 -- nvmf/common.sh@294 -- # net_devs=() 00:29:29.408 02:40:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:29.408 02:40:53 -- nvmf/common.sh@295 -- # e810=() 00:29:29.408 02:40:53 -- nvmf/common.sh@295 -- # local -ga e810 00:29:29.408 02:40:53 -- nvmf/common.sh@296 -- # x722=() 00:29:29.408 02:40:53 -- nvmf/common.sh@296 -- # local -ga x722 00:29:29.408 02:40:53 -- nvmf/common.sh@297 -- # mlx=() 00:29:29.408 02:40:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:29.408 02:40:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:29.408 02:40:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:29.408 02:40:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:29.408 02:40:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:29.408 02:40:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:29.408 02:40:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:29.408 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:29.408 02:40:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:29.408 02:40:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:29.408 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:29.408 02:40:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:29.408 02:40:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:29.408 02:40:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:29.408 02:40:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:29.408 02:40:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:29.408 02:40:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:29.408 02:40:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:29.408 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:29.408 02:40:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:29.408 02:40:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:29.408 02:40:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:29.408 02:40:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:29.408 02:40:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:29.408 02:40:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:29.408 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:29.409 02:40:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:29.409 02:40:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:29.409 02:40:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:29.409 02:40:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:29.409 02:40:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:29.409 02:40:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:29.409 02:40:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:29.409 02:40:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:29.409 02:40:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:29.409 02:40:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:29.409 02:40:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:29.409 02:40:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:29.409 02:40:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:29.409 02:40:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:29.409 02:40:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:29.409 02:40:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:29.409 02:40:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:29.409 02:40:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:29.409 02:40:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:29.409 02:40:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:29.409 02:40:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:29.409 02:40:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:29.409 02:40:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:29.409 02:40:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:29.409 02:40:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:29.409 02:40:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:29.409 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:29.409 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:29:29.409 00:29:29.409 --- 10.0.0.2 ping statistics --- 00:29:29.409 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:29.409 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:29:29.409 02:40:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:29.409 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:29.409 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:29:29.409 00:29:29.409 --- 10.0.0.1 ping statistics --- 00:29:29.409 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:29.409 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:29:29.409 02:40:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:29.409 02:40:53 -- nvmf/common.sh@410 -- # return 0 00:29:29.409 02:40:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:29.409 02:40:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:29.409 02:40:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:29.409 02:40:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:29.409 02:40:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:29.409 02:40:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:29.409 02:40:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:29.409 02:40:53 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:29.409 02:40:53 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:29.409 02:40:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:29.409 02:40:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:29.409 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:29:29.409 ************************************ 00:29:29.409 START TEST nvmf_digest_clean 00:29:29.409 ************************************ 00:29:29.409 02:40:53 -- common/autotest_common.sh@1114 -- # run_digest 00:29:29.409 02:40:53 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:29.409 02:40:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:29.409 02:40:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:29.409 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:29:29.409 02:40:53 -- nvmf/common.sh@469 -- # nvmfpid=2191608 00:29:29.409 02:40:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:29.409 02:40:53 -- nvmf/common.sh@470 -- # waitforlisten 2191608 00:29:29.409 02:40:53 -- common/autotest_common.sh@829 -- # '[' -z 2191608 ']' 00:29:29.409 02:40:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:29.409 02:40:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:29.409 02:40:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:29.409 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:29.409 02:40:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:29.409 02:40:53 -- common/autotest_common.sh@10 -- # set +x 00:29:29.409 [2024-11-27 02:40:53.790007] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:29.409 [2024-11-27 02:40:53.790096] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:29.409 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.409 [2024-11-27 02:40:53.854156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:29.409 [2024-11-27 02:40:53.941960] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:29.409 [2024-11-27 02:40:53.942147] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:29.409 [2024-11-27 02:40:53.942165] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:29.409 [2024-11-27 02:40:53.942179] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:29.409 [2024-11-27 02:40:53.942208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:29.409 02:40:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:29.409 02:40:54 -- common/autotest_common.sh@862 -- # return 0 00:29:29.409 02:40:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:29.409 02:40:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:29.409 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:29:29.409 02:40:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:29.409 02:40:54 -- host/digest.sh@120 -- # common_target_config 00:29:29.409 02:40:54 -- host/digest.sh@43 -- # rpc_cmd 00:29:29.409 02:40:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.409 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:29:29.667 null0 00:29:29.667 [2024-11-27 02:40:54.143386] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:29.667 [2024-11-27 02:40:54.167646] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:29.667 02:40:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.667 02:40:54 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:29.667 02:40:54 -- host/digest.sh@77 -- # local rw bs qd 00:29:29.667 02:40:54 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:29.667 02:40:54 -- host/digest.sh@80 -- # rw=randread 00:29:29.667 02:40:54 -- host/digest.sh@80 -- # bs=4096 00:29:29.667 02:40:54 -- host/digest.sh@80 -- # qd=128 00:29:29.667 02:40:54 -- host/digest.sh@82 -- # bperfpid=2191632 00:29:29.667 02:40:54 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:29.667 02:40:54 -- host/digest.sh@83 -- # waitforlisten 2191632 /var/tmp/bperf.sock 00:29:29.667 02:40:54 -- common/autotest_common.sh@829 -- # '[' -z 2191632 ']' 00:29:29.667 02:40:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:29.667 02:40:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:29.667 02:40:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:29.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:29.667 02:40:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:29.667 02:40:54 -- common/autotest_common.sh@10 -- # set +x 00:29:29.667 [2024-11-27 02:40:54.212556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:29.668 [2024-11-27 02:40:54.212630] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2191632 ] 00:29:29.668 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.668 [2024-11-27 02:40:54.273803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:29.926 [2024-11-27 02:40:54.364031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:29.926 02:40:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:29.926 02:40:54 -- common/autotest_common.sh@862 -- # return 0 00:29:29.926 02:40:54 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:29.926 02:40:54 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:29.926 02:40:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:30.492 02:40:54 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.492 02:40:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.749 nvme0n1 00:29:30.749 02:40:55 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:30.749 02:40:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.749 Running I/O for 2 seconds... 00:29:33.276 00:29:33.276 Latency(us) 00:29:33.276 [2024-11-27T01:40:57.911Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.276 [2024-11-27T01:40:57.911Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:33.276 nvme0n1 : 2.00 16210.70 63.32 0.00 0.00 7889.40 3422.44 16019.91 00:29:33.276 [2024-11-27T01:40:57.911Z] =================================================================================================================== 00:29:33.276 [2024-11-27T01:40:57.911Z] Total : 16210.70 63.32 0.00 0.00 7889.40 3422.44 16019.91 00:29:33.276 0 00:29:33.276 02:40:57 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:33.276 02:40:57 -- host/digest.sh@92 -- # get_accel_stats 00:29:33.276 02:40:57 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:33.276 02:40:57 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:33.276 | select(.opcode=="crc32c") 00:29:33.276 | "\(.module_name) \(.executed)"' 00:29:33.276 02:40:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:33.276 02:40:57 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:33.276 02:40:57 -- host/digest.sh@93 -- # exp_module=software 00:29:33.276 02:40:57 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:33.276 02:40:57 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:33.276 02:40:57 -- host/digest.sh@97 -- # killprocess 2191632 00:29:33.276 02:40:57 -- common/autotest_common.sh@936 -- # '[' -z 2191632 ']' 00:29:33.276 02:40:57 -- common/autotest_common.sh@940 -- # kill -0 2191632 00:29:33.276 02:40:57 -- common/autotest_common.sh@941 -- # uname 00:29:33.276 02:40:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.276 02:40:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2191632 00:29:33.276 02:40:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:33.276 02:40:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:33.276 02:40:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2191632' 00:29:33.276 killing process with pid 2191632 00:29:33.276 02:40:57 -- common/autotest_common.sh@955 -- # kill 2191632 00:29:33.276 Received shutdown signal, test time was about 2.000000 seconds 00:29:33.276 00:29:33.276 Latency(us) 00:29:33.276 [2024-11-27T01:40:57.911Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.276 [2024-11-27T01:40:57.911Z] =================================================================================================================== 00:29:33.276 [2024-11-27T01:40:57.911Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:33.276 02:40:57 -- common/autotest_common.sh@960 -- # wait 2191632 00:29:33.276 02:40:57 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:33.276 02:40:57 -- host/digest.sh@77 -- # local rw bs qd 00:29:33.276 02:40:57 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:33.276 02:40:57 -- host/digest.sh@80 -- # rw=randread 00:29:33.276 02:40:57 -- host/digest.sh@80 -- # bs=131072 00:29:33.276 02:40:57 -- host/digest.sh@80 -- # qd=16 00:29:33.276 02:40:57 -- host/digest.sh@82 -- # bperfpid=2192056 00:29:33.276 02:40:57 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:33.276 02:40:57 -- host/digest.sh@83 -- # waitforlisten 2192056 /var/tmp/bperf.sock 00:29:33.276 02:40:57 -- common/autotest_common.sh@829 -- # '[' -z 2192056 ']' 00:29:33.276 02:40:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:33.276 02:40:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:33.276 02:40:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:33.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:33.276 02:40:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:33.276 02:40:57 -- common/autotest_common.sh@10 -- # set +x 00:29:33.276 [2024-11-27 02:40:57.907022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:33.276 [2024-11-27 02:40:57.907100] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192056 ] 00:29:33.276 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:33.276 Zero copy mechanism will not be used. 00:29:33.534 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.534 [2024-11-27 02:40:57.971467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.534 [2024-11-27 02:40:58.061702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.534 02:40:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.534 02:40:58 -- common/autotest_common.sh@862 -- # return 0 00:29:33.534 02:40:58 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:33.534 02:40:58 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:33.534 02:40:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:34.100 02:40:58 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.100 02:40:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.358 nvme0n1 00:29:34.358 02:40:58 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:34.358 02:40:58 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:34.617 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:34.617 Zero copy mechanism will not be used. 00:29:34.617 Running I/O for 2 seconds... 00:29:36.517 00:29:36.517 Latency(us) 00:29:36.517 [2024-11-27T01:41:01.152Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.517 [2024-11-27T01:41:01.152Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:36.517 nvme0n1 : 2.00 5191.65 648.96 0.00 0.00 3077.67 728.18 5072.97 00:29:36.518 [2024-11-27T01:41:01.153Z] =================================================================================================================== 00:29:36.518 [2024-11-27T01:41:01.153Z] Total : 5191.65 648.96 0.00 0.00 3077.67 728.18 5072.97 00:29:36.518 0 00:29:36.518 02:41:01 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:36.518 02:41:01 -- host/digest.sh@92 -- # get_accel_stats 00:29:36.518 02:41:01 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:36.518 02:41:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:36.518 02:41:01 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:36.518 | select(.opcode=="crc32c") 00:29:36.518 | "\(.module_name) \(.executed)"' 00:29:36.776 02:41:01 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:36.776 02:41:01 -- host/digest.sh@93 -- # exp_module=software 00:29:36.776 02:41:01 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:36.776 02:41:01 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:36.776 02:41:01 -- host/digest.sh@97 -- # killprocess 2192056 00:29:36.776 02:41:01 -- common/autotest_common.sh@936 -- # '[' -z 2192056 ']' 00:29:36.776 02:41:01 -- common/autotest_common.sh@940 -- # kill -0 2192056 00:29:36.776 02:41:01 -- common/autotest_common.sh@941 -- # uname 00:29:36.776 02:41:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:36.776 02:41:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2192056 00:29:36.776 02:41:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:36.776 02:41:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:36.776 02:41:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2192056' 00:29:36.776 killing process with pid 2192056 00:29:36.776 02:41:01 -- common/autotest_common.sh@955 -- # kill 2192056 00:29:36.776 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.776 00:29:36.776 Latency(us) 00:29:36.776 [2024-11-27T01:41:01.411Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.776 [2024-11-27T01:41:01.411Z] =================================================================================================================== 00:29:36.776 [2024-11-27T01:41:01.411Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.776 02:41:01 -- common/autotest_common.sh@960 -- # wait 2192056 00:29:37.033 02:41:01 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:37.033 02:41:01 -- host/digest.sh@77 -- # local rw bs qd 00:29:37.033 02:41:01 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:37.033 02:41:01 -- host/digest.sh@80 -- # rw=randwrite 00:29:37.033 02:41:01 -- host/digest.sh@80 -- # bs=4096 00:29:37.033 02:41:01 -- host/digest.sh@80 -- # qd=128 00:29:37.033 02:41:01 -- host/digest.sh@82 -- # bperfpid=2192591 00:29:37.033 02:41:01 -- host/digest.sh@83 -- # waitforlisten 2192591 /var/tmp/bperf.sock 00:29:37.033 02:41:01 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:37.033 02:41:01 -- common/autotest_common.sh@829 -- # '[' -z 2192591 ']' 00:29:37.033 02:41:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.033 02:41:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.033 02:41:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.033 02:41:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.033 02:41:01 -- common/autotest_common.sh@10 -- # set +x 00:29:37.033 [2024-11-27 02:41:01.590602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:37.033 [2024-11-27 02:41:01.590683] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2192591 ] 00:29:37.033 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.033 [2024-11-27 02:41:01.651595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.291 [2024-11-27 02:41:01.740083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:37.291 02:41:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:37.291 02:41:01 -- common/autotest_common.sh@862 -- # return 0 00:29:37.291 02:41:01 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:37.291 02:41:01 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:37.291 02:41:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:37.549 02:41:02 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.549 02:41:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.114 nvme0n1 00:29:38.114 02:41:02 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:38.114 02:41:02 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.114 Running I/O for 2 seconds... 00:29:40.014 00:29:40.014 Latency(us) 00:29:40.014 [2024-11-27T01:41:04.649Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.014 [2024-11-27T01:41:04.649Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:40.014 nvme0n1 : 2.01 20374.48 79.59 0.00 0.00 6268.58 2439.40 12184.84 00:29:40.014 [2024-11-27T01:41:04.649Z] =================================================================================================================== 00:29:40.014 [2024-11-27T01:41:04.649Z] Total : 20374.48 79.59 0.00 0.00 6268.58 2439.40 12184.84 00:29:40.014 0 00:29:40.014 02:41:04 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:40.014 02:41:04 -- host/digest.sh@92 -- # get_accel_stats 00:29:40.014 02:41:04 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:40.014 02:41:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:40.014 02:41:04 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:40.014 | select(.opcode=="crc32c") 00:29:40.014 | "\(.module_name) \(.executed)"' 00:29:40.580 02:41:04 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:40.580 02:41:04 -- host/digest.sh@93 -- # exp_module=software 00:29:40.580 02:41:04 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:40.580 02:41:04 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:40.580 02:41:04 -- host/digest.sh@97 -- # killprocess 2192591 00:29:40.580 02:41:04 -- common/autotest_common.sh@936 -- # '[' -z 2192591 ']' 00:29:40.580 02:41:04 -- common/autotest_common.sh@940 -- # kill -0 2192591 00:29:40.580 02:41:04 -- common/autotest_common.sh@941 -- # uname 00:29:40.580 02:41:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:40.580 02:41:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2192591 00:29:40.580 02:41:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:40.580 02:41:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:40.580 02:41:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2192591' 00:29:40.580 killing process with pid 2192591 00:29:40.580 02:41:04 -- common/autotest_common.sh@955 -- # kill 2192591 00:29:40.580 Received shutdown signal, test time was about 2.000000 seconds 00:29:40.580 00:29:40.580 Latency(us) 00:29:40.580 [2024-11-27T01:41:05.215Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.580 [2024-11-27T01:41:05.215Z] =================================================================================================================== 00:29:40.580 [2024-11-27T01:41:05.215Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:40.580 02:41:04 -- common/autotest_common.sh@960 -- # wait 2192591 00:29:40.580 02:41:05 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:40.580 02:41:05 -- host/digest.sh@77 -- # local rw bs qd 00:29:40.580 02:41:05 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:40.580 02:41:05 -- host/digest.sh@80 -- # rw=randwrite 00:29:40.580 02:41:05 -- host/digest.sh@80 -- # bs=131072 00:29:40.580 02:41:05 -- host/digest.sh@80 -- # qd=16 00:29:40.580 02:41:05 -- host/digest.sh@82 -- # bperfpid=2193013 00:29:40.580 02:41:05 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:40.580 02:41:05 -- host/digest.sh@83 -- # waitforlisten 2193013 /var/tmp/bperf.sock 00:29:40.580 02:41:05 -- common/autotest_common.sh@829 -- # '[' -z 2193013 ']' 00:29:40.580 02:41:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:40.581 02:41:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:40.581 02:41:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:40.581 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:40.581 02:41:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:40.581 02:41:05 -- common/autotest_common.sh@10 -- # set +x 00:29:40.581 [2024-11-27 02:41:05.196086] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:40.581 [2024-11-27 02:41:05.196167] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2193013 ] 00:29:40.581 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:40.581 Zero copy mechanism will not be used. 00:29:40.839 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.839 [2024-11-27 02:41:05.258624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.839 [2024-11-27 02:41:05.344703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:40.839 02:41:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:40.839 02:41:05 -- common/autotest_common.sh@862 -- # return 0 00:29:40.839 02:41:05 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:40.839 02:41:05 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:40.839 02:41:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:41.405 02:41:05 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:41.405 02:41:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:41.664 nvme0n1 00:29:41.664 02:41:06 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:41.664 02:41:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:41.664 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:41.664 Zero copy mechanism will not be used. 00:29:41.664 Running I/O for 2 seconds... 00:29:44.192 00:29:44.192 Latency(us) 00:29:44.192 [2024-11-27T01:41:08.827Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.192 [2024-11-27T01:41:08.827Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:44.192 nvme0n1 : 2.00 6369.33 796.17 0.00 0.00 2504.77 1905.40 8543.95 00:29:44.192 [2024-11-27T01:41:08.827Z] =================================================================================================================== 00:29:44.192 [2024-11-27T01:41:08.827Z] Total : 6369.33 796.17 0.00 0.00 2504.77 1905.40 8543.95 00:29:44.192 0 00:29:44.192 02:41:08 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:44.192 02:41:08 -- host/digest.sh@92 -- # get_accel_stats 00:29:44.192 02:41:08 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:44.192 02:41:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:44.192 02:41:08 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:44.192 | select(.opcode=="crc32c") 00:29:44.192 | "\(.module_name) \(.executed)"' 00:29:44.192 02:41:08 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:44.192 02:41:08 -- host/digest.sh@93 -- # exp_module=software 00:29:44.192 02:41:08 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:44.192 02:41:08 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:44.192 02:41:08 -- host/digest.sh@97 -- # killprocess 2193013 00:29:44.192 02:41:08 -- common/autotest_common.sh@936 -- # '[' -z 2193013 ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@940 -- # kill -0 2193013 00:29:44.192 02:41:08 -- common/autotest_common.sh@941 -- # uname 00:29:44.192 02:41:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2193013 00:29:44.192 02:41:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:44.192 02:41:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2193013' 00:29:44.192 killing process with pid 2193013 00:29:44.192 02:41:08 -- common/autotest_common.sh@955 -- # kill 2193013 00:29:44.192 Received shutdown signal, test time was about 2.000000 seconds 00:29:44.192 00:29:44.192 Latency(us) 00:29:44.192 [2024-11-27T01:41:08.827Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.192 [2024-11-27T01:41:08.827Z] =================================================================================================================== 00:29:44.192 [2024-11-27T01:41:08.827Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:44.192 02:41:08 -- common/autotest_common.sh@960 -- # wait 2193013 00:29:44.192 02:41:08 -- host/digest.sh@126 -- # killprocess 2191608 00:29:44.192 02:41:08 -- common/autotest_common.sh@936 -- # '[' -z 2191608 ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@940 -- # kill -0 2191608 00:29:44.192 02:41:08 -- common/autotest_common.sh@941 -- # uname 00:29:44.192 02:41:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2191608 00:29:44.192 02:41:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:44.192 02:41:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:44.192 02:41:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2191608' 00:29:44.192 killing process with pid 2191608 00:29:44.192 02:41:08 -- common/autotest_common.sh@955 -- # kill 2191608 00:29:44.192 02:41:08 -- common/autotest_common.sh@960 -- # wait 2191608 00:29:44.450 00:29:44.450 real 0m15.274s 00:29:44.450 user 0m30.034s 00:29:44.450 sys 0m4.393s 00:29:44.450 02:41:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:44.450 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.450 ************************************ 00:29:44.450 END TEST nvmf_digest_clean 00:29:44.450 ************************************ 00:29:44.450 02:41:09 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:44.450 02:41:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:44.450 02:41:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:44.450 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.450 ************************************ 00:29:44.450 START TEST nvmf_digest_error 00:29:44.450 ************************************ 00:29:44.450 02:41:09 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:44.450 02:41:09 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:44.450 02:41:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:44.450 02:41:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:44.450 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.450 02:41:09 -- nvmf/common.sh@469 -- # nvmfpid=2193462 00:29:44.450 02:41:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:44.450 02:41:09 -- nvmf/common.sh@470 -- # waitforlisten 2193462 00:29:44.450 02:41:09 -- common/autotest_common.sh@829 -- # '[' -z 2193462 ']' 00:29:44.450 02:41:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:44.450 02:41:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:44.450 02:41:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:44.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:44.450 02:41:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:44.450 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.707 [2024-11-27 02:41:09.089143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:44.707 [2024-11-27 02:41:09.089222] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:44.707 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.707 [2024-11-27 02:41:09.154323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:44.707 [2024-11-27 02:41:09.242482] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:44.707 [2024-11-27 02:41:09.242767] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:44.707 [2024-11-27 02:41:09.242786] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:44.707 [2024-11-27 02:41:09.242799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:44.708 [2024-11-27 02:41:09.242853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:44.708 02:41:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:44.708 02:41:09 -- common/autotest_common.sh@862 -- # return 0 00:29:44.708 02:41:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:44.708 02:41:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:44.708 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.708 02:41:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:44.708 02:41:09 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:44.708 02:41:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.708 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.708 [2024-11-27 02:41:09.339521] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:44.966 02:41:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:44.966 02:41:09 -- host/digest.sh@104 -- # common_target_config 00:29:44.966 02:41:09 -- host/digest.sh@43 -- # rpc_cmd 00:29:44.966 02:41:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.966 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.966 null0 00:29:44.966 [2024-11-27 02:41:09.456700] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:44.966 [2024-11-27 02:41:09.480941] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:44.966 02:41:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:44.966 02:41:09 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:44.966 02:41:09 -- host/digest.sh@54 -- # local rw bs qd 00:29:44.966 02:41:09 -- host/digest.sh@56 -- # rw=randread 00:29:44.966 02:41:09 -- host/digest.sh@56 -- # bs=4096 00:29:44.966 02:41:09 -- host/digest.sh@56 -- # qd=128 00:29:44.966 02:41:09 -- host/digest.sh@58 -- # bperfpid=2193601 00:29:44.966 02:41:09 -- host/digest.sh@60 -- # waitforlisten 2193601 /var/tmp/bperf.sock 00:29:44.966 02:41:09 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:44.966 02:41:09 -- common/autotest_common.sh@829 -- # '[' -z 2193601 ']' 00:29:44.966 02:41:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:44.966 02:41:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:44.966 02:41:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:44.966 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:44.966 02:41:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:44.966 02:41:09 -- common/autotest_common.sh@10 -- # set +x 00:29:44.966 [2024-11-27 02:41:09.525897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:44.966 [2024-11-27 02:41:09.525969] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2193601 ] 00:29:44.966 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.966 [2024-11-27 02:41:09.587639] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.225 [2024-11-27 02:41:09.677918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:46.159 02:41:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.159 02:41:10 -- common/autotest_common.sh@862 -- # return 0 00:29:46.159 02:41:10 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.159 02:41:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:46.417 02:41:10 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:46.417 02:41:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.417 02:41:10 -- common/autotest_common.sh@10 -- # set +x 00:29:46.417 02:41:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.417 02:41:10 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.417 02:41:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.981 nvme0n1 00:29:46.981 02:41:11 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:46.981 02:41:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.981 02:41:11 -- common/autotest_common.sh@10 -- # set +x 00:29:46.981 02:41:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.981 02:41:11 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:46.981 02:41:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:46.981 Running I/O for 2 seconds... 00:29:46.981 [2024-11-27 02:41:11.461700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.461763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:23228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.461785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.475128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.475165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:17742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.475186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.488684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.488713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:22794 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.488745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.502757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.502787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.502804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.516678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.516709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.516726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.528330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.528365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.528385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.546241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.546287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15306 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.546308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.557770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.557801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.557836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.570176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.570204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:11723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.570235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.583821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.981 [2024-11-27 02:41:11.583850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:6620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.981 [2024-11-27 02:41:11.583866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.981 [2024-11-27 02:41:11.600774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:46.982 [2024-11-27 02:41:11.600817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.982 [2024-11-27 02:41:11.600837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.617945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.617980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:8504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.617999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.634884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.634920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:11019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.634939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.651665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.651694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.651726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.667444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.667479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.667497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.683363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.683397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.683416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.695463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.695496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:21207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.695515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.710885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.710916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:6982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.710933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.723015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.723045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.723061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.738842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.738871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.738904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.750610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.750637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:5097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.750669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.767149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.767183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:19961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.767201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.784238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.784274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.784292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.800111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.800147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:16319 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.800171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.815827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.815860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19435 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.815879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.828098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.828132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:17144 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.828150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.843536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.843582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.843597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.240 [2024-11-27 02:41:11.860677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.240 [2024-11-27 02:41:11.860720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:19243 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.240 [2024-11-27 02:41:11.860736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.878076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.878110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:22901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.878128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.893751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.893780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:12039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.893812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.912535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.912581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:11578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.912596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.929446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.929479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.929498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.946208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.946242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:24083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.946260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.963227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.963262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:3422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.963281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.980295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.980327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.980346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:11.992012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:11.992046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:11.992064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.499 [2024-11-27 02:41:12.006069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.499 [2024-11-27 02:41:12.006103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:9277 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.499 [2024-11-27 02:41:12.006122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.020056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.020090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.020108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.032146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.032179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:19984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.032198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.046228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.046260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4229 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.046279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.059854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.059900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.059925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.076441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.076474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.076493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.093291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.093324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.093343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.110480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.110514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.110544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.500 [2024-11-27 02:41:12.124674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.500 [2024-11-27 02:41:12.124704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:9163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.500 [2024-11-27 02:41:12.124720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.758 [2024-11-27 02:41:12.137408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.758 [2024-11-27 02:41:12.137441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:11438 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.758 [2024-11-27 02:41:12.137460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.758 [2024-11-27 02:41:12.151707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.758 [2024-11-27 02:41:12.151734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:13160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.758 [2024-11-27 02:41:12.151764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.758 [2024-11-27 02:41:12.168776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.758 [2024-11-27 02:41:12.168804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.758 [2024-11-27 02:41:12.168819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.758 [2024-11-27 02:41:12.186097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.186130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:12497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.186148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.203614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.203647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:20213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.203679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.217691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.217720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.217737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.228897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.228930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.228948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.243785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.243812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:6827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.243842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.261949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.261983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:14878 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.262002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.273738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.273766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.273796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.289343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.289376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:11119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.289395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.303706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.303733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:10879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.303763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.320220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.320253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.320271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.331741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.331770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:8765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.331802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.347944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.347977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:19011 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.347996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.363845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.363880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:20073 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.363898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.375016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.375050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:10971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.375069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.759 [2024-11-27 02:41:12.388218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:47.759 [2024-11-27 02:41:12.388251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:15306 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.759 [2024-11-27 02:41:12.388270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.018 [2024-11-27 02:41:12.401043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.018 [2024-11-27 02:41:12.401076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:1088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.018 [2024-11-27 02:41:12.401094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.018 [2024-11-27 02:41:12.414306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.018 [2024-11-27 02:41:12.414340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.018 [2024-11-27 02:41:12.414359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.018 [2024-11-27 02:41:12.432314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.018 [2024-11-27 02:41:12.432348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:24427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.018 [2024-11-27 02:41:12.432366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.448306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.448338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.448363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.460331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.460365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:16275 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.460384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.474042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.474076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:7059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.474095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.488619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.488664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:13011 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.488680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.500016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.500050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:1133 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.500068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.517609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.517639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:11741 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.517672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.532695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.532723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:12213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.532754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.549965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.549998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:15017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.550016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.562036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.562070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:16087 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.562088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.576749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.576782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:16936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.576813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.594159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.594192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.594210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.609696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.609740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.609756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.621968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.622001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:6338 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.622020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.633940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.633973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:20210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.633992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.019 [2024-11-27 02:41:12.646501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.019 [2024-11-27 02:41:12.646544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:10836 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.019 [2024-11-27 02:41:12.646580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.277 [2024-11-27 02:41:12.659325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.659358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:9762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.659376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.673829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.673858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.673892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.687615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.687645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.687661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.699956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.699989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:11091 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.700007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.710596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.710625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7969 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.710656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.724484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.724518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:276 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.724548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.741054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.741088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.741106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.757918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.757951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.757969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.775003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.775047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:3907 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.775066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.790792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.790848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.790864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.806506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.806552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4809 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.806597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.819639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.819669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:4612 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.819693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.836449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.836483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:22094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.836502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.853586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.853615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:10416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.853646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.865236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.865268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:14650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.865286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.881981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.882015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:24023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.882034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.278 [2024-11-27 02:41:12.897926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.278 [2024-11-27 02:41:12.897960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:3704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.278 [2024-11-27 02:41:12.897978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.915617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.915644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:10363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.915674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.931434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.931468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:25134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.931487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.942901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.942934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:24142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.942953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.958743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.958772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:25190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.958804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.975682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.975710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:16865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.975741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:12.992754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:12.992782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:12.992813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:13.010155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.536 [2024-11-27 02:41:13.010188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:7124 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.536 [2024-11-27 02:41:13.010207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.536 [2024-11-27 02:41:13.025998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.026032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.026051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.038971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.039004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:1796 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.039023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.056660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.056689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:13702 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.056719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.067945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.067978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:25535 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.067996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.084345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.084379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.084404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.101854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.101899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:17908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.101917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.118708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.118738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.118770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.130434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.130467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:11868 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.130485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.143912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.143945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:22478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.143963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.537 [2024-11-27 02:41:13.162183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.537 [2024-11-27 02:41:13.162217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:12979 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.537 [2024-11-27 02:41:13.162235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.179118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.179151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:15101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.179169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.190479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.190512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:20708 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.190540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.206904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.206937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:1027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.206955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.224197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.224239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.224259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.241074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.241108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:8187 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.241126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.257958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.257992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:1918 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.258010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.275008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.275043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:2503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.275063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.291754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.291783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:6999 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.291816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.309431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.309466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:11198 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.309484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.326431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.326465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.326483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.343387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.343421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:12385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.343439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.360122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.360156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:13038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.360174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.377037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.377071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:3588 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.377090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.393988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.394021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:14403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.394039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.411067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.411101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:7556 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.411119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.795 [2024-11-27 02:41:13.428017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:48.795 [2024-11-27 02:41:13.428051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.795 [2024-11-27 02:41:13.428069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.054 [2024-11-27 02:41:13.445049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x86a400) 00:29:49.054 [2024-11-27 02:41:13.445082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.054 [2024-11-27 02:41:13.445101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.054 00:29:49.054 Latency(us) 00:29:49.054 [2024-11-27T01:41:13.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.054 [2024-11-27T01:41:13.689Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:49.054 nvme0n1 : 2.01 16872.85 65.91 0.00 0.00 7579.64 3446.71 26991.12 00:29:49.054 [2024-11-27T01:41:13.689Z] =================================================================================================================== 00:29:49.054 [2024-11-27T01:41:13.689Z] Total : 16872.85 65.91 0.00 0.00 7579.64 3446.71 26991.12 00:29:49.054 0 00:29:49.054 02:41:13 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:49.054 02:41:13 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:49.054 02:41:13 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:49.054 | .driver_specific 00:29:49.054 | .nvme_error 00:29:49.054 | .status_code 00:29:49.054 | .command_transient_transport_error' 00:29:49.054 02:41:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:49.313 02:41:13 -- host/digest.sh@71 -- # (( 132 > 0 )) 00:29:49.313 02:41:13 -- host/digest.sh@73 -- # killprocess 2193601 00:29:49.313 02:41:13 -- common/autotest_common.sh@936 -- # '[' -z 2193601 ']' 00:29:49.313 02:41:13 -- common/autotest_common.sh@940 -- # kill -0 2193601 00:29:49.313 02:41:13 -- common/autotest_common.sh@941 -- # uname 00:29:49.313 02:41:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.313 02:41:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2193601 00:29:49.313 02:41:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:49.313 02:41:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:49.313 02:41:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2193601' 00:29:49.313 killing process with pid 2193601 00:29:49.313 02:41:13 -- common/autotest_common.sh@955 -- # kill 2193601 00:29:49.313 Received shutdown signal, test time was about 2.000000 seconds 00:29:49.313 00:29:49.313 Latency(us) 00:29:49.313 [2024-11-27T01:41:13.948Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.313 [2024-11-27T01:41:13.948Z] =================================================================================================================== 00:29:49.313 [2024-11-27T01:41:13.948Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:49.313 02:41:13 -- common/autotest_common.sh@960 -- # wait 2193601 00:29:49.571 02:41:13 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:49.571 02:41:13 -- host/digest.sh@54 -- # local rw bs qd 00:29:49.571 02:41:13 -- host/digest.sh@56 -- # rw=randread 00:29:49.571 02:41:13 -- host/digest.sh@56 -- # bs=131072 00:29:49.571 02:41:13 -- host/digest.sh@56 -- # qd=16 00:29:49.571 02:41:13 -- host/digest.sh@58 -- # bperfpid=2194162 00:29:49.571 02:41:13 -- host/digest.sh@60 -- # waitforlisten 2194162 /var/tmp/bperf.sock 00:29:49.571 02:41:13 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:49.571 02:41:13 -- common/autotest_common.sh@829 -- # '[' -z 2194162 ']' 00:29:49.571 02:41:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:49.571 02:41:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:49.571 02:41:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:49.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:49.571 02:41:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:49.571 02:41:13 -- common/autotest_common.sh@10 -- # set +x 00:29:49.571 [2024-11-27 02:41:14.031518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:49.571 [2024-11-27 02:41:14.031607] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2194162 ] 00:29:49.571 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:49.571 Zero copy mechanism will not be used. 00:29:49.571 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.571 [2024-11-27 02:41:14.088902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.571 [2024-11-27 02:41:14.172534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.505 02:41:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:50.505 02:41:14 -- common/autotest_common.sh@862 -- # return 0 00:29:50.505 02:41:14 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.505 02:41:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.763 02:41:15 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:50.763 02:41:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.763 02:41:15 -- common/autotest_common.sh@10 -- # set +x 00:29:50.763 02:41:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:50.763 02:41:15 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:50.763 02:41:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.328 nvme0n1 00:29:51.328 02:41:15 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:51.328 02:41:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.328 02:41:15 -- common/autotest_common.sh@10 -- # set +x 00:29:51.328 02:41:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.328 02:41:15 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:51.328 02:41:15 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:51.328 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:51.328 Zero copy mechanism will not be used. 00:29:51.328 Running I/O for 2 seconds... 00:29:51.328 [2024-11-27 02:41:15.958141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.328 [2024-11-27 02:41:15.958197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.328 [2024-11-27 02:41:15.958221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.963701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.963734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.963752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.969329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.969366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.969386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.975291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.975336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.975356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.980277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.980312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.980331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.985891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.985926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.985946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.992289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.992324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.992343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:15.998912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:15.998946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:15.998966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.005454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.005496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.005517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.010935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.010969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.010989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.017042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.017077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.017096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.022850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.022896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.022915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.029496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.029538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.029560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.034511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.034579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.034599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.040226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.040260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.040279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.588 [2024-11-27 02:41:16.045880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.588 [2024-11-27 02:41:16.045914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.588 [2024-11-27 02:41:16.045933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.051615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.051660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.051682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.057112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.057146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.057165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.062831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.062877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.062896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.069034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.069068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.069087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.074011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.074045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.074064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.079494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.079536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.079559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.084553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.084599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.084616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.090447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.090482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.090501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.096351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.096386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.096405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.102348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.102388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.102407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.108195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.108230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.108249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.114846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.114881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.114900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.121329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.121364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.121384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.128875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.128910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.128928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.136288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.136324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.136343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.142605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.142637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.142654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.148155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.148200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.148219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.153746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.153778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.153795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.158746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.158776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.158793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.164301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.164336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.164354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.169739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.169770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.169787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.174931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.174962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.174990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.179601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.179633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.179650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.183958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.183990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.184008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.188536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.188582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.188599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.193765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.193796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.193813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.589 [2024-11-27 02:41:16.199716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.589 [2024-11-27 02:41:16.199747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.589 [2024-11-27 02:41:16.199770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.590 [2024-11-27 02:41:16.205273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.590 [2024-11-27 02:41:16.205305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.590 [2024-11-27 02:41:16.205323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.590 [2024-11-27 02:41:16.211026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.590 [2024-11-27 02:41:16.211059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.590 [2024-11-27 02:41:16.211076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.590 [2024-11-27 02:41:16.216516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.590 [2024-11-27 02:41:16.216583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.590 [2024-11-27 02:41:16.216601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.222305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.222340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.222359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.227790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.227821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.227845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.233284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.233318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.233337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.238916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.238964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.238983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.244956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.244990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.245009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.251957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.252005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.252025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.258441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.258475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.258494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.265160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.265195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.265214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.272315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.272348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.272369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.277122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.277156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.277175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.282491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.282534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.282555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.287733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.287764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.287781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.293763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.293793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.293810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.299762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.299792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.299810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.305381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.305415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.305434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.311208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.311241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.311260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.317341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.317375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.317394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.323385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.323418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.323437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.329248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.329282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.329301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.335102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.335136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.335155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.340655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.849 [2024-11-27 02:41:16.340685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.849 [2024-11-27 02:41:16.340702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.849 [2024-11-27 02:41:16.346082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.346114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.346132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.351697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.351727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.351750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.357481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.357515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.357543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.363316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.363349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.363369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.369110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.369144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.369163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.374704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.374734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.374751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.380221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.380254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.380273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.385293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.385327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.385345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.390073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.390107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.390125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.394647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.394677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.394694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.400274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.400309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.400327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.405798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.405843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.405862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.411966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.412000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.412019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.417091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.417124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.417143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.420538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.420584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.420601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.425920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.425954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.425972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.431580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.431610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.431626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.436112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.436146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.436164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.441442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.441474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.441499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.446343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.446376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.446394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.451719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.451747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.451763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.457237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.457271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.457290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.462004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.462037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.462055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.467309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.467342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.467361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.472861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.472896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.472915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.850 [2024-11-27 02:41:16.478721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:51.850 [2024-11-27 02:41:16.478752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.850 [2024-11-27 02:41:16.478769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.484306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.484340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.484359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.490282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.490322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.490342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.496072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.496105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.496123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.501954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.501989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.502008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.508080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.508114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.508132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.109 [2024-11-27 02:41:16.513919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.109 [2024-11-27 02:41:16.513954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.109 [2024-11-27 02:41:16.513973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.518963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.518997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.519016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.523887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.523921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.523940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.529364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.529398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.529417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.534900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.534933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.534952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.539521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.539582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.539599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.544093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.544127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.544146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.549057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.549091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.549110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.554780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.554815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.554846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.560600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.560645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.560662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.566668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.566713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.566729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.572330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.572364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.572383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.577715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.577760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.577777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.583192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.583225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.583251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.589202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.589235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.589253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.594871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.594922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.594941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.600407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.600440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.600458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.606298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.606332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.606351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.612316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.612350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.612368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.617942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.617976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.617995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.624366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.624400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.624419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.630483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.630516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.630544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.636488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.636542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.636564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.641627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.641658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.641674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.647205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.647238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.647256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.653433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.653466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.653485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.658091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.658124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.658143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.110 [2024-11-27 02:41:16.662940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.110 [2024-11-27 02:41:16.662974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.110 [2024-11-27 02:41:16.662993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.667644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.667674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.667691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.672375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.672408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.672427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.677520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.677561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.677580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.682694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.682725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.682741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.687514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.687570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.687588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.692184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.692218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.692236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.697218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.697251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.697270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.702729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.702760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.702776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.708557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.708588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.708605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.714217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.714252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.714271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.719726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.719757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.719774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.725185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.725218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.725243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.730966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.731001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.731021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.736104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.736138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.736157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.111 [2024-11-27 02:41:16.741102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.111 [2024-11-27 02:41:16.741137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.111 [2024-11-27 02:41:16.741155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.746851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.746885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.746904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.753570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.753599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.753615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.760397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.760432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.760451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.767868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.767902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.767921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.775615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.775646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.775664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.783653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.369 [2024-11-27 02:41:16.783684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.369 [2024-11-27 02:41:16.783702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.369 [2024-11-27 02:41:16.790208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.790242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.790261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.795415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.795448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.795467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.800281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.800314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.800332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.805669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.805699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.805716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.811890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.811924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.811943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.819425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.819458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.819477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.825348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.825383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.825402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.832024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.832059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.832084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.838750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.838781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.838799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.844684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.844716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.844734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.849887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.849922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.849942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.855299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.855332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.855352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.860958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.860993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.861011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.866389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.866422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.866441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.871925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.871959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.871978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.877330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.877364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.877383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.882643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.882689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.882706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.887833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.887866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.887885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.893028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.893062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.893080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.898484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.898517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.898546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.904249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.904282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.904301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.910313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.910346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.910365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.916378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.916412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.916430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.921849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.921883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.921902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.927043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.927076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.927095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.932068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.932102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.932121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.937916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.370 [2024-11-27 02:41:16.937949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.370 [2024-11-27 02:41:16.937968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.370 [2024-11-27 02:41:16.944445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.944479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.944497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.951344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.951377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.951397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.956911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.956945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.956964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.962583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.962613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.962630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.968281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.968316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.968335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.972668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.972698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.972715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.977080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.977113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.977139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.980624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.980654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.980671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.984876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.984909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.984929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.990151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.990185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.990204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:16.995753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:16.995783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:16.995817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.371 [2024-11-27 02:41:17.000891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.371 [2024-11-27 02:41:17.000937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.371 [2024-11-27 02:41:17.000957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.005658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.005688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.005705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.010552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.010597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.010613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.015361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.015393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.015411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.020169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.020206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.020224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.025031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.025063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.025082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.029743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.029772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.029803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.034658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.034685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.034716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.039327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.039361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.039379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.043994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.044026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.044045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.048828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.048871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.048887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.053492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.053531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.053552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.058037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.058069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.058093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.062986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.063018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.063037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.067621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.067650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.067666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.630 [2024-11-27 02:41:17.072443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.630 [2024-11-27 02:41:17.072475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.630 [2024-11-27 02:41:17.072494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.077697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.077727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.077744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.082957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.082992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.083011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.088883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.088917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.088936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.094703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.094734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.094751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.099439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.099473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.099492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.104498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.104547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.104583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.109388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.109421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.109439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.114287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.114319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.114338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.119541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.119588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.119605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.125445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.125479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.125498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.131364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.131398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.131417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.136802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.136851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.136869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.142536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.142569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.142605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.148436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.148471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.148489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.156245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.156280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.156299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.163331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.163365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.163384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.170286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.170320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.170339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.178039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.178072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.178091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.185626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.185657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.185674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.193127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.193160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.193179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.199065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.199100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.199120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.203726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.203757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.203774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.207783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.207812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.207834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.211703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.211732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.211748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.215673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.215702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.215719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.219759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.219788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.219804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.224236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.631 [2024-11-27 02:41:17.224270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.631 [2024-11-27 02:41:17.224290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.631 [2024-11-27 02:41:17.228725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.228756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.228773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.232792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.232823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.232840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.236898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.236931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.236949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.241091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.241124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.241143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.245485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.245534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.245572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.250409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.250441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.250461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.255211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.255245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.255263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.632 [2024-11-27 02:41:17.260055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.632 [2024-11-27 02:41:17.260089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.632 [2024-11-27 02:41:17.260109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.264930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.264963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.264981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.269894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.269929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.269947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.274667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.274697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.274713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.279259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.279292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.279311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.284167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.284209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.284228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.289181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.289217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.289235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.293759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.293789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.293805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.298595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.298624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.298640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.303391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.303425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.303443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.308344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.308376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.308394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.313398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.313432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.313451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.318961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.318996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.319015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.323493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.323535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.323556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.327838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.327872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.327901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.332042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.332076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.332096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.335731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.335761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.335778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.339395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.339429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.339447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.343440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.343473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.343491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.347172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.347205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.347224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.891 [2024-11-27 02:41:17.351963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.891 [2024-11-27 02:41:17.351996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.891 [2024-11-27 02:41:17.352015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.357825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.357856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.357872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.364356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.364390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.364409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.371661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.371692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.371708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.379643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.379674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.379691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.387833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.387863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.387897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.395958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.395992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.396011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.403582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.403613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.403630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.411642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.411687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.411704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.419374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.419408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.419426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.426860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.426894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.426912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.434571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.434602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.434639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.442059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.442092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.442111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.448913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.448947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.448965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.455836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.455870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.455889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.463182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.463215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.463234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.469380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.469414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.469433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.475312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.475345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.475364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.480807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.480837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.480854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.486027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.486061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.486079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.490500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.490547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.490588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.494658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.494688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.494704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.499580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.499609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.499626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.504590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.504620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.504636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.509762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.509792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.509809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.515416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.515450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.515469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.892 [2024-11-27 02:41:17.521184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:52.892 [2024-11-27 02:41:17.521218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.892 [2024-11-27 02:41:17.521237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.526665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.526696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.526712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.531212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.531245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.531263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.535477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.535507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.535531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.538918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.538947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.538964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.542419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.542448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.542464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.546098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.546127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.546144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.549280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.549309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.549325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.552596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.552625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.552641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.555461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.555489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.555505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.558901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.558934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.558952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.563004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.563036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.563060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.567662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.567705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.567720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.572569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.572615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.572632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.577322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.577353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.577371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.582170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.582202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.582220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.586862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.586894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.586912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.591499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.591539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.591573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.596138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.596171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.596189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.600759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.600788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.152 [2024-11-27 02:41:17.600804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.152 [2024-11-27 02:41:17.605264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.152 [2024-11-27 02:41:17.605301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.605320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.609888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.609920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.609937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.614585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.614614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.614631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.619289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.619321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.619340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.624231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.624263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.624281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.629038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.629070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.629089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.633927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.633959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.633976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.639203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.639236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.639254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.644595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.644625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.644647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.650440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.650474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.650492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.656222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.656255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.656273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.661894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.661928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.661947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.667768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.667799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.667816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.674417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.674451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.674469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.680556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.680602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.680618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.685219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.685252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.685270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.690048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.690082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.690101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.694700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.694735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.694753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.700203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.700237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.700256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.706272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.706306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.706325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.712244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.712277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.712295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.717858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.717892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.717911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.723787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.723833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.723853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.729714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.729743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.729774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.735417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.735452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.735471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.741168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.741202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.741221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.746842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.746877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.153 [2024-11-27 02:41:17.746896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.153 [2024-11-27 02:41:17.752376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.153 [2024-11-27 02:41:17.752408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.752427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.758193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.758226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.758246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.763557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.763603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.763620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.768738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.768769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.768786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.773458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.773491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.773511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.777976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.778009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.778027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.154 [2024-11-27 02:41:17.782488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.154 [2024-11-27 02:41:17.782521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.154 [2024-11-27 02:41:17.782549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.787314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.787347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.787373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.791928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.791961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.791979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.796575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.796605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.796621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.801034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.801065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.801083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.806068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.806101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.806120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.810803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.810832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.810848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.815607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.815636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.815652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.820285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.820316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.820334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.825186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.825218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.825237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.412 [2024-11-27 02:41:17.830932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.412 [2024-11-27 02:41:17.830971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.412 [2024-11-27 02:41:17.830991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.836303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.836336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.836355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.841550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.841596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.841613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.846286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.846318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.846336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.850967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.851001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.851019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.855762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.855792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.855808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.860491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.860534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.860555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.865178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.865210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.865228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.869921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.869953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.869970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.874714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.874743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.874759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.879514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.879570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.879587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.883384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.883416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.883433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.887418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.887450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.887469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.892167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.892200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.892219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.897652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.897682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.897700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.902692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.902722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.902739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.907574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.907604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.907620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.912950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.912983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.913009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.918314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.918348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.918367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.924024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.924057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.924077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.929324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.929357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.929376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.934657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.934687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.934704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.413 [2024-11-27 02:41:17.939791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.413 [2024-11-27 02:41:17.939840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.413 [2024-11-27 02:41:17.939860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.414 [2024-11-27 02:41:17.945072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.414 [2024-11-27 02:41:17.945106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.414 [2024-11-27 02:41:17.945125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.414 [2024-11-27 02:41:17.950335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16352f0) 00:29:53.414 [2024-11-27 02:41:17.950368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.414 [2024-11-27 02:41:17.950386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.414 00:29:53.414 Latency(us) 00:29:53.414 [2024-11-27T01:41:18.049Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.414 [2024-11-27T01:41:18.049Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:53.414 nvme0n1 : 2.00 5720.27 715.03 0.00 0.00 2792.53 764.59 10971.21 00:29:53.414 [2024-11-27T01:41:18.049Z] =================================================================================================================== 00:29:53.414 [2024-11-27T01:41:18.049Z] Total : 5720.27 715.03 0.00 0.00 2792.53 764.59 10971.21 00:29:53.414 0 00:29:53.414 02:41:17 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:53.414 02:41:17 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:53.414 02:41:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:53.414 02:41:17 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:53.414 | .driver_specific 00:29:53.414 | .nvme_error 00:29:53.414 | .status_code 00:29:53.414 | .command_transient_transport_error' 00:29:53.697 02:41:18 -- host/digest.sh@71 -- # (( 369 > 0 )) 00:29:53.697 02:41:18 -- host/digest.sh@73 -- # killprocess 2194162 00:29:53.697 02:41:18 -- common/autotest_common.sh@936 -- # '[' -z 2194162 ']' 00:29:53.697 02:41:18 -- common/autotest_common.sh@940 -- # kill -0 2194162 00:29:53.697 02:41:18 -- common/autotest_common.sh@941 -- # uname 00:29:53.697 02:41:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:53.697 02:41:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2194162 00:29:53.697 02:41:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:53.697 02:41:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:53.697 02:41:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2194162' 00:29:53.697 killing process with pid 2194162 00:29:53.697 02:41:18 -- common/autotest_common.sh@955 -- # kill 2194162 00:29:53.697 Received shutdown signal, test time was about 2.000000 seconds 00:29:53.697 00:29:53.697 Latency(us) 00:29:53.697 [2024-11-27T01:41:18.332Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.697 [2024-11-27T01:41:18.332Z] =================================================================================================================== 00:29:53.697 [2024-11-27T01:41:18.332Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:53.697 02:41:18 -- common/autotest_common.sh@960 -- # wait 2194162 00:29:53.983 02:41:18 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:53.983 02:41:18 -- host/digest.sh@54 -- # local rw bs qd 00:29:53.983 02:41:18 -- host/digest.sh@56 -- # rw=randwrite 00:29:53.983 02:41:18 -- host/digest.sh@56 -- # bs=4096 00:29:53.983 02:41:18 -- host/digest.sh@56 -- # qd=128 00:29:53.983 02:41:18 -- host/digest.sh@58 -- # bperfpid=2194688 00:29:53.983 02:41:18 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:53.983 02:41:18 -- host/digest.sh@60 -- # waitforlisten 2194688 /var/tmp/bperf.sock 00:29:53.983 02:41:18 -- common/autotest_common.sh@829 -- # '[' -z 2194688 ']' 00:29:53.983 02:41:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:53.983 02:41:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:53.983 02:41:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:53.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:53.983 02:41:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:53.983 02:41:18 -- common/autotest_common.sh@10 -- # set +x 00:29:53.983 [2024-11-27 02:41:18.517495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:53.983 [2024-11-27 02:41:18.517607] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2194688 ] 00:29:53.983 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.983 [2024-11-27 02:41:18.582436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.242 [2024-11-27 02:41:18.673057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.174 02:41:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:55.174 02:41:19 -- common/autotest_common.sh@862 -- # return 0 00:29:55.174 02:41:19 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:55.174 02:41:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:55.174 02:41:19 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:55.174 02:41:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.174 02:41:19 -- common/autotest_common.sh@10 -- # set +x 00:29:55.174 02:41:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.174 02:41:19 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.174 02:41:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.741 nvme0n1 00:29:55.741 02:41:20 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:55.741 02:41:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.741 02:41:20 -- common/autotest_common.sh@10 -- # set +x 00:29:55.741 02:41:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.741 02:41:20 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:55.741 02:41:20 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:55.741 Running I/O for 2 seconds... 00:29:55.741 [2024-11-27 02:41:20.316219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ee5c8 00:29:55.741 [2024-11-27 02:41:20.317267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:14614 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.741 [2024-11-27 02:41:20.317312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:55.741 [2024-11-27 02:41:20.329706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ee5c8 00:29:55.741 [2024-11-27 02:41:20.330094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.741 [2024-11-27 02:41:20.330128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:55.741 [2024-11-27 02:41:20.342574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190eee38 00:29:55.741 [2024-11-27 02:41:20.343169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:17217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.741 [2024-11-27 02:41:20.343203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:55.741 [2024-11-27 02:41:20.355124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ed920 00:29:55.741 [2024-11-27 02:41:20.355666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:10615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.741 [2024-11-27 02:41:20.355696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:55.741 [2024-11-27 02:41:20.367563] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190e95a0 00:29:55.741 [2024-11-27 02:41:20.368091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:16364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.741 [2024-11-27 02:41:20.368124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:55.999 [2024-11-27 02:41:20.380090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ea680 00:29:55.999 [2024-11-27 02:41:20.380547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:24908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.999 [2024-11-27 02:41:20.380592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:55.999 [2024-11-27 02:41:20.392360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190f31b8 00:29:55.999 [2024-11-27 02:41:20.392817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:15725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.392850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.404782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190f3e60 00:29:56.000 [2024-11-27 02:41:20.405204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:7747 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.405237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.418551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ed920 00:29:56.000 [2024-11-27 02:41:20.419588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:9586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.419617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.429870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190ff3c8 00:29:56.000 [2024-11-27 02:41:20.430852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:14950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.430885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.440892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fd640 00:29:56.000 [2024-11-27 02:41:20.441125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:17329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.441157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.454150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190f6cc8 00:29:56.000 [2024-11-27 02:41:20.454619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.454665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.466763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fe2e8 00:29:56.000 [2024-11-27 02:41:20.467198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6038 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.467231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.479269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190e0630 00:29:56.000 [2024-11-27 02:41:20.479645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.479676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.491441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190f7970 00:29:56.000 [2024-11-27 02:41:20.491791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.491822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.503796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fbcf0 00:29:56.000 [2024-11-27 02:41:20.504104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:8804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.504136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.516333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb8b8 00:29:56.000 [2024-11-27 02:41:20.516611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:18356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.516642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.530796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190f8a50 00:29:56.000 [2024-11-27 02:41:20.532579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:20844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.532607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.542228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.542656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.542699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.556019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.556261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:13453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.556294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.569699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.569924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.569956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.583216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.583462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4509 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.583493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.596825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.597094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.597126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.610444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.610668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.610703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.000 [2024-11-27 02:41:20.624231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.000 [2024-11-27 02:41:20.624442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:7304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.000 [2024-11-27 02:41:20.624473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.637902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.638142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:9383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.638173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.651680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.651977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:2102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.652008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.665518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.665782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.665837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.679292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.679499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.679542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.693152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.693394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:9734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.693425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.706915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.707160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:4391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.707191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.720767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.721011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:6926 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.721041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.734482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.734781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:14232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.734810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.259 [2024-11-27 02:41:20.748163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.259 [2024-11-27 02:41:20.748411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:14371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.259 [2024-11-27 02:41:20.748442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.761916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.762130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.762160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.775679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.775930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:13280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.775961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.789397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.789634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:23143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.789663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.803156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.803361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:16983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.803391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.816941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.817186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.817216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.830652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.830901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:6960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.830932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.844194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.844398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:3985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.844429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.857876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.858117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:19179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.858148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.871699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.872088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.872119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.260 [2024-11-27 02:41:20.885487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.260 [2024-11-27 02:41:20.885782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.260 [2024-11-27 02:41:20.885828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.899154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.899360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:24709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.899391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.912830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.913099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:3353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.913129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.926681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.927062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:5810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.927093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.940499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.940801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:4415 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.940829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.954184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.954423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:17951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.954455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.967990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.968240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:8971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.968277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.981653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.981927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.981958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:20.995378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:20.995636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:20.995664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:21.009153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:21.009358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:4781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:21.009389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:21.022937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:21.023178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6106 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.519 [2024-11-27 02:41:21.023209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.519 [2024-11-27 02:41:21.036666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.519 [2024-11-27 02:41:21.036889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.036921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.050462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.050712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.050740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.064234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.064448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:24557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.064479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.078001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.078249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:6543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.078280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.091697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.091956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:22686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.091987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.105289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.105497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:18211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.105536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.119190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.119432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:3341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.119463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.132979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.133221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.133252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.520 [2024-11-27 02:41:21.146938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.520 [2024-11-27 02:41:21.147192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:15605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.520 [2024-11-27 02:41:21.147223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.160588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.160872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:21334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.160903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.174360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.174594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:4265 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.174623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.188133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.188372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:11909 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.188403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.201913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.202163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:11202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.202194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.215648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.215940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22721 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.215971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.229372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.229637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.229665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.243138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.243350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.243381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.256863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.257112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:10249 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.257143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.270608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.270929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:12022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.270961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.284428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.284672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:21246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.284700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.298152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.298355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:18679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.298386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.312012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.312228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:2882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.312259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.325839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.326091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1909 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.326127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.339469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.339724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:23073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.339753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.353218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.353469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.353499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.366766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.367087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:3919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.367118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.380362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.380602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.380630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.394131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.394372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.394402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:56.779 [2024-11-27 02:41:21.407974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:56.779 [2024-11-27 02:41:21.408183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:6896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.779 [2024-11-27 02:41:21.408213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.421672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.422008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.422040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.435506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.435783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:20237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.435812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.449266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.449531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:14381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.449577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.463054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.463297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:7871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.463328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.476815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.477067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1972 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.477099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.490607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.490869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:14552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.490900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.504345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.504581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18977 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.504609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.518201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.518447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:8575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.518478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.531970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.532207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.532237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.545655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.545945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15957 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.545976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.559369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.038 [2024-11-27 02:41:21.559596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:13601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.038 [2024-11-27 02:41:21.559624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.038 [2024-11-27 02:41:21.573043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.573289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:16811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.573320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.586815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.587073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6434 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.587103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.600614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.600877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.600908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.614305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.614550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:4938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.614596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.627810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.628064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:11438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.628095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.641314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.641562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.641606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.654967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.655175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:11032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.655206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.039 [2024-11-27 02:41:21.668722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.039 [2024-11-27 02:41:21.668991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:1064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.039 [2024-11-27 02:41:21.669021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.682446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.682663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:13535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.682697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.696237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.696453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.696483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.710042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.710246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15505 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.710277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.723919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.724168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:16057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.724199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.737663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.737945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:22410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.737977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.751392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.751658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:1608 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.751688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.765126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.765363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:24098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.765393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.778818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.779085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:15213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.779116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.792543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.792769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.792797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.806304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.806563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.806607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.820057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.820296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.820327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.833698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.833965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:15903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.833996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.847412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.847654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:7197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.847684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.861150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.861357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.861388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.874906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.875116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:18240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.875147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.888433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.888684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:6173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.888712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.902108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.902348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.902378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.915673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.915915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:13280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.915947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.298 [2024-11-27 02:41:21.929265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.298 [2024-11-27 02:41:21.929472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.298 [2024-11-27 02:41:21.929503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:21.942874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:21.943152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:21.943183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:21.956641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:21.956880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:2934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:21.956912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:21.970390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:21.970622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:17771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:21.970650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:21.984152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:21.984390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:21.984421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:21.997860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:21.998106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:21.998137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:22.011575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:22.011874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:22.011905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.557 [2024-11-27 02:41:22.025362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.557 [2024-11-27 02:41:22.025627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:20653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.557 [2024-11-27 02:41:22.025656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.039029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.039238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.039275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.052730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.052948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:24184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.052979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.066482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.066739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:24990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.066768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.080253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.080461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:11070 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.080492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.093981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.094219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:24038 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.094250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.107733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.108081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.108112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.121316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.121538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.121582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.135181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.135433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:12066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.135464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.149004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.149213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:22277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.149244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.162640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.162890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:13765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.162921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.176419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.176641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:14755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.176669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.558 [2024-11-27 02:41:22.190102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.558 [2024-11-27 02:41:22.190341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.558 [2024-11-27 02:41:22.190372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.203859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.204066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.204097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.217603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.217845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:18280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.217876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.231366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.231637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:23334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.231665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.245119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.245360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.245390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.258844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.259084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:12125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.259115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.272550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.272890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:22965 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.272920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.286303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.286551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:7568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.286582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 [2024-11-27 02:41:22.300010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59920) with pdu=0x2000190fb048 00:29:57.816 [2024-11-27 02:41:22.300257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9092 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.816 [2024-11-27 02:41:22.300288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:57.816 00:29:57.816 Latency(us) 00:29:57.816 [2024-11-27T01:41:22.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:57.816 [2024-11-27T01:41:22.451Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:57.817 nvme0n1 : 2.01 18796.18 73.42 0.00 0.00 6794.82 3131.16 13883.92 00:29:57.817 [2024-11-27T01:41:22.452Z] =================================================================================================================== 00:29:57.817 [2024-11-27T01:41:22.452Z] Total : 18796.18 73.42 0.00 0.00 6794.82 3131.16 13883.92 00:29:57.817 0 00:29:57.817 02:41:22 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:57.817 02:41:22 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:57.817 02:41:22 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:57.817 | .driver_specific 00:29:57.817 | .nvme_error 00:29:57.817 | .status_code 00:29:57.817 | .command_transient_transport_error' 00:29:57.817 02:41:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:58.075 02:41:22 -- host/digest.sh@71 -- # (( 147 > 0 )) 00:29:58.075 02:41:22 -- host/digest.sh@73 -- # killprocess 2194688 00:29:58.075 02:41:22 -- common/autotest_common.sh@936 -- # '[' -z 2194688 ']' 00:29:58.075 02:41:22 -- common/autotest_common.sh@940 -- # kill -0 2194688 00:29:58.075 02:41:22 -- common/autotest_common.sh@941 -- # uname 00:29:58.075 02:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.075 02:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2194688 00:29:58.075 02:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:58.075 02:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:58.075 02:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2194688' 00:29:58.075 killing process with pid 2194688 00:29:58.075 02:41:22 -- common/autotest_common.sh@955 -- # kill 2194688 00:29:58.075 Received shutdown signal, test time was about 2.000000 seconds 00:29:58.075 00:29:58.075 Latency(us) 00:29:58.075 [2024-11-27T01:41:22.710Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:58.075 [2024-11-27T01:41:22.710Z] =================================================================================================================== 00:29:58.075 [2024-11-27T01:41:22.710Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:58.075 02:41:22 -- common/autotest_common.sh@960 -- # wait 2194688 00:29:58.334 02:41:22 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:58.334 02:41:22 -- host/digest.sh@54 -- # local rw bs qd 00:29:58.334 02:41:22 -- host/digest.sh@56 -- # rw=randwrite 00:29:58.334 02:41:22 -- host/digest.sh@56 -- # bs=131072 00:29:58.334 02:41:22 -- host/digest.sh@56 -- # qd=16 00:29:58.334 02:41:22 -- host/digest.sh@58 -- # bperfpid=2195145 00:29:58.334 02:41:22 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:58.334 02:41:22 -- host/digest.sh@60 -- # waitforlisten 2195145 /var/tmp/bperf.sock 00:29:58.334 02:41:22 -- common/autotest_common.sh@829 -- # '[' -z 2195145 ']' 00:29:58.334 02:41:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:58.334 02:41:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:58.334 02:41:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:58.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:58.334 02:41:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:58.334 02:41:22 -- common/autotest_common.sh@10 -- # set +x 00:29:58.334 [2024-11-27 02:41:22.884973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:58.334 [2024-11-27 02:41:22.885052] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2195145 ] 00:29:58.334 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:58.334 Zero copy mechanism will not be used. 00:29:58.334 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.334 [2024-11-27 02:41:22.947171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:58.593 [2024-11-27 02:41:23.038125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:59.527 02:41:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:59.527 02:41:23 -- common/autotest_common.sh@862 -- # return 0 00:29:59.527 02:41:23 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:59.527 02:41:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:59.527 02:41:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:59.527 02:41:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.527 02:41:24 -- common/autotest_common.sh@10 -- # set +x 00:29:59.527 02:41:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.527 02:41:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:59.527 02:41:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.093 nvme0n1 00:30:00.093 02:41:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:00.093 02:41:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.093 02:41:24 -- common/autotest_common.sh@10 -- # set +x 00:30:00.093 02:41:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.093 02:41:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:00.093 02:41:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:00.093 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:00.093 Zero copy mechanism will not be used. 00:30:00.093 Running I/O for 2 seconds... 00:30:00.093 [2024-11-27 02:41:24.685133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.685478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.685522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.690034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.690178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.690209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.694449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.694589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.694629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.698761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.698872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.698901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.703083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.703203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.703231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.707382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.707476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.707505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.711824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.711966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.711995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.716218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.716439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.716469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.720507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.720731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.720760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.093 [2024-11-27 02:41:24.725262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.093 [2024-11-27 02:41:24.725394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.093 [2024-11-27 02:41:24.725423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.730150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.730257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.730286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.734770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.734861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.734888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.739710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.739784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.739811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.744612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.744739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.744768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.749437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.749588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.749633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.352 [2024-11-27 02:41:24.754733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.352 [2024-11-27 02:41:24.754932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.352 [2024-11-27 02:41:24.754960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.759641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.759814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.759846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.764519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.764643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.764672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.769494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.769633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.769663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.774607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.774681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.774708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.779546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.779684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.779712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.784489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.784598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.784628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.789171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.789329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.789373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.793846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.794063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.794092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.798696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.798874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.798903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.803742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.803849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.803880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.808042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.808178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.808206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.812376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.812548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.812577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.816958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.817125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.817159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.822113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.822305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.822334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.828150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.828269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.828298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.833700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.833966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.833996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.839243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.839464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.839494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.844605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.844754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.844782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.850023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.850231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.850260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.855148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.855280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.855309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.860447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.860622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.860651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.865931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.866064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.866097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.871266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.871470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.871499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.876598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.876819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.876848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.881748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.881987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.882017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.886919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.353 [2024-11-27 02:41:24.887065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.353 [2024-11-27 02:41:24.887094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.353 [2024-11-27 02:41:24.892246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.892378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.892406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.897769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.897965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.897995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.903010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.903162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.903190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.908384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.908511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.908567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.913637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.913894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.913923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.918975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.919218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.919246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.924073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.924333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.924363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.929331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.929492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.929521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.934521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.934668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.934697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.939862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.940024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.940050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.945064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.945208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.945237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.950641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.950876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.950906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.956113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.956373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.956408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.961504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.961745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.961776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.966903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.967051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.967083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.972233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.972371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.972414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.977559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.977767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.977796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.354 [2024-11-27 02:41:24.982819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.354 [2024-11-27 02:41:24.982968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.354 [2024-11-27 02:41:24.982998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.613 [2024-11-27 02:41:24.988119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.613 [2024-11-27 02:41:24.988371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.613 [2024-11-27 02:41:24.988400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.613 [2024-11-27 02:41:24.993434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.613 [2024-11-27 02:41:24.993663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:24.993692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:24.998860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:24.999042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:24.999090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.004440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.004633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.004663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.009832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.010048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.010077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.015180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.015383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.015429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.020385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.020547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.020575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.025683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.025961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.025994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.030958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.031221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.031251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.036166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.036432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.036461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.041331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.041495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.041535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.046522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.046775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.046805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.051260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.051387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.051438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.055510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.055708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.055737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.059859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.060031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.060077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.064198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.064369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.064398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.068583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.068761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.068790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.073150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.073329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.073358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.077359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.077472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.077501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.081818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.081975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.082023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.086212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.086398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.086427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.090427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.090559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.090589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.094738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.094878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.094906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.099131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.099308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.099337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.103558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.103771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.103801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.107888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.108084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.108114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.112247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.112354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.112383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.116506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.614 [2024-11-27 02:41:25.116718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.614 [2024-11-27 02:41:25.116747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.614 [2024-11-27 02:41:25.120745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.120921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.120950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.125174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.125286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.125315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.129509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.129690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.129719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.134377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.134620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.134650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.139954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.140179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.140208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.145817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.146048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.146077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.151109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.151295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.151324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.156223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.156391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.156419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.162129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.162306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.162335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.168107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.168281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.168316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.172773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.172872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.172901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.176991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.177167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.177195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.181963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.182143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.182174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.187332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.187450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.187479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.192565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.192794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.192827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.197551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.197811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.197863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.203394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.203606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.203636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.209299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.209426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.209455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.213652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.213792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.213820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.218419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.218656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.218685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.223176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.223351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.223381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.227857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.228092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.228138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.232455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.232608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.232637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.237084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.237218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.237247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.241970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.615 [2024-11-27 02:41:25.242212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.615 [2024-11-27 02:41:25.242245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.615 [2024-11-27 02:41:25.246473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.246612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.246642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.250872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.250995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.251040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.255312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.255519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.255556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.260224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.260480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.260510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.265369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.265605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.265635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.270473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.270656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.270685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.275471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.275679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.275709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.280634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.280810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.280839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.285730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.285952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.285981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.290756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.290900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.290928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.295778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.295967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.296018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.300939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.301149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.301178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.305955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.306118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.306149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.311071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.311254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.311282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.316138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.316334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.316363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.321291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.321487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.321518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.326370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.326571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.326600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.331458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.331657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.331686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.336639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.336943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.875 [2024-11-27 02:41:25.336971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.875 [2024-11-27 02:41:25.341587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.875 [2024-11-27 02:41:25.341772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.341801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.346733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.346986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.347014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.351668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.351869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.351897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.356783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.356934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.356965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.361854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.362065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.362093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.366887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.367100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.367128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.371977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.372165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.372194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.377640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.377893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.377922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.383418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.383600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.383629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.388892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.389087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.389116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.394002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.394266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.394296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.399216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.399387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.399416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.405175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.405474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.405503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.410566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.410702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.410731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.414905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.415065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.415096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.419670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.419851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.419879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.424333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.424487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.424515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.428899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.428993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.429027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.433302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.433484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.433538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.438123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.438336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.438364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.443321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.443596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.443625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.448933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.449111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.449138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.454658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.454792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.454821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.459180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.459379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.459425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.463700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.463884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.463913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.468339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.468578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.468607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.473033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.473195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.876 [2024-11-27 02:41:25.473225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.876 [2024-11-27 02:41:25.477715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.876 [2024-11-27 02:41:25.477844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.477875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.482329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.482421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.482448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.486920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.487057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.487085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.491420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.491579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.491608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.496033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.496198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.496226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.500577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.500755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.500783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.877 [2024-11-27 02:41:25.505395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:00.877 [2024-11-27 02:41:25.505611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.877 [2024-11-27 02:41:25.505640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.510027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.510162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.510195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.514676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.514785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.514813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.519310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.519540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.519584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.524130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.524249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.524279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.528605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.528753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.528781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.533297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.135 [2024-11-27 02:41:25.533542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.135 [2024-11-27 02:41:25.533588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.135 [2024-11-27 02:41:25.537982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.538144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.538172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.542634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.542838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.542868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.547264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.547418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.547447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.551823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.551972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.552019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.556602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.556755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.556783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.561300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.561458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.561486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.565833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.565971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.565999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.570708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.570891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.570920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.575227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.575373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.575413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.580100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.580282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.580310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.584742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.584843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.584872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.589049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.589208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.589236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.593773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.593945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.593974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.598545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.598681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.598709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.603028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.603171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.603199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.607727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.607911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.607939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.612377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.612574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.612603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.617072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.617289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.617318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.621849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.621979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.622008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.626479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.626619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.626648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.631206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.631393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.631432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.635930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.636040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.636068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.640482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.640648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.640678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.645325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.136 [2024-11-27 02:41:25.645544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.136 [2024-11-27 02:41:25.645589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.136 [2024-11-27 02:41:25.650175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.650339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.650371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.654962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.655147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.655179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.659173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.659337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.659365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.664094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.664260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.664288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.669321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.669523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.669559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.674926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.675092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.675124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.680696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.680826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.680855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.684950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.685130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.685159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.689473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.689630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.689658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.694055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.694244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.694273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.698203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.698331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.698359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.702393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.702507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.702547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.707132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.707219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.707245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.713237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.713389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.713418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.718572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.718688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.718717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.724108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.724348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.724377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.729210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.729399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.729444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.734559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.734713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.734742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.739951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.740243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.740273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.745797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.745978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.746006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.752117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.752296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.752327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.758672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.758856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.758888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.137 [2024-11-27 02:41:25.765060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.137 [2024-11-27 02:41:25.765244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.137 [2024-11-27 02:41:25.765278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.771437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.771596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.771625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.778133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.778307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.778336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.784374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.784618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.784647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.789672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.789930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.789958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.794953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.795126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.795158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.799857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.800020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.800048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.805165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.805399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.805428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.810363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.810580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.810609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.815806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.815916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.815945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.821911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.822076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.822104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.826994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.827169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.827198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.831736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.832052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.832081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.836251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.836495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.396 [2024-11-27 02:41:25.836550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.396 [2024-11-27 02:41:25.840539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.396 [2024-11-27 02:41:25.840648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.840677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.845784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.845889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.845917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.851520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.851725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.851754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.856188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.856320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.856348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.860732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.860834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.860861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.865780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.865897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.865926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.870625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.870824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.870853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.875519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.875641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.875670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.881160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.881257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.881289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.886884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.887023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.887051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.893127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.893282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.893315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.898310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.898486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.898516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.903523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.903673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.903706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.908545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.908682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.908710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.912866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.913052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.913098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.917336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.917519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.917574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.921822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.921940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.921969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.927117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.927234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.927266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.932146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.932302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.932346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.937388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.937552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.937580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.942683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.942840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.942869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.948059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.948204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.948232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.954543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.954781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.954810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.959387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.959642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.959671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.963731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.963934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.963962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.968416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.968603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.968633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.973733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.973822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.973851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.397 [2024-11-27 02:41:25.978597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.397 [2024-11-27 02:41:25.978710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.397 [2024-11-27 02:41:25.978738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:25.983577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:25.983735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:25.983764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:25.988654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:25.988753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:25.988782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:25.994798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:25.995096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:25.995125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.000854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.001134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.001163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.005990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.006254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.006282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.010956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.011141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.011169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.015928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.016132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.016160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.021612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.021801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.021829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.398 [2024-11-27 02:41:26.026870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.398 [2024-11-27 02:41:26.027014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.398 [2024-11-27 02:41:26.027041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.032308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.032542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.032573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.037635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.037919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.037953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.042849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.043089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.043118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.047948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.048103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.048132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.053140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.053355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.053399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.058409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.058567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.058596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.063566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.063727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.063754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.069019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.069282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.069310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.074169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.074404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.074431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.079345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.079501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.079536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.084687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.084886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.084913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.090089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.090302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.090330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.095301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.095466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.095494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.100771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.100962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.100992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.105843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.106004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.106032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.111284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.111466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.111494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.116857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.117099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.117127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.122009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.122150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.122177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.127208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.127349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.127378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.132537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.132766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.132795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.137854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.138084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.138112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.143127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.143374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.143406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.148347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.148554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.148600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.153753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.657 [2024-11-27 02:41:26.153898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.657 [2024-11-27 02:41:26.153926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.657 [2024-11-27 02:41:26.159260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.159435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.159463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.164349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.164608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.164638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.169764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.170005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.170033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.175185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.175425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.175459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.180669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.180865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.180894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.185873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.186016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.186044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.191179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.191397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.191425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.196303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.196480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.196509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.201555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.201783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.201811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.206893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.207142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.207175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.212059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.212211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.212239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.217306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.217446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.217474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.222539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.222727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.222754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.228124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.228316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.228345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.233538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.233670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.233697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.238916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.239190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.239219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.244120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.244365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.244394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.249493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.249718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.249747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.255087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.255268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.255296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.260670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.260858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.260886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.266022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.266192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.266225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.271260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.271426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.271455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.276604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.276736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.276764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.282279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.282518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.282559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.658 [2024-11-27 02:41:26.287387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.658 [2024-11-27 02:41:26.287615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.658 [2024-11-27 02:41:26.287645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.917 [2024-11-27 02:41:26.292801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.293045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.293074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.297951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.298085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.298113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.303289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.303406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.303434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.308836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.308998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.309027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.314051] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.314200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.314229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.319564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.319845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.319874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.324805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.324980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.325009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.330082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.330251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.330280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.335626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.335781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.335815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.340875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.341016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.341044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.346240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.346343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.346371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.351624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.351822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.351850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.357081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.357243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.357274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.362348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.362603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.362632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.367720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.368000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.368029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.373131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.373270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.373298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.378564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.378725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.378753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.384058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.384186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.384214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.389505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.389642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.389670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.395047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.395233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.395261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.400735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.401004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.401033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.406158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.406442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.406479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.411346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.411672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.411703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.416548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.416710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.416738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.421666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.421805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.421833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.426767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.918 [2024-11-27 02:41:26.426978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.918 [2024-11-27 02:41:26.427022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.918 [2024-11-27 02:41:26.432033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.432181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.432210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.437356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.437511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.437553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.442895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.443185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.443214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.448279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.448521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.448578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.453941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.454193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.454222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.459365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.459519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.459555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.464941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.465088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.465119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.470296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.470482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.470511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.475754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.475917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.475946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.481068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.481273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.481301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.487453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.487641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.487669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.492617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.492842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.492870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.498111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.498325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.498353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.503383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.503576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.503604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.508868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.509032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.509077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.514071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.514247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.514275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.519568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.519721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.519750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.524872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.525042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.525070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.530206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.530391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.530438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.535413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.535595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.535623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.540750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.541032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.541062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.919 [2024-11-27 02:41:26.546230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:01.919 [2024-11-27 02:41:26.546387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.919 [2024-11-27 02:41:26.546419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.551542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.551737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.551766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.556905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.557076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.557107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.562396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.562539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.562568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.568048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.568244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.568273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.573870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.574075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.574104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.578969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.579215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.579244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.584698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.584915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.584944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.590342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.590480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.590509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.596056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.596209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.596238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.601198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.601383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.601426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.605892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.606054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.606083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.610157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.610298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.610330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.614560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.614763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.614791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.178 [2024-11-27 02:41:26.618833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.178 [2024-11-27 02:41:26.619014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.178 [2024-11-27 02:41:26.619044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.623215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.623440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.623483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.627475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.627622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.627651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.631812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.631933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.631967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.636230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.636420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.636467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.640539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.640666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.640694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.644791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.644919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.644947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.649290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.649509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.649545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.653500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.653728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.653757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.657818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.658058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.658087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.662422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.662640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.662670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.667479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.667623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.667651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.672480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.672741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.672770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.677517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.677696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.677724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.179 [2024-11-27 02:41:26.682579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e59ac0) with pdu=0x2000190fef90 00:30:02.179 [2024-11-27 02:41:26.682736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.179 [2024-11-27 02:41:26.682764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.179 00:30:02.179 Latency(us) 00:30:02.179 [2024-11-27T01:41:26.814Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:02.179 [2024-11-27T01:41:26.814Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:02.179 nvme0n1 : 2.00 6101.58 762.70 0.00 0.00 2614.73 1905.40 6747.78 00:30:02.179 [2024-11-27T01:41:26.814Z] =================================================================================================================== 00:30:02.179 [2024-11-27T01:41:26.814Z] Total : 6101.58 762.70 0.00 0.00 2614.73 1905.40 6747.78 00:30:02.179 0 00:30:02.179 02:41:26 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:02.179 02:41:26 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:02.179 02:41:26 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:02.179 | .driver_specific 00:30:02.179 | .nvme_error 00:30:02.179 | .status_code 00:30:02.179 | .command_transient_transport_error' 00:30:02.179 02:41:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:02.437 02:41:26 -- host/digest.sh@71 -- # (( 394 > 0 )) 00:30:02.437 02:41:26 -- host/digest.sh@73 -- # killprocess 2195145 00:30:02.437 02:41:26 -- common/autotest_common.sh@936 -- # '[' -z 2195145 ']' 00:30:02.437 02:41:26 -- common/autotest_common.sh@940 -- # kill -0 2195145 00:30:02.437 02:41:26 -- common/autotest_common.sh@941 -- # uname 00:30:02.437 02:41:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:02.437 02:41:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2195145 00:30:02.437 02:41:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:02.437 02:41:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:02.437 02:41:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2195145' 00:30:02.437 killing process with pid 2195145 00:30:02.437 02:41:26 -- common/autotest_common.sh@955 -- # kill 2195145 00:30:02.437 Received shutdown signal, test time was about 2.000000 seconds 00:30:02.437 00:30:02.437 Latency(us) 00:30:02.437 [2024-11-27T01:41:27.072Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:02.437 [2024-11-27T01:41:27.072Z] =================================================================================================================== 00:30:02.437 [2024-11-27T01:41:27.072Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:02.437 02:41:26 -- common/autotest_common.sh@960 -- # wait 2195145 00:30:02.696 02:41:27 -- host/digest.sh@115 -- # killprocess 2193462 00:30:02.696 02:41:27 -- common/autotest_common.sh@936 -- # '[' -z 2193462 ']' 00:30:02.696 02:41:27 -- common/autotest_common.sh@940 -- # kill -0 2193462 00:30:02.696 02:41:27 -- common/autotest_common.sh@941 -- # uname 00:30:02.696 02:41:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:02.696 02:41:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2193462 00:30:02.696 02:41:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:02.696 02:41:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:02.696 02:41:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2193462' 00:30:02.696 killing process with pid 2193462 00:30:02.696 02:41:27 -- common/autotest_common.sh@955 -- # kill 2193462 00:30:02.696 02:41:27 -- common/autotest_common.sh@960 -- # wait 2193462 00:30:02.955 00:30:02.955 real 0m18.434s 00:30:02.955 user 0m37.471s 00:30:02.955 sys 0m4.578s 00:30:02.955 02:41:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:02.955 02:41:27 -- common/autotest_common.sh@10 -- # set +x 00:30:02.955 ************************************ 00:30:02.955 END TEST nvmf_digest_error 00:30:02.955 ************************************ 00:30:02.955 02:41:27 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:02.955 02:41:27 -- host/digest.sh@139 -- # nvmftestfini 00:30:02.955 02:41:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:02.955 02:41:27 -- nvmf/common.sh@116 -- # sync 00:30:02.955 02:41:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:02.955 02:41:27 -- nvmf/common.sh@119 -- # set +e 00:30:02.955 02:41:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:02.955 02:41:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:02.955 rmmod nvme_tcp 00:30:02.955 rmmod nvme_fabrics 00:30:02.955 rmmod nvme_keyring 00:30:02.955 02:41:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:02.955 02:41:27 -- nvmf/common.sh@123 -- # set -e 00:30:02.955 02:41:27 -- nvmf/common.sh@124 -- # return 0 00:30:02.955 02:41:27 -- nvmf/common.sh@477 -- # '[' -n 2193462 ']' 00:30:02.955 02:41:27 -- nvmf/common.sh@478 -- # killprocess 2193462 00:30:02.955 02:41:27 -- common/autotest_common.sh@936 -- # '[' -z 2193462 ']' 00:30:02.955 02:41:27 -- common/autotest_common.sh@940 -- # kill -0 2193462 00:30:02.955 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2193462) - No such process 00:30:02.955 02:41:27 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2193462 is not found' 00:30:02.955 Process with pid 2193462 is not found 00:30:02.955 02:41:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:02.955 02:41:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:02.955 02:41:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:02.955 02:41:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:02.955 02:41:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:02.955 02:41:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:02.955 02:41:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:02.955 02:41:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:05.490 02:41:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:05.490 00:30:05.490 real 0m38.348s 00:30:05.490 user 1m8.446s 00:30:05.490 sys 0m10.653s 00:30:05.490 02:41:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:05.490 02:41:29 -- common/autotest_common.sh@10 -- # set +x 00:30:05.490 ************************************ 00:30:05.490 END TEST nvmf_digest 00:30:05.490 ************************************ 00:30:05.490 02:41:29 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:05.490 02:41:29 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:05.490 02:41:29 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:05.490 02:41:29 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:05.490 02:41:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:05.490 02:41:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:05.490 02:41:29 -- common/autotest_common.sh@10 -- # set +x 00:30:05.490 ************************************ 00:30:05.490 START TEST nvmf_bdevperf 00:30:05.490 ************************************ 00:30:05.490 02:41:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:05.490 * Looking for test storage... 00:30:05.490 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:05.490 02:41:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:05.490 02:41:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:05.490 02:41:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:05.491 02:41:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:05.491 02:41:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:05.491 02:41:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:05.491 02:41:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:05.491 02:41:29 -- scripts/common.sh@335 -- # IFS=.-: 00:30:05.491 02:41:29 -- scripts/common.sh@335 -- # read -ra ver1 00:30:05.491 02:41:29 -- scripts/common.sh@336 -- # IFS=.-: 00:30:05.491 02:41:29 -- scripts/common.sh@336 -- # read -ra ver2 00:30:05.491 02:41:29 -- scripts/common.sh@337 -- # local 'op=<' 00:30:05.491 02:41:29 -- scripts/common.sh@339 -- # ver1_l=2 00:30:05.491 02:41:29 -- scripts/common.sh@340 -- # ver2_l=1 00:30:05.491 02:41:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:05.491 02:41:29 -- scripts/common.sh@343 -- # case "$op" in 00:30:05.491 02:41:29 -- scripts/common.sh@344 -- # : 1 00:30:05.491 02:41:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:05.491 02:41:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:05.491 02:41:29 -- scripts/common.sh@364 -- # decimal 1 00:30:05.491 02:41:29 -- scripts/common.sh@352 -- # local d=1 00:30:05.491 02:41:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:05.491 02:41:29 -- scripts/common.sh@354 -- # echo 1 00:30:05.491 02:41:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:05.491 02:41:29 -- scripts/common.sh@365 -- # decimal 2 00:30:05.491 02:41:29 -- scripts/common.sh@352 -- # local d=2 00:30:05.491 02:41:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:05.491 02:41:29 -- scripts/common.sh@354 -- # echo 2 00:30:05.491 02:41:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:05.491 02:41:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:05.491 02:41:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:05.491 02:41:29 -- scripts/common.sh@367 -- # return 0 00:30:05.491 02:41:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:05.491 02:41:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:05.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.491 --rc genhtml_branch_coverage=1 00:30:05.491 --rc genhtml_function_coverage=1 00:30:05.491 --rc genhtml_legend=1 00:30:05.491 --rc geninfo_all_blocks=1 00:30:05.491 --rc geninfo_unexecuted_blocks=1 00:30:05.491 00:30:05.491 ' 00:30:05.491 02:41:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:05.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.491 --rc genhtml_branch_coverage=1 00:30:05.491 --rc genhtml_function_coverage=1 00:30:05.491 --rc genhtml_legend=1 00:30:05.491 --rc geninfo_all_blocks=1 00:30:05.491 --rc geninfo_unexecuted_blocks=1 00:30:05.491 00:30:05.491 ' 00:30:05.491 02:41:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:05.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.491 --rc genhtml_branch_coverage=1 00:30:05.491 --rc genhtml_function_coverage=1 00:30:05.491 --rc genhtml_legend=1 00:30:05.491 --rc geninfo_all_blocks=1 00:30:05.491 --rc geninfo_unexecuted_blocks=1 00:30:05.491 00:30:05.491 ' 00:30:05.491 02:41:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:05.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.491 --rc genhtml_branch_coverage=1 00:30:05.491 --rc genhtml_function_coverage=1 00:30:05.491 --rc genhtml_legend=1 00:30:05.491 --rc geninfo_all_blocks=1 00:30:05.491 --rc geninfo_unexecuted_blocks=1 00:30:05.491 00:30:05.491 ' 00:30:05.491 02:41:29 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:05.491 02:41:29 -- nvmf/common.sh@7 -- # uname -s 00:30:05.491 02:41:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:05.491 02:41:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:05.491 02:41:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:05.491 02:41:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:05.491 02:41:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:05.491 02:41:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:05.491 02:41:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:05.491 02:41:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:05.491 02:41:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:05.491 02:41:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:05.491 02:41:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:05.491 02:41:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:05.491 02:41:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:05.491 02:41:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:05.491 02:41:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:05.491 02:41:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:05.491 02:41:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:05.491 02:41:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:05.491 02:41:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:05.491 02:41:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.491 02:41:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.491 02:41:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.491 02:41:29 -- paths/export.sh@5 -- # export PATH 00:30:05.491 02:41:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.491 02:41:29 -- nvmf/common.sh@46 -- # : 0 00:30:05.491 02:41:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:05.491 02:41:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:05.491 02:41:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:05.491 02:41:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:05.491 02:41:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:05.491 02:41:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:05.491 02:41:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:05.491 02:41:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:05.491 02:41:29 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:05.491 02:41:29 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:05.491 02:41:29 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:05.491 02:41:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:05.491 02:41:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:05.491 02:41:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:05.491 02:41:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:05.491 02:41:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:05.491 02:41:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:05.491 02:41:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:05.491 02:41:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:05.491 02:41:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:05.491 02:41:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:05.491 02:41:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:05.491 02:41:29 -- common/autotest_common.sh@10 -- # set +x 00:30:07.395 02:41:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:07.395 02:41:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:07.395 02:41:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:07.395 02:41:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:07.395 02:41:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:07.395 02:41:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:07.395 02:41:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:07.395 02:41:31 -- nvmf/common.sh@294 -- # net_devs=() 00:30:07.395 02:41:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:07.395 02:41:31 -- nvmf/common.sh@295 -- # e810=() 00:30:07.395 02:41:31 -- nvmf/common.sh@295 -- # local -ga e810 00:30:07.395 02:41:31 -- nvmf/common.sh@296 -- # x722=() 00:30:07.395 02:41:31 -- nvmf/common.sh@296 -- # local -ga x722 00:30:07.395 02:41:31 -- nvmf/common.sh@297 -- # mlx=() 00:30:07.395 02:41:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:07.395 02:41:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:07.395 02:41:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:07.396 02:41:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:07.396 02:41:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:07.396 02:41:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:07.396 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:07.396 02:41:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:07.396 02:41:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:07.396 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:07.396 02:41:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:07.396 02:41:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:07.396 02:41:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:07.396 02:41:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:07.396 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:07.396 02:41:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:07.396 02:41:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:07.396 02:41:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:07.396 02:41:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:07.396 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:07.396 02:41:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:07.396 02:41:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:07.396 02:41:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:07.396 02:41:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:07.396 02:41:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:07.396 02:41:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:07.396 02:41:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:07.396 02:41:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:07.396 02:41:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:07.396 02:41:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:07.396 02:41:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:07.396 02:41:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:07.396 02:41:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:07.396 02:41:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:07.396 02:41:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:07.396 02:41:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:07.396 02:41:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:07.396 02:41:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:07.396 02:41:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:07.396 02:41:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:07.396 02:41:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:07.396 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:07.396 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:30:07.396 00:30:07.396 --- 10.0.0.2 ping statistics --- 00:30:07.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:07.396 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:30:07.396 02:41:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:07.396 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:07.396 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:30:07.396 00:30:07.396 --- 10.0.0.1 ping statistics --- 00:30:07.396 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:07.396 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:30:07.396 02:41:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:07.396 02:41:31 -- nvmf/common.sh@410 -- # return 0 00:30:07.396 02:41:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:07.396 02:41:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:07.396 02:41:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:07.396 02:41:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:07.396 02:41:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:07.396 02:41:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:07.396 02:41:31 -- host/bdevperf.sh@25 -- # tgt_init 00:30:07.396 02:41:31 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:07.396 02:41:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:07.396 02:41:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:07.396 02:41:31 -- common/autotest_common.sh@10 -- # set +x 00:30:07.396 02:41:31 -- nvmf/common.sh@469 -- # nvmfpid=2197662 00:30:07.396 02:41:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:07.396 02:41:31 -- nvmf/common.sh@470 -- # waitforlisten 2197662 00:30:07.396 02:41:31 -- common/autotest_common.sh@829 -- # '[' -z 2197662 ']' 00:30:07.396 02:41:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:07.396 02:41:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:07.396 02:41:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:07.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:07.396 02:41:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:07.396 02:41:31 -- common/autotest_common.sh@10 -- # set +x 00:30:07.396 [2024-11-27 02:41:32.017495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:07.396 [2024-11-27 02:41:32.017608] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:07.655 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.655 [2024-11-27 02:41:32.091169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:07.655 [2024-11-27 02:41:32.182635] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:07.655 [2024-11-27 02:41:32.182815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:07.655 [2024-11-27 02:41:32.182835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:07.655 [2024-11-27 02:41:32.182850] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:07.655 [2024-11-27 02:41:32.182940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:07.655 [2024-11-27 02:41:32.183055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:07.655 [2024-11-27 02:41:32.183058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:08.594 02:41:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:08.594 02:41:32 -- common/autotest_common.sh@862 -- # return 0 00:30:08.594 02:41:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:08.594 02:41:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:08.594 02:41:32 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 02:41:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:08.594 02:41:32 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:08.594 02:41:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.594 02:41:32 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 [2024-11-27 02:41:33.003971] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:08.594 02:41:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.594 02:41:33 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:08.594 02:41:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.594 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 Malloc0 00:30:08.594 02:41:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.594 02:41:33 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:08.594 02:41:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.594 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 02:41:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.594 02:41:33 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:08.594 02:41:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.594 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 02:41:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.594 02:41:33 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:08.594 02:41:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.594 02:41:33 -- common/autotest_common.sh@10 -- # set +x 00:30:08.594 [2024-11-27 02:41:33.060375] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:08.594 02:41:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.594 02:41:33 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:08.594 02:41:33 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:08.594 02:41:33 -- nvmf/common.sh@520 -- # config=() 00:30:08.594 02:41:33 -- nvmf/common.sh@520 -- # local subsystem config 00:30:08.594 02:41:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:08.594 02:41:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:08.594 { 00:30:08.594 "params": { 00:30:08.594 "name": "Nvme$subsystem", 00:30:08.594 "trtype": "$TEST_TRANSPORT", 00:30:08.594 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:08.594 "adrfam": "ipv4", 00:30:08.594 "trsvcid": "$NVMF_PORT", 00:30:08.594 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:08.594 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:08.594 "hdgst": ${hdgst:-false}, 00:30:08.594 "ddgst": ${ddgst:-false} 00:30:08.594 }, 00:30:08.594 "method": "bdev_nvme_attach_controller" 00:30:08.594 } 00:30:08.594 EOF 00:30:08.594 )") 00:30:08.594 02:41:33 -- nvmf/common.sh@542 -- # cat 00:30:08.594 02:41:33 -- nvmf/common.sh@544 -- # jq . 00:30:08.594 02:41:33 -- nvmf/common.sh@545 -- # IFS=, 00:30:08.594 02:41:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:08.594 "params": { 00:30:08.594 "name": "Nvme1", 00:30:08.594 "trtype": "tcp", 00:30:08.594 "traddr": "10.0.0.2", 00:30:08.594 "adrfam": "ipv4", 00:30:08.594 "trsvcid": "4420", 00:30:08.594 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:08.594 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:08.594 "hdgst": false, 00:30:08.594 "ddgst": false 00:30:08.594 }, 00:30:08.594 "method": "bdev_nvme_attach_controller" 00:30:08.594 }' 00:30:08.594 [2024-11-27 02:41:33.102871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:08.594 [2024-11-27 02:41:33.102947] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2197826 ] 00:30:08.594 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.594 [2024-11-27 02:41:33.165864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.852 [2024-11-27 02:41:33.254428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:09.109 Running I/O for 1 seconds... 00:30:10.042 00:30:10.042 Latency(us) 00:30:10.042 [2024-11-27T01:41:34.677Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:10.042 [2024-11-27T01:41:34.677Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:10.042 Verification LBA range: start 0x0 length 0x4000 00:30:10.042 Nvme1n1 : 1.01 13018.43 50.85 0.00 0.00 9790.61 928.43 16699.54 00:30:10.042 [2024-11-27T01:41:34.677Z] =================================================================================================================== 00:30:10.042 [2024-11-27T01:41:34.677Z] Total : 13018.43 50.85 0.00 0.00 9790.61 928.43 16699.54 00:30:10.298 02:41:34 -- host/bdevperf.sh@30 -- # bdevperfpid=2198091 00:30:10.298 02:41:34 -- host/bdevperf.sh@32 -- # sleep 3 00:30:10.298 02:41:34 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:10.298 02:41:34 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:10.298 02:41:34 -- nvmf/common.sh@520 -- # config=() 00:30:10.298 02:41:34 -- nvmf/common.sh@520 -- # local subsystem config 00:30:10.298 02:41:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:10.298 02:41:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:10.298 { 00:30:10.299 "params": { 00:30:10.299 "name": "Nvme$subsystem", 00:30:10.299 "trtype": "$TEST_TRANSPORT", 00:30:10.299 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:10.299 "adrfam": "ipv4", 00:30:10.299 "trsvcid": "$NVMF_PORT", 00:30:10.299 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:10.299 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:10.299 "hdgst": ${hdgst:-false}, 00:30:10.299 "ddgst": ${ddgst:-false} 00:30:10.299 }, 00:30:10.299 "method": "bdev_nvme_attach_controller" 00:30:10.299 } 00:30:10.299 EOF 00:30:10.299 )") 00:30:10.299 02:41:34 -- nvmf/common.sh@542 -- # cat 00:30:10.299 02:41:34 -- nvmf/common.sh@544 -- # jq . 00:30:10.299 02:41:34 -- nvmf/common.sh@545 -- # IFS=, 00:30:10.299 02:41:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:10.299 "params": { 00:30:10.299 "name": "Nvme1", 00:30:10.299 "trtype": "tcp", 00:30:10.299 "traddr": "10.0.0.2", 00:30:10.299 "adrfam": "ipv4", 00:30:10.299 "trsvcid": "4420", 00:30:10.299 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:10.299 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:10.299 "hdgst": false, 00:30:10.299 "ddgst": false 00:30:10.299 }, 00:30:10.299 "method": "bdev_nvme_attach_controller" 00:30:10.299 }' 00:30:10.299 [2024-11-27 02:41:34.764894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:10.299 [2024-11-27 02:41:34.764975] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2198091 ] 00:30:10.299 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.299 [2024-11-27 02:41:34.824036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:10.299 [2024-11-27 02:41:34.905879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:10.557 Running I/O for 15 seconds... 00:30:13.842 02:41:37 -- host/bdevperf.sh@33 -- # kill -9 2197662 00:30:13.842 02:41:37 -- host/bdevperf.sh@35 -- # sleep 3 00:30:13.842 [2024-11-27 02:41:37.737482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:9608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:9672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:9680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:9688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:9712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:9720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:9744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:9760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.842 [2024-11-27 02:41:37.737871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:9768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.842 [2024-11-27 02:41:37.737903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:9072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.737969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.737987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:9104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:9152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:9184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:9216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:9240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:9248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:9296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:9304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:9336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.842 [2024-11-27 02:41:37.738539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.842 [2024-11-27 02:41:37.738562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:9784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.842 [2024-11-27 02:41:37.738595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:9800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.738714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:9824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.738743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:9832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:9848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:9872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.738972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.738987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:9888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:9896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:9912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:9920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:9936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:9944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:9952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:9960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:9976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:9984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:9992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:10000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:10008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:10016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.843 [2024-11-27 02:41:37.739650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:10024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.843 [2024-11-27 02:41:37.739680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.843 [2024-11-27 02:41:37.739696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:10032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.739709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.739738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:9352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:9384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:9424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.739980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:9432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.739995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:10048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:10056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:10064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:10072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:10104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:10112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:10120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:10136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:10152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:10160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:10176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.844 [2024-11-27 02:41:37.740611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:10208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.844 [2024-11-27 02:41:37.740763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.844 [2024-11-27 02:41:37.740778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:10224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.740798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:10232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.740848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:10240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.740881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.740913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.740945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:10264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.740977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.740994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:10272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:10280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:9464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:9480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:9488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:9504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:9512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:9536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:9568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:9576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:9600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:10296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:10304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:10312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.845 [2024-11-27 02:41:37.741742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:10328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:9648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.845 [2024-11-27 02:41:37.741799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.845 [2024-11-27 02:41:37.741832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:9656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.741847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.741864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.741879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.741895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.741910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.741926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:9704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.741941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.741958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.741973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.741989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.846 [2024-11-27 02:41:37.742006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee19a0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.742043] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:13.846 [2024-11-27 02:41:37.742056] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:13.846 [2024-11-27 02:41:37.742074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9752 len:8 PRP1 0x0 PRP2 0x0 00:30:13.846 [2024-11-27 02:41:37.742089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742156] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xee19a0 was disconnected and freed. reset controller. 00:30:13.846 [2024-11-27 02:41:37.742244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:13.846 [2024-11-27 02:41:37.742268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742311] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:13.846 [2024-11-27 02:41:37.742325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:13.846 [2024-11-27 02:41:37.742351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742381] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:13.846 [2024-11-27 02:41:37.742395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.846 [2024-11-27 02:41:37.742408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.744839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.846 [2024-11-27 02:41:37.744892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.846 [2024-11-27 02:41:37.745386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.745592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.745620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.846 [2024-11-27 02:41:37.745637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.745841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.846 [2024-11-27 02:41:37.746029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.846 [2024-11-27 02:41:37.746052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.846 [2024-11-27 02:41:37.746073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.846 [2024-11-27 02:41:37.748469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.846 [2024-11-27 02:41:37.757751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.846 [2024-11-27 02:41:37.758071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.758222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.758249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.846 [2024-11-27 02:41:37.758266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.758491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.846 [2024-11-27 02:41:37.758671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.846 [2024-11-27 02:41:37.758693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.846 [2024-11-27 02:41:37.758708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.846 [2024-11-27 02:41:37.760901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.846 [2024-11-27 02:41:37.770187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.846 [2024-11-27 02:41:37.770536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.770685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.770712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.846 [2024-11-27 02:41:37.770728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.770905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.846 [2024-11-27 02:41:37.771081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.846 [2024-11-27 02:41:37.771105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.846 [2024-11-27 02:41:37.771121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.846 [2024-11-27 02:41:37.773470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.846 [2024-11-27 02:41:37.782600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.846 [2024-11-27 02:41:37.782903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.783040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.783082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.846 [2024-11-27 02:41:37.783098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.846 [2024-11-27 02:41:37.783260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.846 [2024-11-27 02:41:37.783429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.846 [2024-11-27 02:41:37.783452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.846 [2024-11-27 02:41:37.783468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.846 [2024-11-27 02:41:37.785834] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.846 [2024-11-27 02:41:37.795228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.846 [2024-11-27 02:41:37.795614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.795732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.846 [2024-11-27 02:41:37.795757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.847 [2024-11-27 02:41:37.795773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.847 [2024-11-27 02:41:37.795984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.847 [2024-11-27 02:41:37.796171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.847 [2024-11-27 02:41:37.796201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.847 [2024-11-27 02:41:37.796218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.847 [2024-11-27 02:41:37.798617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.847 [2024-11-27 02:41:37.807969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.847 [2024-11-27 02:41:37.808315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.808450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.808478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.847 [2024-11-27 02:41:37.808496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.847 [2024-11-27 02:41:37.808651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.847 [2024-11-27 02:41:37.808857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.847 [2024-11-27 02:41:37.808881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.847 [2024-11-27 02:41:37.808896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.847 [2024-11-27 02:41:37.811127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.847 [2024-11-27 02:41:37.820679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.847 [2024-11-27 02:41:37.820963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.821097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.821125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.847 [2024-11-27 02:41:37.821143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.847 [2024-11-27 02:41:37.821254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.847 [2024-11-27 02:41:37.821386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.847 [2024-11-27 02:41:37.821409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.847 [2024-11-27 02:41:37.821424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.847 [2024-11-27 02:41:37.823562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.847 [2024-11-27 02:41:37.833428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.847 [2024-11-27 02:41:37.833720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.833850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.833879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.847 [2024-11-27 02:41:37.833896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.847 [2024-11-27 02:41:37.834097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.847 [2024-11-27 02:41:37.834320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.847 [2024-11-27 02:41:37.834344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.847 [2024-11-27 02:41:37.834365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.847 [2024-11-27 02:41:37.836671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.847 [2024-11-27 02:41:37.845942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.847 [2024-11-27 02:41:37.846244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.846400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.847 [2024-11-27 02:41:37.846428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.847 [2024-11-27 02:41:37.846446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.847 [2024-11-27 02:41:37.846621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.847 [2024-11-27 02:41:37.846813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.847 [2024-11-27 02:41:37.846837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.847 [2024-11-27 02:41:37.846852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.847 [2024-11-27 02:41:37.849227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.847 [2024-11-27 02:41:37.858467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.847 [2024-11-27 02:41:37.858783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.858907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.858937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.858954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.859117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.859304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.859328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.859343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.861712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.870860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.871177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.871332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.871360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.871377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.871532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.871666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.871690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.871705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.874053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.883507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.883775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.883934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.883959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.883975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.884185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.884337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.884360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.884376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.886693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.896172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.896470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.896587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.896613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.896629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.896817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.897004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.897027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.897043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.899537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.908847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.909136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.909333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.909359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.909375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.909617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.909823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.909847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.909862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.912273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.921431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.921765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.921999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.922027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.922045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.922226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.848 [2024-11-27 02:41:37.922377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.848 [2024-11-27 02:41:37.922400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.848 [2024-11-27 02:41:37.922415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.848 [2024-11-27 02:41:37.924694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.848 [2024-11-27 02:41:37.934099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.848 [2024-11-27 02:41:37.934450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.934587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.848 [2024-11-27 02:41:37.934631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.848 [2024-11-27 02:41:37.934647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.848 [2024-11-27 02:41:37.934862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.935013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.935036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.935052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:37.937341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:37.946764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:37.947112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.947249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.947275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:37.947290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:37.947438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.947625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.947650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.947665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:37.950149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:37.959261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:37.959581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.959736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.959766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:37.959783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:37.959929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.960061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.960085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.960100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:37.962442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:37.971834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:37.972146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.972313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.972339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:37.972355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:37.972502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.972678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.972703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.972718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:37.975060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:37.984424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:37.984778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.984914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.984956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:37.984972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:37.985155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.985288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.985311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.985327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:37.987625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:37.997025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:37.997360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.997457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:37.997490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:37.997507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:37.997647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:37.997826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:37.997850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:37.997865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:38.000058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:38.009534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:38.009833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:38.009975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:38.010001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:38.010017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:38.010193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:38.010349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:38.010373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:38.010388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.849 [2024-11-27 02:41:38.012610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.849 [2024-11-27 02:41:38.022186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.849 [2024-11-27 02:41:38.022500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:38.022649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.849 [2024-11-27 02:41:38.022678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.849 [2024-11-27 02:41:38.022696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.849 [2024-11-27 02:41:38.022878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.849 [2024-11-27 02:41:38.023029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.849 [2024-11-27 02:41:38.023053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.849 [2024-11-27 02:41:38.023068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.025429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.034786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.035077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.035239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.035265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.035286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.035500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.035661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.035685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.035701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.037985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.047430] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.047774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.047879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.047908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.047926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.048126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.048258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.048282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.048297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.050558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.059934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.060250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.060361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.060391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.060409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.060642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.060865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.060889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.060904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.063226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.072556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.072888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.073042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.073060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.073194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.073363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.073386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.073401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.075859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.085155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.085473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.085583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.085613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.085631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.085813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.086018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.086042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.086057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.088419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.097862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.098150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.098308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.098334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.098350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.098538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.098671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.098694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.098710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.100960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.110335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.110658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.110793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.850 [2024-11-27 02:41:38.110821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.850 [2024-11-27 02:41:38.110839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.850 [2024-11-27 02:41:38.111021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.850 [2024-11-27 02:41:38.111196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.850 [2024-11-27 02:41:38.111219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.850 [2024-11-27 02:41:38.111235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.850 [2024-11-27 02:41:38.113606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.850 [2024-11-27 02:41:38.122960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.850 [2024-11-27 02:41:38.123240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.123385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.123411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.123427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.123598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.123800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.123824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.123839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.126183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.135636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.136031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.136280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.136339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.136357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.136521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.136701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.136724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.136739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.138970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.148259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.148548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.148729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.148759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.148776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.148940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.149091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.149121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.149138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.151473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.160872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.161260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.161403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.161430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.161446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.161596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.161785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.161808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.161824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.164107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.173396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.173736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.173839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.173868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.173885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.174049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.174182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.174206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.174221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.176790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.185982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.186209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.186340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.186368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.186386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.186564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.186738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.186761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.186782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.188925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.198595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.198919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.199065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.199090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.199106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.199311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.199482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.199506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.199522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.201914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.211105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.851 [2024-11-27 02:41:38.211378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.211540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.851 [2024-11-27 02:41:38.211570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.851 [2024-11-27 02:41:38.211587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.851 [2024-11-27 02:41:38.211697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.851 [2024-11-27 02:41:38.211866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.851 [2024-11-27 02:41:38.211890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.851 [2024-11-27 02:41:38.211905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.851 [2024-11-27 02:41:38.214267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.851 [2024-11-27 02:41:38.223589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.223925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.224082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.224110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.224128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.224291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.224460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.224484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.224500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.226850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.236054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.236393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.236523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.236561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.236579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.236743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.236930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.236954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.236969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.239398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.248745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.248960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.249089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.249133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.249149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.249344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.249566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.249592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.249608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.251892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.261289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.261585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.261684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.261727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.261744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.261889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.262094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.262118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.262133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.264512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.274102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.274428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.274595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.274622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.274638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.274799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.274932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.274956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.274972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.277333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.286781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.287102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.287225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.287251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.287266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.287460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.287587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.287611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.287626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.289875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.299165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.299485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.299647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.299674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.299690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.299835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.300017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.300041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.300057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.302431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.852 [2024-11-27 02:41:38.311858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.852 [2024-11-27 02:41:38.312168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.312315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.852 [2024-11-27 02:41:38.312341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.852 [2024-11-27 02:41:38.312357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.852 [2024-11-27 02:41:38.312522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.852 [2024-11-27 02:41:38.312697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.852 [2024-11-27 02:41:38.312721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.852 [2024-11-27 02:41:38.312736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.852 [2024-11-27 02:41:38.315005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.324440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.324722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.324856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.324882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.324898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.325107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.325313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.325337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.853 [2024-11-27 02:41:38.325352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.853 [2024-11-27 02:41:38.327704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.336851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.337141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.337310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.337337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.337352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.337498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.337692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.337717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.853 [2024-11-27 02:41:38.337732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.853 [2024-11-27 02:41:38.340234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.349541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.349814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.349966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.349995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.350018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.350202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.350425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.350448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.853 [2024-11-27 02:41:38.350464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.853 [2024-11-27 02:41:38.352674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.362008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.362265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.362391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.362419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.362437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.362654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.362843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.362866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.853 [2024-11-27 02:41:38.362882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.853 [2024-11-27 02:41:38.364985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.374538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.374924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.375123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.375152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.375170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.375352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.375484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.375507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.853 [2024-11-27 02:41:38.375522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.853 [2024-11-27 02:41:38.377969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.853 [2024-11-27 02:41:38.386900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.853 [2024-11-27 02:41:38.387230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.387327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.853 [2024-11-27 02:41:38.387356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.853 [2024-11-27 02:41:38.387374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.853 [2024-11-27 02:41:38.387537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.853 [2024-11-27 02:41:38.387706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.853 [2024-11-27 02:41:38.387730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.387745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.390048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.399293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.399644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.399740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.399771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.399789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.399972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.400140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.400164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.400179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.402583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.411832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.412164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.412273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.412303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.412320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.412502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.412719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.412743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.412758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.415117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.424316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.424617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.424785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.424814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.424831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.424941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.425152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.425176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.425192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.427516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.436784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.437101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.437260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.437286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.437301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.437479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.437712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.437737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.437753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.439912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.449151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.449480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.449610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.449639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.449657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.449839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.450026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.450050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.450066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.452298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.854 [2024-11-27 02:41:38.461683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.854 [2024-11-27 02:41:38.461991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.462101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.854 [2024-11-27 02:41:38.462127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:13.854 [2024-11-27 02:41:38.462142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:13.854 [2024-11-27 02:41:38.462289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:13.854 [2024-11-27 02:41:38.462426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.854 [2024-11-27 02:41:38.462455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.854 [2024-11-27 02:41:38.462471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.854 [2024-11-27 02:41:38.464824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.114 [2024-11-27 02:41:38.474222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.114 [2024-11-27 02:41:38.474564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.474701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.474730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.114 [2024-11-27 02:41:38.474748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.114 [2024-11-27 02:41:38.474877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.114 [2024-11-27 02:41:38.475009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.114 [2024-11-27 02:41:38.475033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.114 [2024-11-27 02:41:38.475048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.114 [2024-11-27 02:41:38.477480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.114 [2024-11-27 02:41:38.486761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.114 [2024-11-27 02:41:38.487074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.487207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.487235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.114 [2024-11-27 02:41:38.487253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.114 [2024-11-27 02:41:38.487416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.114 [2024-11-27 02:41:38.487614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.114 [2024-11-27 02:41:38.487640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.114 [2024-11-27 02:41:38.487655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.114 [2024-11-27 02:41:38.490110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.114 [2024-11-27 02:41:38.499309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.114 [2024-11-27 02:41:38.499587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.499727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.499754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.114 [2024-11-27 02:41:38.499770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.114 [2024-11-27 02:41:38.499977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.114 [2024-11-27 02:41:38.500143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.114 [2024-11-27 02:41:38.500166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.114 [2024-11-27 02:41:38.500187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.114 [2024-11-27 02:41:38.502507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.114 [2024-11-27 02:41:38.511732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.114 [2024-11-27 02:41:38.512072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.512226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.512255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.114 [2024-11-27 02:41:38.512273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.114 [2024-11-27 02:41:38.512401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.114 [2024-11-27 02:41:38.512581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.114 [2024-11-27 02:41:38.512606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.114 [2024-11-27 02:41:38.512622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.114 [2024-11-27 02:41:38.514763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.114 [2024-11-27 02:41:38.524223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.114 [2024-11-27 02:41:38.524511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.524645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.114 [2024-11-27 02:41:38.524688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.114 [2024-11-27 02:41:38.524704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.524836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.525010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.525035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.525050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.527320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.536783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.537107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.537263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.537292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.537309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.537492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.537635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.537660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.537675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.539841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.549371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.549666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.549849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.549875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.549890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.550097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.550295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.550319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.550334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.552611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.561934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.562262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.562361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.562390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.562407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.562583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.562736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.562759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.562775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.565239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.574588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.574856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.574979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.575009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.575026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.575136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.575287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.575310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.575326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.577746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.587089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.587402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.587539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.587569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.587586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.587769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.587938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.587962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.587977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.590260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.599820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.600076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.600231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.600260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.600277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.600460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.600640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.600665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.600680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.115 [2024-11-27 02:41:38.603125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.115 [2024-11-27 02:41:38.612394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.115 [2024-11-27 02:41:38.612699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.612828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.115 [2024-11-27 02:41:38.612857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.115 [2024-11-27 02:41:38.612874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.115 [2024-11-27 02:41:38.613039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.115 [2024-11-27 02:41:38.613190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.115 [2024-11-27 02:41:38.613213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.115 [2024-11-27 02:41:38.613228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.615541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.625011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.625348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.625478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.625508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.625537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.625687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.625874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.625897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.625912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.628128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.637580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.637847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.638002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.638031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.638048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.638230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.638399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.638423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.638438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.640842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.650197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.650481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.650635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.650666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.650684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.650868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.651018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.651042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.651057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.653327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.662898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.663244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.663339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.663373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.663392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.663620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.663790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.663814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.663829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.666170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.675722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.676061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.676191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.676220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.676238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.676438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.676617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.676642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.676657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.678835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.688121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.688472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.688597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.688624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.688639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.688790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.688941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.688964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.688980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.691210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.700494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.700794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.700960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.700986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.116 [2024-11-27 02:41:38.701007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.116 [2024-11-27 02:41:38.701138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.116 [2024-11-27 02:41:38.701316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.116 [2024-11-27 02:41:38.701340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.116 [2024-11-27 02:41:38.701356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.116 [2024-11-27 02:41:38.703631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.116 [2024-11-27 02:41:38.713133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.116 [2024-11-27 02:41:38.713452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.713580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.116 [2024-11-27 02:41:38.713609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.117 [2024-11-27 02:41:38.713626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.117 [2024-11-27 02:41:38.713844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.117 [2024-11-27 02:41:38.714013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.117 [2024-11-27 02:41:38.714036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.117 [2024-11-27 02:41:38.714052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.117 [2024-11-27 02:41:38.716320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.117 [2024-11-27 02:41:38.725895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.117 [2024-11-27 02:41:38.726211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.117 [2024-11-27 02:41:38.726327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.117 [2024-11-27 02:41:38.726355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.117 [2024-11-27 02:41:38.726373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.117 [2024-11-27 02:41:38.726501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.117 [2024-11-27 02:41:38.726680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.117 [2024-11-27 02:41:38.726704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.117 [2024-11-27 02:41:38.726720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.117 [2024-11-27 02:41:38.729092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.117 [2024-11-27 02:41:38.738369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.117 [2024-11-27 02:41:38.738662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.117 [2024-11-27 02:41:38.738815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.117 [2024-11-27 02:41:38.738844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.117 [2024-11-27 02:41:38.738861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.117 [2024-11-27 02:41:38.739066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.117 [2024-11-27 02:41:38.739253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.117 [2024-11-27 02:41:38.739277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.117 [2024-11-27 02:41:38.739293] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.117 [2024-11-27 02:41:38.741714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.751057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.751335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.751490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.751519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.751549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.751697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.751865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.751889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.751905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.754276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.763540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.763818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.763938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.763967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.763985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.764132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.764301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.764324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.764340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.766867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.776031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.776368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.776603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.776631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.776646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.776827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.776990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.777014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.777030] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.779323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.788667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.789037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.789159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.789186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.789204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.789314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.789447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.789471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.789486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.791837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.801108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.801434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.801556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.801583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.801599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.801779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.801907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.801930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.801945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.804086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.813857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.814240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.814355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.814382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.814398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.814543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.814647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.377 [2024-11-27 02:41:38.814674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.377 [2024-11-27 02:41:38.814688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.377 [2024-11-27 02:41:38.817092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.377 [2024-11-27 02:41:38.826516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.377 [2024-11-27 02:41:38.826825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.826947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.377 [2024-11-27 02:41:38.826976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.377 [2024-11-27 02:41:38.826994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.377 [2024-11-27 02:41:38.827185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.377 [2024-11-27 02:41:38.827389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.827414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.827429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.829840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.839080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.839380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.839516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.839553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.839586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.839734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.839895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.839919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.839934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.842302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.851725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.852066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.852161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.852186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.852203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.852340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.852509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.852550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.852588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.854949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.864101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.864402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.864577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.864604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.864620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.864752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.864915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.864939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.864955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.867322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.876601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.876916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.877042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.877068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.877084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.877231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.877416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.877454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.877468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.879776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.889176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.889509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.889614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.889640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.889656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.889804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.889993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.890016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.890031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.892250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.901955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.902211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.902364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.902392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.902410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.902583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.902771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.902794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.378 [2024-11-27 02:41:38.902811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.378 [2024-11-27 02:41:38.905028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.378 [2024-11-27 02:41:38.914705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.378 [2024-11-27 02:41:38.914999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.915134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.378 [2024-11-27 02:41:38.915163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.378 [2024-11-27 02:41:38.915180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.378 [2024-11-27 02:41:38.915289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.378 [2024-11-27 02:41:38.915458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.378 [2024-11-27 02:41:38.915482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.915497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.918066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.927317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.927615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.927755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.927780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.927796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.927978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.928136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.928157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.928172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.930096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.939341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.939638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.939762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.939788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.939804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.939970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.940147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.940167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.940180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.942214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.952041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.952337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.952437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.952466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.952484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.952648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.952768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.952789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.952819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.954969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.964534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.964864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.965029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.965055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.965071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.965249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.965416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.965439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.965454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.967785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.977145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.977467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.977596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.977623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.977638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.977835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.977985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.978008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.978023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.980356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:38.989787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:38.990034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.990186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:38.990215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:38.990233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:38.990378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:38.990543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:38.990567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:38.990582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:38.992831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.379 [2024-11-27 02:41:39.002573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.379 [2024-11-27 02:41:39.002963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:39.003108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.379 [2024-11-27 02:41:39.003134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.379 [2024-11-27 02:41:39.003150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.379 [2024-11-27 02:41:39.003310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.379 [2024-11-27 02:41:39.003487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.379 [2024-11-27 02:41:39.003511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.379 [2024-11-27 02:41:39.003534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.379 [2024-11-27 02:41:39.006010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.015098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.015454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.015604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.015641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.015672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.015857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.016046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.016070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.016086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.018504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.027722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.028041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.028167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.028193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.028209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.028342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.028457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.028481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.028496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.030846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.040377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.040641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.040772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.040801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.040818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.041000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.041169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.041193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.041208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.043579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.053018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.053430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.053574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.053616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.053631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.053817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.054023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.054047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.054062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.056610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.065594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.066027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.066188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.066231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.066248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.066406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.066599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.066624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.066639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.069011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.078102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.078450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.078586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.078632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.078648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.078795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.078971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.078995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.079010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.640 [2024-11-27 02:41:39.081260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.640 [2024-11-27 02:41:39.090926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.640 [2024-11-27 02:41:39.091271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.091432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.640 [2024-11-27 02:41:39.091459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.640 [2024-11-27 02:41:39.091475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.640 [2024-11-27 02:41:39.091617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.640 [2024-11-27 02:41:39.091807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.640 [2024-11-27 02:41:39.091831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.640 [2024-11-27 02:41:39.091846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.094140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.103415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.103747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.103853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.103882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.103898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.104078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.104247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.104271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.104286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.106710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.115974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.116231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.116376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.116403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.116420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.116588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.116773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.116796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.116811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.119132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.128642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.128996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.129107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.129133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.129149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.129248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.129444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.129473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.129489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.131946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.141119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.141424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.141612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.141639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.141655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.141864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.142085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.142108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.142124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.144182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.153638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.153949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.154083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.154112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.154129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.154277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.154427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.154451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.154466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.156841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.166109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.166336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.166492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.166520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.166547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.166694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.166863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.166886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.166911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.169197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.641 [2024-11-27 02:41:39.178640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.641 [2024-11-27 02:41:39.178968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.179084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.641 [2024-11-27 02:41:39.179110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.641 [2024-11-27 02:41:39.179126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.641 [2024-11-27 02:41:39.179294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.641 [2024-11-27 02:41:39.179517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.641 [2024-11-27 02:41:39.179551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.641 [2024-11-27 02:41:39.179567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.641 [2024-11-27 02:41:39.181890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.191174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.191559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.191733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.191762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.191779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.191962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.192113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.192136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.192151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.194736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.203755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.204051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.204183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.204212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.204230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.204377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.204509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.204546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.204563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.206767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.216341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.216649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.216783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.216812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.216830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.217013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.217181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.217204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.217220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.219439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.229076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.229378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.229541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.229571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.229589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.229753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.229958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.229981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.229996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.232323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.241718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.242039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.242197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.242223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.242239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.242402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.242649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.242674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.242689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.244850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.254286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.254619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.254729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.254758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.254776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.254923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.255147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.255171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.255187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.257540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.642 [2024-11-27 02:41:39.266922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.642 [2024-11-27 02:41:39.267235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.267363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.642 [2024-11-27 02:41:39.267392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.642 [2024-11-27 02:41:39.267409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.642 [2024-11-27 02:41:39.267519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.642 [2024-11-27 02:41:39.267643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.642 [2024-11-27 02:41:39.267670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.642 [2024-11-27 02:41:39.267697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.642 [2024-11-27 02:41:39.269944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.279679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.279925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.280083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.280112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.280129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.280276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.280427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.280451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.280466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.902 [2024-11-27 02:41:39.282841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.292169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.292555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.292652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.292677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.292693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.292824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.293033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.293057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.293072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.902 [2024-11-27 02:41:39.295309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.304884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.305250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.305408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.305437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.305454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.305630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.305763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.305786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.305802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.902 [2024-11-27 02:41:39.308108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.317451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.317790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.317957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.317986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.318004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.318168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.318372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.318395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.318411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.902 [2024-11-27 02:41:39.320908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.329825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.330101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.330234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.330265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.330281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.330461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.330660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.330688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.330704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.902 [2024-11-27 02:41:39.333100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.902 [2024-11-27 02:41:39.342531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.902 [2024-11-27 02:41:39.342786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.342926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.902 [2024-11-27 02:41:39.342952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.902 [2024-11-27 02:41:39.342968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.902 [2024-11-27 02:41:39.343098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.902 [2024-11-27 02:41:39.343233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.902 [2024-11-27 02:41:39.343256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.902 [2024-11-27 02:41:39.343272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.345487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.355176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.355470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.355616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.355642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.355658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.355806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.356037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.356062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.356077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.358203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.367831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.368173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.368295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.368339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.368361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.368477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.368658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.368682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.368698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.371090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.380405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.380705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.380839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.380882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.380898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.381074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.381236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.381260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.381276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.383672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.393132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.393523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.393654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.393680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.393696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.393870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.394021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.394045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.394061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.396405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.405716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.405983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.406111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.406140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.406158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.406311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.406498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.406521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.406549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.408803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.418236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.418551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.418710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.418751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.418767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.418930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.419169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.419193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.419208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.421684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.430699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.431027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.431185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.431213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.431231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.431359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.431493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.431516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.903 [2024-11-27 02:41:39.431545] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.903 [2024-11-27 02:41:39.433607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.903 [2024-11-27 02:41:39.443162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.903 [2024-11-27 02:41:39.443435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.443568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.903 [2024-11-27 02:41:39.443598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.903 [2024-11-27 02:41:39.443617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.903 [2024-11-27 02:41:39.443799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.903 [2024-11-27 02:41:39.443975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.903 [2024-11-27 02:41:39.443999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.444014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.446413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.455675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.455950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.456076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.456106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.456123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.456306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.456440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.456463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.456478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.458845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.468126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.468430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.468536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.468567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.468585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.468767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.468954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.468977] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.468992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.471224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.480685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.480987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.481114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.481142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.481160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.481361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.481577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.481608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.481624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.484002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.493305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.493592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.493711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.493737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.493753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.493935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.494159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.494182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.494197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.496467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.505849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.506180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.506337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.506366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.506383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.506512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.506709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.506733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.506748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.508886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.518541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.518809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.518950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.519001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.519018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.519182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.519350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.519373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.519395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.904 [2024-11-27 02:41:39.521869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.904 [2024-11-27 02:41:39.531380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.904 [2024-11-27 02:41:39.531702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.531858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.904 [2024-11-27 02:41:39.531887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:14.904 [2024-11-27 02:41:39.531905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:14.904 [2024-11-27 02:41:39.532069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:14.904 [2024-11-27 02:41:39.532257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.904 [2024-11-27 02:41:39.532280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.904 [2024-11-27 02:41:39.532295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.534791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.543872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.544191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.544300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.544329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.544347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.544544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.544751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.544775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.544790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.547006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.556562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.556943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.557039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.557069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.557085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.557240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.557391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.557414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.557429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.559607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.569098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.569409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.569533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.569562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.569580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.569781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.569896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.569919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.569934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.572187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.581806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.582052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.582175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.582201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.582216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.582372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.582505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.582540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.582558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.584899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.594186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.594495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.594633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.594662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.594680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.594844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.594977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.595000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.595016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.597486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.606843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.607110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.607240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.607270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.607287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.607434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.607633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.607657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.607672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.164 [2024-11-27 02:41:39.609924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.164 [2024-11-27 02:41:39.619703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.164 [2024-11-27 02:41:39.620038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.620169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.164 [2024-11-27 02:41:39.620198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.164 [2024-11-27 02:41:39.620215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.164 [2024-11-27 02:41:39.620416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.164 [2024-11-27 02:41:39.620632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.164 [2024-11-27 02:41:39.620656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.164 [2024-11-27 02:41:39.620672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.623032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.632127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.632466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.632603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.632629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.632645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.632793] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.632958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.632978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.632991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.635221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.644629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.644972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.645108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.645137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.645155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.645337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.645506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.645541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.645559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.647866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.657252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.657556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.657697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.657723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.657739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.657875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.658026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.658049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.658065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.660335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.669959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.670231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.670364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.670393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.670411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.670587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.670721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.670744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.670760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.673087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.682492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.682838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.682943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.682972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.682995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.683161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.683330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.683354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.683369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.685810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.695108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.695359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.695496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.695534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.695554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.695719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.695906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.695930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.695945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.698197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.707638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.708004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.708126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.708155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.165 [2024-11-27 02:41:39.708173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.165 [2024-11-27 02:41:39.708318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.165 [2024-11-27 02:41:39.708488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.165 [2024-11-27 02:41:39.708511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.165 [2024-11-27 02:41:39.708538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.165 [2024-11-27 02:41:39.710793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.165 [2024-11-27 02:41:39.720283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.165 [2024-11-27 02:41:39.720596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.165 [2024-11-27 02:41:39.720731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.720760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.720777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.720911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.721081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.721105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.721121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.723371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.732934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.733222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.733369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.733395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.733411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.733569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.733720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.733740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.733753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.735999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.745403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.745678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.745787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.745812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.745827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.745992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.746173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.746197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.746212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.748428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.757836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.758136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.758300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.758325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.758341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.758497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.758692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.758715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.758731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.761020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.770357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.770659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.770758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.770786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.770804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.771004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.771192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.771215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.771231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.773605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.782784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.783075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.783206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.783234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.783252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.783398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.166 [2024-11-27 02:41:39.783599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.166 [2024-11-27 02:41:39.783623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.166 [2024-11-27 02:41:39.783639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.166 [2024-11-27 02:41:39.785835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.166 [2024-11-27 02:41:39.795571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.166 [2024-11-27 02:41:39.795848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.796020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.166 [2024-11-27 02:41:39.796055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.166 [2024-11-27 02:41:39.796075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.166 [2024-11-27 02:41:39.796311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.426 [2024-11-27 02:41:39.796501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.426 [2024-11-27 02:41:39.796546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.796566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.799060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.808206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.808546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.808648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.808677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.808695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.808842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.809011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.809035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.809050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.811565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.820837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.821127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.821284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.821313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.821331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.821496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.821694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.821718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.821734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.823986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.833301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.833653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.833773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.833802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.833819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.834002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.834243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.834267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.834288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.836550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.846012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.846344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.846476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.846505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.846523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.846717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.846850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.846873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.846888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.849157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.858682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.859013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.859147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.859173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.859189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.859342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.859457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.859480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.859495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.861869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.871213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.871593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.871713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.871743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.871761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.871943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.872112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.872135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.872150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.874309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.883784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.884079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.884206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.884236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.427 [2024-11-27 02:41:39.884253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.427 [2024-11-27 02:41:39.884400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.427 [2024-11-27 02:41:39.884580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.427 [2024-11-27 02:41:39.884604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.427 [2024-11-27 02:41:39.884619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.427 [2024-11-27 02:41:39.886782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.427 [2024-11-27 02:41:39.896293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.427 [2024-11-27 02:41:39.896596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.427 [2024-11-27 02:41:39.896706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.896735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.896753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.896953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.897140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.897163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.897179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.899502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.908835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.909172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.909308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.909334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.909350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.909466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.909683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.909706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.909720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.911933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.921367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.921679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.921772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.921798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.921814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.921989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.922173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.922197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.922213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.924442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.934197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.934532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.934669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.934695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.934711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.934889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.935006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.935026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.935055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.937366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.946934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.947225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.947365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.947391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.947407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.947609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.947761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.947784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.947800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.950181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.959709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.960020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.960181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.960207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.960223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.960369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.960540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.960574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.960589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.962897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.972311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.972636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.972771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.972800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.972828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.973028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.973180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.973203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.973219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.975474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.984965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.428 [2024-11-27 02:41:39.985282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.985449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.428 [2024-11-27 02:41:39.985481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.428 [2024-11-27 02:41:39.985497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.428 [2024-11-27 02:41:39.985621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.428 [2024-11-27 02:41:39.985834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.428 [2024-11-27 02:41:39.985858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.428 [2024-11-27 02:41:39.985874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.428 [2024-11-27 02:41:39.988072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.428 [2024-11-27 02:41:39.997442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.429 [2024-11-27 02:41:39.997676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:39.997770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:39.997800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.429 [2024-11-27 02:41:39.997817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.429 [2024-11-27 02:41:39.997948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.429 [2024-11-27 02:41:39.998161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.429 [2024-11-27 02:41:39.998183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.429 [2024-11-27 02:41:39.998196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.429 [2024-11-27 02:41:40.000325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.429 [2024-11-27 02:41:40.010082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.429 [2024-11-27 02:41:40.010452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.010548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.010576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.429 [2024-11-27 02:41:40.010592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.429 [2024-11-27 02:41:40.010773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.429 [2024-11-27 02:41:40.010936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.429 [2024-11-27 02:41:40.010973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.429 [2024-11-27 02:41:40.010989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.429 [2024-11-27 02:41:40.013204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.429 [2024-11-27 02:41:40.022363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.429 [2024-11-27 02:41:40.022663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.022763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.022791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.429 [2024-11-27 02:41:40.022810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.429 [2024-11-27 02:41:40.022928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.429 [2024-11-27 02:41:40.023084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.429 [2024-11-27 02:41:40.023108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.429 [2024-11-27 02:41:40.023125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.429 [2024-11-27 02:41:40.025319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.429 [2024-11-27 02:41:40.034850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.429 [2024-11-27 02:41:40.035161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.035324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.035354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.429 [2024-11-27 02:41:40.035379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.429 [2024-11-27 02:41:40.035587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.429 [2024-11-27 02:41:40.035757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.429 [2024-11-27 02:41:40.035779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.429 [2024-11-27 02:41:40.035802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.429 [2024-11-27 02:41:40.038232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.429 [2024-11-27 02:41:40.047446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.429 [2024-11-27 02:41:40.047763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.047915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.429 [2024-11-27 02:41:40.047942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.429 [2024-11-27 02:41:40.047958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.429 [2024-11-27 02:41:40.048148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.429 [2024-11-27 02:41:40.048318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.429 [2024-11-27 02:41:40.048341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.429 [2024-11-27 02:41:40.048356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.429 [2024-11-27 02:41:40.050836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.059929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.060199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.060302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.060331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.060349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.060508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.060683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.060707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.060722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.063021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.072309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.072578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.072707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.072734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.072750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.072947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.073065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.073085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.073100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.075153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.084569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.084886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.085009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.085035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.085051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.085199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.085387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.085407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.085419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.087516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.097077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.097442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.097538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.097565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.097581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.097745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.097907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.097931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.097946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.100332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.109610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.109939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.110057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.110083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.110099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.110269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.110426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.110450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.110465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.112851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.121959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.122245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.122385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.122411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.122427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.122586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.122750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.122774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.122789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.125183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.134646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.134920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.135111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.135137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.135152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.135311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.135517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.135552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.135569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.137966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.146944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.147285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.147414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.689 [2024-11-27 02:41:40.147442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.689 [2024-11-27 02:41:40.147460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.689 [2024-11-27 02:41:40.147671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.689 [2024-11-27 02:41:40.147806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.689 [2024-11-27 02:41:40.147835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.689 [2024-11-27 02:41:40.147852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.689 [2024-11-27 02:41:40.150068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.689 [2024-11-27 02:41:40.159494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.689 [2024-11-27 02:41:40.159804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.159935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.159961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.159977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.160139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.160298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.160323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.160338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.162764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.172135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.172443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.172607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.172666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.172684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.172830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.172981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.173005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.173021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.175335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.184846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.185255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.185402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.185445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.185461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.185637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.185836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.185861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.185882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.188169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.197428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.197709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.197854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.197880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.197897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.198016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.198143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.198167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.198182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.200323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.209881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.210209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.210327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.210358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.210375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.210503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.210686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.210710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.210725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.212726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.222376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.222682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.222895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.222924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.222941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.223141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.223292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.223315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.223330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.225580] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.235134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.235432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.235568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.235599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.235617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.235782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.235969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.235993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.236008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.238329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.247437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.247715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.247959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.248019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.248036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.248182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.248350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.248373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.248389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.250847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.259963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.260230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.260359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.260387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.260405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.690 [2024-11-27 02:41:40.260595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.690 [2024-11-27 02:41:40.260748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.690 [2024-11-27 02:41:40.260771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.690 [2024-11-27 02:41:40.260786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.690 [2024-11-27 02:41:40.263035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.690 [2024-11-27 02:41:40.272508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.690 [2024-11-27 02:41:40.272865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.273017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.690 [2024-11-27 02:41:40.273043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.690 [2024-11-27 02:41:40.273059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.691 [2024-11-27 02:41:40.273190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.691 [2024-11-27 02:41:40.273331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.691 [2024-11-27 02:41:40.273355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.691 [2024-11-27 02:41:40.273370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.691 [2024-11-27 02:41:40.275672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.691 [2024-11-27 02:41:40.284979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.691 [2024-11-27 02:41:40.285271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.285397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.285441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.691 [2024-11-27 02:41:40.285457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.691 [2024-11-27 02:41:40.285646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.691 [2024-11-27 02:41:40.285820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.691 [2024-11-27 02:41:40.285845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.691 [2024-11-27 02:41:40.285860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.691 [2024-11-27 02:41:40.287928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.691 [2024-11-27 02:41:40.297370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.691 [2024-11-27 02:41:40.297622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.297751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.297780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.691 [2024-11-27 02:41:40.297798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.691 [2024-11-27 02:41:40.297962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.691 [2024-11-27 02:41:40.298112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.691 [2024-11-27 02:41:40.298136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.691 [2024-11-27 02:41:40.298151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.691 [2024-11-27 02:41:40.300513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.691 [2024-11-27 02:41:40.309934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.691 [2024-11-27 02:41:40.310283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.310385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.691 [2024-11-27 02:41:40.310414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.691 [2024-11-27 02:41:40.310432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.691 [2024-11-27 02:41:40.310625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.691 [2024-11-27 02:41:40.310812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.691 [2024-11-27 02:41:40.310837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.691 [2024-11-27 02:41:40.310852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.691 [2024-11-27 02:41:40.313048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.951 [2024-11-27 02:41:40.322739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.951 [2024-11-27 02:41:40.323035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.951 [2024-11-27 02:41:40.323153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.951 [2024-11-27 02:41:40.323179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.951 [2024-11-27 02:41:40.323196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.951 [2024-11-27 02:41:40.323375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.951 [2024-11-27 02:41:40.323620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.951 [2024-11-27 02:41:40.323645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.951 [2024-11-27 02:41:40.323661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.951 [2024-11-27 02:41:40.326043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.951 [2024-11-27 02:41:40.335161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.951 [2024-11-27 02:41:40.335509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.951 [2024-11-27 02:41:40.335662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.951 [2024-11-27 02:41:40.335689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.335705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.335903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.336035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.336058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.336074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.338145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.347706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.347994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.348128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.348165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.348184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.348330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.348547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.348572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.348587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.350906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.360016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.360293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.360454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.360483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.360501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.360692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.360844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.360868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.360883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.363207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.372405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.372675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.372837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.372863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.372879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.373054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.373224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.373247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.373262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.375519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.385090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.385473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.385632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.385676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.385699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.385845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.386050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.386073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.386088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.388446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.397662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.397922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.398073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.398102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.398119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.398338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.398507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.398541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.398559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.400864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.410336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.410693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.410821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.410850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.410867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.411050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.411236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.411260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.411275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.952 [2024-11-27 02:41:40.413662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.952 [2024-11-27 02:41:40.422799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.952 [2024-11-27 02:41:40.423092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.423218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.952 [2024-11-27 02:41:40.423258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.952 [2024-11-27 02:41:40.423274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.952 [2024-11-27 02:41:40.423393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.952 [2024-11-27 02:41:40.423572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.952 [2024-11-27 02:41:40.423596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.952 [2024-11-27 02:41:40.423611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.425935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.435294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.435537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.435688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.435716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.435734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.435952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.436121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.436145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.436160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.438602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.448031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.448340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.448461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.448488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.448504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.448728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.448863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.448887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.448902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.451314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.460484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.460871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.460996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.461022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.461038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.461249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.461387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.461410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.461426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.463630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.472954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.473265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.473394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.473422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.473440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.473601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.473808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.473831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.473847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.476132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.485500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.485773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.485937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.485963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.485979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.486125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.486291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.486315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.486330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.488611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.498088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.498414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.498621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.498637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.498769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.498956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.498980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.499000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.501322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.510443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.510716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.510836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.510866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.953 [2024-11-27 02:41:40.510883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.953 [2024-11-27 02:41:40.511048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.953 [2024-11-27 02:41:40.511253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.953 [2024-11-27 02:41:40.511276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.953 [2024-11-27 02:41:40.511291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.953 [2024-11-27 02:41:40.513729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.953 [2024-11-27 02:41:40.522764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.953 [2024-11-27 02:41:40.523127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.523278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.953 [2024-11-27 02:41:40.523303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.954 [2024-11-27 02:41:40.523319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.954 [2024-11-27 02:41:40.523460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.954 [2024-11-27 02:41:40.523621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.954 [2024-11-27 02:41:40.523646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.954 [2024-11-27 02:41:40.523661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.954 [2024-11-27 02:41:40.526074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.954 [2024-11-27 02:41:40.535108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.954 [2024-11-27 02:41:40.535367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.535539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.535566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.954 [2024-11-27 02:41:40.535583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.954 [2024-11-27 02:41:40.535795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.954 [2024-11-27 02:41:40.535964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.954 [2024-11-27 02:41:40.535988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.954 [2024-11-27 02:41:40.536004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.954 [2024-11-27 02:41:40.538404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.954 [2024-11-27 02:41:40.547622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.954 [2024-11-27 02:41:40.547945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.548073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.548102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.954 [2024-11-27 02:41:40.548119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.954 [2024-11-27 02:41:40.548283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.954 [2024-11-27 02:41:40.548434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.954 [2024-11-27 02:41:40.548457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.954 [2024-11-27 02:41:40.548473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.954 [2024-11-27 02:41:40.550642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.954 [2024-11-27 02:41:40.560339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.954 [2024-11-27 02:41:40.560652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.560813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.560841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.954 [2024-11-27 02:41:40.560858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.954 [2024-11-27 02:41:40.561023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.954 [2024-11-27 02:41:40.561246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.954 [2024-11-27 02:41:40.561269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.954 [2024-11-27 02:41:40.561285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.954 [2024-11-27 02:41:40.563356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.954 [2024-11-27 02:41:40.573109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.954 [2024-11-27 02:41:40.573462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.573616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.954 [2024-11-27 02:41:40.573643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:15.954 [2024-11-27 02:41:40.573659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:15.954 [2024-11-27 02:41:40.573856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:15.954 [2024-11-27 02:41:40.574061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.954 [2024-11-27 02:41:40.574085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.954 [2024-11-27 02:41:40.574100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.954 [2024-11-27 02:41:40.576560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.214 [2024-11-27 02:41:40.585682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.214 [2024-11-27 02:41:40.585955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.586099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.586126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.214 [2024-11-27 02:41:40.586142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.214 [2024-11-27 02:41:40.586274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.214 [2024-11-27 02:41:40.586398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.214 [2024-11-27 02:41:40.586422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.214 [2024-11-27 02:41:40.586437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.214 [2024-11-27 02:41:40.588669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.214 [2024-11-27 02:41:40.598254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.214 [2024-11-27 02:41:40.598633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.598813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.598871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.214 [2024-11-27 02:41:40.598889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.214 [2024-11-27 02:41:40.599034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.214 [2024-11-27 02:41:40.599221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.214 [2024-11-27 02:41:40.599245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.214 [2024-11-27 02:41:40.599260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.214 [2024-11-27 02:41:40.601575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.214 [2024-11-27 02:41:40.610702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.214 [2024-11-27 02:41:40.610996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.611121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.214 [2024-11-27 02:41:40.611150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.214 [2024-11-27 02:41:40.611168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.214 [2024-11-27 02:41:40.611332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.214 [2024-11-27 02:41:40.611446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.214 [2024-11-27 02:41:40.611470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.611486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.613690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.623475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.623817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.623947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.623976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.623994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.624158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.624327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.624351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.624366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.626608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.635866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.636193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.636338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.636363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.636379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.636566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.636718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.636741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.636756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.639060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.648480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.648800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.648910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.648936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.648952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.649144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.649322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.649345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.649360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.651910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.661129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.661426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.661581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.661616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.661634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.661780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.661968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.661992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.662007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.664330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.673727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.674042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.674172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.674201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.674218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.674383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.674551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.674575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.674591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.676893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.686128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.686404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.686539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.686569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.686587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.686751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.686956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.686980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.686995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.689278] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.698734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.699005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.699134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.699163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.699186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.215 [2024-11-27 02:41:40.699333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.215 [2024-11-27 02:41:40.699502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.215 [2024-11-27 02:41:40.699534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.215 [2024-11-27 02:41:40.699552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.215 [2024-11-27 02:41:40.701783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.215 [2024-11-27 02:41:40.711194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.215 [2024-11-27 02:41:40.711503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.711650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.215 [2024-11-27 02:41:40.711676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.215 [2024-11-27 02:41:40.711691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.711886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.712068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.712092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.712107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.714373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 [2024-11-27 02:41:40.723971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.724375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.724534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.724561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.724592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.724811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.724980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.725004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.725019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.727395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2197662 Killed "${NVMF_APP[@]}" "$@" 00:30:16.216 02:41:40 -- host/bdevperf.sh@36 -- # tgt_init 00:30:16.216 02:41:40 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:16.216 02:41:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:16.216 02:41:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:16.216 02:41:40 -- common/autotest_common.sh@10 -- # set +x 00:30:16.216 02:41:40 -- nvmf/common.sh@469 -- # nvmfpid=2198778 00:30:16.216 02:41:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:16.216 02:41:40 -- nvmf/common.sh@470 -- # waitforlisten 2198778 00:30:16.216 02:41:40 -- common/autotest_common.sh@829 -- # '[' -z 2198778 ']' 00:30:16.216 02:41:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:16.216 02:41:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:16.216 02:41:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:16.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:16.216 02:41:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:16.216 02:41:40 -- common/autotest_common.sh@10 -- # set +x 00:30:16.216 [2024-11-27 02:41:40.736546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.736915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.737045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.737073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.737092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.737239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.737428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.737452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.737468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.739855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 [2024-11-27 02:41:40.748952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.749286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.749394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.749420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.749436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.749609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.749763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.749784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.749798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.751862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 [2024-11-27 02:41:40.761570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.761822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.761945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.761971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.761987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.762135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.762330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.762350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.762362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.764378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 [2024-11-27 02:41:40.773845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.774238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.774363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.774389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.774405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.774600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.774765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.774785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.216 [2024-11-27 02:41:40.774799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.216 [2024-11-27 02:41:40.776905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.216 [2024-11-27 02:41:40.777141] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:16.216 [2024-11-27 02:41:40.777195] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:16.216 [2024-11-27 02:41:40.786352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.216 [2024-11-27 02:41:40.786716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.786872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.216 [2024-11-27 02:41:40.786898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.216 [2024-11-27 02:41:40.786914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.216 [2024-11-27 02:41:40.787079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.216 [2024-11-27 02:41:40.787269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.216 [2024-11-27 02:41:40.787290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.217 [2024-11-27 02:41:40.787303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.217 [2024-11-27 02:41:40.789352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.217 [2024-11-27 02:41:40.798359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.217 [2024-11-27 02:41:40.798718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.798818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.798845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.217 [2024-11-27 02:41:40.798861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.217 [2024-11-27 02:41:40.798983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.217 [2024-11-27 02:41:40.799191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.217 [2024-11-27 02:41:40.799211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.217 [2024-11-27 02:41:40.799223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.217 [2024-11-27 02:41:40.801270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.217 [2024-11-27 02:41:40.810473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.217 [2024-11-27 02:41:40.810757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.810902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.810928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.217 [2024-11-27 02:41:40.810944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.217 [2024-11-27 02:41:40.811139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.217 [2024-11-27 02:41:40.811295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.217 [2024-11-27 02:41:40.811315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.217 [2024-11-27 02:41:40.811328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.217 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.217 [2024-11-27 02:41:40.813347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.217 [2024-11-27 02:41:40.823039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.217 [2024-11-27 02:41:40.823331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.823489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.823515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.217 [2024-11-27 02:41:40.823540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.217 [2024-11-27 02:41:40.823690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.217 [2024-11-27 02:41:40.823881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.217 [2024-11-27 02:41:40.823905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.217 [2024-11-27 02:41:40.823920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.217 [2024-11-27 02:41:40.826307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.217 [2024-11-27 02:41:40.835551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.217 [2024-11-27 02:41:40.835815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.835902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.217 [2024-11-27 02:41:40.835928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.217 [2024-11-27 02:41:40.835944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.217 [2024-11-27 02:41:40.836124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.217 [2024-11-27 02:41:40.836295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.217 [2024-11-27 02:41:40.836331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.217 [2024-11-27 02:41:40.836343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.217 [2024-11-27 02:41:40.838774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.476 [2024-11-27 02:41:40.847107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:16.476 [2024-11-27 02:41:40.848346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.476 [2024-11-27 02:41:40.848685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.848811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.848837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.476 [2024-11-27 02:41:40.848853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.476 [2024-11-27 02:41:40.848970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.476 [2024-11-27 02:41:40.849129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.476 [2024-11-27 02:41:40.849153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.476 [2024-11-27 02:41:40.849169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.476 [2024-11-27 02:41:40.851452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.476 [2024-11-27 02:41:40.861283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.476 [2024-11-27 02:41:40.861750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.861923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.861950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.476 [2024-11-27 02:41:40.861970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.476 [2024-11-27 02:41:40.862112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.476 [2024-11-27 02:41:40.862328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.476 [2024-11-27 02:41:40.862354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.476 [2024-11-27 02:41:40.862373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.476 [2024-11-27 02:41:40.864701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.476 [2024-11-27 02:41:40.873923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.476 [2024-11-27 02:41:40.874229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.874371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.476 [2024-11-27 02:41:40.874397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.874413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.874594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.874740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.874762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.874776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.877069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.886726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.887114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.887329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.887358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.887376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.887505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.887753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.887775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.887789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.890062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.899117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.899516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.899679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.899706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.899725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.899895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.900109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.900131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.900146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.902374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.911798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.912164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.912320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.912347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.912366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.912503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.912691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.912737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.912754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.914844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.924598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.924908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.925086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.925113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.925129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.925321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.925468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.925489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.925502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.927668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.937043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.937378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.937538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.937569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.937603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.937767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.937904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.937925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.937939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.938259] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:16.477 [2024-11-27 02:41:40.938379] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:16.477 [2024-11-27 02:41:40.938397] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:16.477 [2024-11-27 02:41:40.938410] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:16.477 [2024-11-27 02:41:40.938469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:16.477 [2024-11-27 02:41:40.938499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:16.477 [2024-11-27 02:41:40.938501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:16.477 [2024-11-27 02:41:40.939979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.949425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.949921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.950037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.950086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.950108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.950267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.950405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.950427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.950443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.952324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.961938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.962386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.962550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.962578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.962598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.962756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.962928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.962949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.962966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.965169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.974401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.974832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.974936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.974963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.974983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.975175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.975327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.975348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.975365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.977600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.986981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.987381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.987519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.987555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.987586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:40.987697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:40.987885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:40.987906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:40.987923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:40.989917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:40.999236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:40.999633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.999793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:40.999830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:40.999849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:41.000020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:41.000228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:41.000249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:41.000265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:41.002152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:41.011684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:41.012116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.012253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.012279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:41.012300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:41.012499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:41.012662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:41.012686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:41.012704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:41.014782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:41.023946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:41.024208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.024308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.024334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:41.024350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:41.024491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:41.024641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:41.024664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:41.024678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:41.026866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:41.036032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:41.036284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.036389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.036417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:41.036433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:41.036575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:41.036760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:41.036782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:41.036796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:41.038799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:41.048335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:41.048613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.048762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.048788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.477 [2024-11-27 02:41:41.048804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.477 [2024-11-27 02:41:41.048957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.477 [2024-11-27 02:41:41.049139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.477 [2024-11-27 02:41:41.049175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.477 [2024-11-27 02:41:41.049190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.477 [2024-11-27 02:41:41.051333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.477 [2024-11-27 02:41:41.060733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.477 [2024-11-27 02:41:41.061027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.061173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.477 [2024-11-27 02:41:41.061206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.478 [2024-11-27 02:41:41.061223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.478 [2024-11-27 02:41:41.061370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.478 [2024-11-27 02:41:41.061511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.478 [2024-11-27 02:41:41.061547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.478 [2024-11-27 02:41:41.061562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.478 [2024-11-27 02:41:41.064028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.478 [2024-11-27 02:41:41.073090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.478 [2024-11-27 02:41:41.073360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.073482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.073519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.478 [2024-11-27 02:41:41.073544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.478 [2024-11-27 02:41:41.073660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.478 [2024-11-27 02:41:41.073843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.478 [2024-11-27 02:41:41.073865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.478 [2024-11-27 02:41:41.073878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.478 [2024-11-27 02:41:41.075836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.478 [2024-11-27 02:41:41.085301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.478 [2024-11-27 02:41:41.085567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.085681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.085708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.478 [2024-11-27 02:41:41.085724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.478 [2024-11-27 02:41:41.085856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.478 [2024-11-27 02:41:41.086056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.478 [2024-11-27 02:41:41.086078] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.478 [2024-11-27 02:41:41.086092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.478 [2024-11-27 02:41:41.088409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.478 [2024-11-27 02:41:41.097488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.478 [2024-11-27 02:41:41.097775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.097911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.478 [2024-11-27 02:41:41.097936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.478 [2024-11-27 02:41:41.097952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.478 [2024-11-27 02:41:41.098133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.478 [2024-11-27 02:41:41.098298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.478 [2024-11-27 02:41:41.098327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.478 [2024-11-27 02:41:41.098342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.478 [2024-11-27 02:41:41.100600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.109880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.110154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.110275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.110301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.110318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.110467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.110629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.110651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.110665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.112860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.122494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.122796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.122904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.122931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.122948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.123064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.123230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.123252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.123265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.125207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.134907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.135215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.135314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.135340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.135356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.135488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.135632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.135655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.135675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.137960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.147241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.147550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.147641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.147668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.147683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.147848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.148049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.148071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.148085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.150329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.159742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.160023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.160147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.160183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.160199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.160331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.160466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.160487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.160501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.162686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.171896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.172167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.172292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.172318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.172334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.172497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.172657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.172679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.172693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.175014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.184216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.184472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.184617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.184644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.184661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.184792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.184948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.184969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.184982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.187132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.196664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.196900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.197000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.197028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.197044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.737 [2024-11-27 02:41:41.197192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.737 [2024-11-27 02:41:41.197342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.737 [2024-11-27 02:41:41.197363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.737 [2024-11-27 02:41:41.197376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.737 [2024-11-27 02:41:41.199566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.737 [2024-11-27 02:41:41.208993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.737 [2024-11-27 02:41:41.209267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.209357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.737 [2024-11-27 02:41:41.209384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.737 [2024-11-27 02:41:41.209400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.209606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.209760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.209782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.209796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.211973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.221351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.221630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.221757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.221783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.221798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.221946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.222112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.222133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.222147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.224251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.233574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.233819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.233925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.233951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.233967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.234066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.234202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.234223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.234236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.236395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.245859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.246128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.246244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.246270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.246286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.246465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.246609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.246632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.246645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.248887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.258074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.258368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.258450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.258476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.258493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.258650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.258803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.258825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.258838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.260933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.270236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.270551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.270643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.270668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.270684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.270816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.271016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.271037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.271051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.272954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.282732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.282959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.283078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.283104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.283119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.283235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.283386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.283406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.283419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.285378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.295079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.295340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.295456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.295487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.295503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.295660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.295780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.295801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.295815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.297873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.307399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.307654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.307770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.738 [2024-11-27 02:41:41.307797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.738 [2024-11-27 02:41:41.307814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.738 [2024-11-27 02:41:41.307995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.738 [2024-11-27 02:41:41.308175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.738 [2024-11-27 02:41:41.308195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.738 [2024-11-27 02:41:41.308208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.738 [2024-11-27 02:41:41.310293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.738 [2024-11-27 02:41:41.319668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.738 [2024-11-27 02:41:41.319972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.320089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.320115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.739 [2024-11-27 02:41:41.320131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.739 [2024-11-27 02:41:41.320263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.739 [2024-11-27 02:41:41.320430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.739 [2024-11-27 02:41:41.320450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.739 [2024-11-27 02:41:41.320463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.739 [2024-11-27 02:41:41.322599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.739 [2024-11-27 02:41:41.332092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.739 [2024-11-27 02:41:41.332371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.332465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.332491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.739 [2024-11-27 02:41:41.332512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.739 [2024-11-27 02:41:41.332701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.739 [2024-11-27 02:41:41.332868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.739 [2024-11-27 02:41:41.332889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.739 [2024-11-27 02:41:41.332902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.739 [2024-11-27 02:41:41.334943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.739 [2024-11-27 02:41:41.344301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.739 [2024-11-27 02:41:41.344642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.344731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.344757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.739 [2024-11-27 02:41:41.344773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.739 [2024-11-27 02:41:41.344921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.739 [2024-11-27 02:41:41.345102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.739 [2024-11-27 02:41:41.345122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.739 [2024-11-27 02:41:41.345136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.739 [2024-11-27 02:41:41.347219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.739 [2024-11-27 02:41:41.356569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.739 [2024-11-27 02:41:41.356879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.356965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.739 [2024-11-27 02:41:41.356991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.739 [2024-11-27 02:41:41.357007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.739 [2024-11-27 02:41:41.357138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.739 [2024-11-27 02:41:41.357273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.739 [2024-11-27 02:41:41.357293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.739 [2024-11-27 02:41:41.357306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.739 [2024-11-27 02:41:41.359317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.739 [2024-11-27 02:41:41.368969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.998 [2024-11-27 02:41:41.369332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.369424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.369451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.998 [2024-11-27 02:41:41.369468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.998 [2024-11-27 02:41:41.369601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.998 [2024-11-27 02:41:41.369756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.998 [2024-11-27 02:41:41.369777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.998 [2024-11-27 02:41:41.369791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.998 [2024-11-27 02:41:41.372017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.998 [2024-11-27 02:41:41.381222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.998 [2024-11-27 02:41:41.381502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.381654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.381681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.998 [2024-11-27 02:41:41.381697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.998 [2024-11-27 02:41:41.381845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.998 [2024-11-27 02:41:41.382011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.998 [2024-11-27 02:41:41.382032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.998 [2024-11-27 02:41:41.382045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.998 [2024-11-27 02:41:41.383974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.998 [2024-11-27 02:41:41.393536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.998 [2024-11-27 02:41:41.393863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.393956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.393982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.998 [2024-11-27 02:41:41.393997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.998 [2024-11-27 02:41:41.394129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.998 [2024-11-27 02:41:41.394279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.998 [2024-11-27 02:41:41.394299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.998 [2024-11-27 02:41:41.394312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.998 [2024-11-27 02:41:41.396373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.998 [2024-11-27 02:41:41.405743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.998 [2024-11-27 02:41:41.406066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.406145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.406171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.998 [2024-11-27 02:41:41.406186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.998 [2024-11-27 02:41:41.406286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.998 [2024-11-27 02:41:41.406437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.998 [2024-11-27 02:41:41.406463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.998 [2024-11-27 02:41:41.406477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.998 [2024-11-27 02:41:41.408629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.998 [2024-11-27 02:41:41.417936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.998 [2024-11-27 02:41:41.418217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.418329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.998 [2024-11-27 02:41:41.418354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.998 [2024-11-27 02:41:41.418370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.998 [2024-11-27 02:41:41.418502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.998 [2024-11-27 02:41:41.418695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.998 [2024-11-27 02:41:41.418717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.998 [2024-11-27 02:41:41.418731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.420911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.430198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.430502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.430637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.430663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.430678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.430842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.431009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.431029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.431043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.433019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.442505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.442841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.442955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.442980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.442996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.443191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.443371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.443392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.443409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.445460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.454792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.455020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.455134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.455160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.455175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.455291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.455409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.455430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.455443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.457453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.467096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.467353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.467470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.467496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.467512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.467700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.467820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.467855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.467869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.469823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.479447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.479735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.479817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.479842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.479858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.480038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.480187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.480207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.480220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.482266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.491695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.491955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.492069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.492095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.492110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.492274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.492439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.492460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.492473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.494374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.504010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.504290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.504434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.504460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.504476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.504633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.504802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.504824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.504837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.507079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.516227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.516491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.516619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.516646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.516662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.516810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.517023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.999 [2024-11-27 02:41:41.517044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.999 [2024-11-27 02:41:41.517058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.999 [2024-11-27 02:41:41.519396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.999 [2024-11-27 02:41:41.528380] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.999 [2024-11-27 02:41:41.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.528812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.999 [2024-11-27 02:41:41.528838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:16.999 [2024-11-27 02:41:41.528854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:16.999 [2024-11-27 02:41:41.529002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:16.999 [2024-11-27 02:41:41.529182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.000 [2024-11-27 02:41:41.529203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.000 [2024-11-27 02:41:41.529216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.000 [2024-11-27 02:41:41.531394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.000 [2024-11-27 02:41:41.540783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.000 [2024-11-27 02:41:41.541042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.541127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.541153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.000 [2024-11-27 02:41:41.541169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.000 [2024-11-27 02:41:41.541349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.000 [2024-11-27 02:41:41.541495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.000 [2024-11-27 02:41:41.541538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.000 [2024-11-27 02:41:41.541553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.000 [2024-11-27 02:41:41.543504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.000 [2024-11-27 02:41:41.552964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.000 [2024-11-27 02:41:41.553261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.553374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.553400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.000 [2024-11-27 02:41:41.553415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.000 [2024-11-27 02:41:41.553574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.000 [2024-11-27 02:41:41.553678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.000 [2024-11-27 02:41:41.553699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.000 [2024-11-27 02:41:41.553713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.000 [2024-11-27 02:41:41.555812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.000 [2024-11-27 02:41:41.565222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.000 [2024-11-27 02:41:41.565544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.565656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.565682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.000 [2024-11-27 02:41:41.565697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.000 [2024-11-27 02:41:41.565862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.000 [2024-11-27 02:41:41.566010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.000 [2024-11-27 02:41:41.566030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.000 [2024-11-27 02:41:41.566043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.000 [2024-11-27 02:41:41.568128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.000 [2024-11-27 02:41:41.577497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.000 [2024-11-27 02:41:41.577794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.577910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.577936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.000 [2024-11-27 02:41:41.577952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.000 [2024-11-27 02:41:41.578116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.000 [2024-11-27 02:41:41.578265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.000 [2024-11-27 02:41:41.578285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.000 [2024-11-27 02:41:41.578298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.000 [2024-11-27 02:41:41.580375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.000 [2024-11-27 02:41:41.589808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.000 [2024-11-27 02:41:41.590100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.590225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.000 [2024-11-27 02:41:41.590251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.054 [2024-11-27 02:41:41.590267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.054 [2024-11-27 02:41:41.590399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.054 [2024-11-27 02:41:41.590607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.054 [2024-11-27 02:41:41.590629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.054 [2024-11-27 02:41:41.590643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.054 [2024-11-27 02:41:41.592783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.054 [2024-11-27 02:41:41.602084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.054 [2024-11-27 02:41:41.602341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.602456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.602487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.054 [2024-11-27 02:41:41.602504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.054 [2024-11-27 02:41:41.602677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.054 [2024-11-27 02:41:41.602830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.054 [2024-11-27 02:41:41.602851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.054 [2024-11-27 02:41:41.602864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.054 [2024-11-27 02:41:41.604997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.054 [2024-11-27 02:41:41.614369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.054 [2024-11-27 02:41:41.614622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.614765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.614791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.054 [2024-11-27 02:41:41.614807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.054 [2024-11-27 02:41:41.614938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.054 [2024-11-27 02:41:41.615136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.054 [2024-11-27 02:41:41.615156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.054 [2024-11-27 02:41:41.615169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.054 [2024-11-27 02:41:41.617087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.054 [2024-11-27 02:41:41.626671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.054 [2024-11-27 02:41:41.626988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.627111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.054 [2024-11-27 02:41:41.627145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.054 [2024-11-27 02:41:41.627162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.054 [2024-11-27 02:41:41.627360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.054 [2024-11-27 02:41:41.627512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.054 [2024-11-27 02:41:41.627547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.054 [2024-11-27 02:41:41.627564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.054 [2024-11-27 02:41:41.629658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.638914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.639160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.639248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.639276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.639297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.639414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.639625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.639648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.639663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.641687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.651239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.651565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.651655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.651682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.651698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.651814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.651948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.651969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.651982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.653911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.663675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.663965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.664062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.664087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.664103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.664218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.664369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.664389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.664403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.666500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.676025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.676276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.676375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.676401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.676416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.676628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.676797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.676819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.676848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.679102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.688374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.688653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.688775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.688801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.688817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.688980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.689130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.689151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.689165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.691392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.700503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.700767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.700887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.700913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.700930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.701047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.701182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.701204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.701217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.703448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.712495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.712787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.712883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.712910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.712926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.713041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.314 [2024-11-27 02:41:41.713181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.314 [2024-11-27 02:41:41.713202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.314 [2024-11-27 02:41:41.713216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.314 [2024-11-27 02:41:41.715311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.314 [2024-11-27 02:41:41.724801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.314 [2024-11-27 02:41:41.725101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.725213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.314 [2024-11-27 02:41:41.725239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.314 [2024-11-27 02:41:41.725254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.314 [2024-11-27 02:41:41.725386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.725561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.725583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.725598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.727647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.736972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.737286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.737380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.737408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.737424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.737581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.737734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.737756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.737770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.739986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.749345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.749636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.749776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.749803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.749820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.749952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.750087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.750113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.750128] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.752337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.761634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.761859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.761973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.762000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.762015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.762115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.762299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.762320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.762333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.764616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.774020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.774255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.774371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.774396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.774413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.774544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.774729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.774752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.774766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.776880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 02:41:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:17.315 02:41:41 -- common/autotest_common.sh@862 -- # return 0 00:30:17.315 02:41:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:17.315 02:41:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:17.315 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.315 [2024-11-27 02:41:41.786275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.786595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.786695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.786721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.786737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.786885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.787010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.787031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.787045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.789195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.798600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.798793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.798913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.798938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.798955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.799103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.799269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.799289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.799302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.801439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 02:41:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:17.315 02:41:41 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:17.315 02:41:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.315 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.315 [2024-11-27 02:41:41.810993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.811243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.811385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.811411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.315 [2024-11-27 02:41:41.811427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.315 [2024-11-27 02:41:41.811552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.315 [2024-11-27 02:41:41.811721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.315 [2024-11-27 02:41:41.811742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.315 [2024-11-27 02:41:41.811756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.315 [2024-11-27 02:41:41.813942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.315 [2024-11-27 02:41:41.815100] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:17.315 02:41:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.315 02:41:41 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:17.315 02:41:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.315 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.315 [2024-11-27 02:41:41.823361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.315 [2024-11-27 02:41:41.823646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.823792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.315 [2024-11-27 02:41:41.823818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.316 [2024-11-27 02:41:41.823833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.316 [2024-11-27 02:41:41.823981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.316 [2024-11-27 02:41:41.824148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.316 [2024-11-27 02:41:41.824169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.316 [2024-11-27 02:41:41.824183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.316 [2024-11-27 02:41:41.826107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.316 [2024-11-27 02:41:41.835972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.316 [2024-11-27 02:41:41.836328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.836442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.836468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.316 [2024-11-27 02:41:41.836483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.316 [2024-11-27 02:41:41.836671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.316 [2024-11-27 02:41:41.836855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.316 [2024-11-27 02:41:41.836875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.316 [2024-11-27 02:41:41.836889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.316 [2024-11-27 02:41:41.838822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.316 [2024-11-27 02:41:41.848208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.316 [2024-11-27 02:41:41.848595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.848720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.848746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.316 [2024-11-27 02:41:41.848764] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.316 [2024-11-27 02:41:41.848918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.316 [2024-11-27 02:41:41.849054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.316 [2024-11-27 02:41:41.849076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.316 [2024-11-27 02:41:41.849092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.316 [2024-11-27 02:41:41.850994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.316 [2024-11-27 02:41:41.860421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.316 [2024-11-27 02:41:41.860835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.860979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.861006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.316 [2024-11-27 02:41:41.861035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.316 [2024-11-27 02:41:41.861245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.316 [2024-11-27 02:41:41.861421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.316 [2024-11-27 02:41:41.861444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.316 [2024-11-27 02:41:41.861462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.316 Malloc0 00:30:17.316 02:41:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.316 02:41:41 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:17.316 [2024-11-27 02:41:41.863684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.316 02:41:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.316 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.316 02:41:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.316 02:41:41 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:17.316 02:41:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.316 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.316 [2024-11-27 02:41:41.872927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.316 [2024-11-27 02:41:41.873170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.873297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.316 [2024-11-27 02:41:41.873324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xebc1d0 with addr=10.0.0.2, port=4420 00:30:17.316 [2024-11-27 02:41:41.873340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xebc1d0 is same with the state(5) to be set 00:30:17.316 [2024-11-27 02:41:41.873547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xebc1d0 (9): Bad file descriptor 00:30:17.316 [2024-11-27 02:41:41.873685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.316 [2024-11-27 02:41:41.873707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.316 [2024-11-27 02:41:41.873721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.316 [2024-11-27 02:41:41.875898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.316 02:41:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.316 02:41:41 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:17.316 02:41:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.316 02:41:41 -- common/autotest_common.sh@10 -- # set +x 00:30:17.316 [2024-11-27 02:41:41.882980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:17.316 [2024-11-27 02:41:41.885427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.316 02:41:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.316 02:41:41 -- host/bdevperf.sh@38 -- # wait 2198091 00:30:17.574 [2024-11-27 02:41:41.998878] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:25.680 00:30:25.680 Latency(us) 00:30:25.680 [2024-11-27T01:41:50.315Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.680 [2024-11-27T01:41:50.315Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:25.680 Verification LBA range: start 0x0 length 0x4000 00:30:25.680 Nvme1n1 : 15.01 9404.03 36.73 16426.67 0.00 4940.73 649.29 20583.16 00:30:25.680 [2024-11-27T01:41:50.315Z] =================================================================================================================== 00:30:25.680 [2024-11-27T01:41:50.315Z] Total : 9404.03 36.73 16426.67 0.00 4940.73 649.29 20583.16 00:30:25.938 02:41:50 -- host/bdevperf.sh@39 -- # sync 00:30:25.938 02:41:50 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:25.938 02:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:25.938 02:41:50 -- common/autotest_common.sh@10 -- # set +x 00:30:25.938 02:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:25.938 02:41:50 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:25.938 02:41:50 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:25.938 02:41:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:25.938 02:41:50 -- nvmf/common.sh@116 -- # sync 00:30:25.938 02:41:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:25.938 02:41:50 -- nvmf/common.sh@119 -- # set +e 00:30:25.938 02:41:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:25.938 02:41:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:25.938 rmmod nvme_tcp 00:30:25.938 rmmod nvme_fabrics 00:30:25.938 rmmod nvme_keyring 00:30:25.938 02:41:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:25.938 02:41:50 -- nvmf/common.sh@123 -- # set -e 00:30:25.938 02:41:50 -- nvmf/common.sh@124 -- # return 0 00:30:25.938 02:41:50 -- nvmf/common.sh@477 -- # '[' -n 2198778 ']' 00:30:25.938 02:41:50 -- nvmf/common.sh@478 -- # killprocess 2198778 00:30:25.938 02:41:50 -- common/autotest_common.sh@936 -- # '[' -z 2198778 ']' 00:30:25.938 02:41:50 -- common/autotest_common.sh@940 -- # kill -0 2198778 00:30:25.938 02:41:50 -- common/autotest_common.sh@941 -- # uname 00:30:25.938 02:41:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:25.938 02:41:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2198778 00:30:25.938 02:41:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:25.938 02:41:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:25.938 02:41:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2198778' 00:30:25.938 killing process with pid 2198778 00:30:25.938 02:41:50 -- common/autotest_common.sh@955 -- # kill 2198778 00:30:25.938 02:41:50 -- common/autotest_common.sh@960 -- # wait 2198778 00:30:26.198 02:41:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:26.198 02:41:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.198 02:41:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.198 02:41:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.198 02:41:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.198 02:41:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.198 02:41:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:26.198 02:41:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.732 02:41:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:28.732 00:30:28.732 real 0m23.115s 00:30:28.732 user 1m2.445s 00:30:28.732 sys 0m4.139s 00:30:28.732 02:41:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.732 02:41:52 -- common/autotest_common.sh@10 -- # set +x 00:30:28.732 ************************************ 00:30:28.732 END TEST nvmf_bdevperf 00:30:28.732 ************************************ 00:30:28.732 02:41:52 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:28.732 02:41:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:28.732 02:41:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:28.732 02:41:52 -- common/autotest_common.sh@10 -- # set +x 00:30:28.732 ************************************ 00:30:28.732 START TEST nvmf_target_disconnect 00:30:28.732 ************************************ 00:30:28.732 02:41:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:28.732 * Looking for test storage... 00:30:28.732 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:28.732 02:41:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:28.732 02:41:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:28.732 02:41:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:28.732 02:41:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:28.732 02:41:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:28.732 02:41:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:28.732 02:41:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:28.732 02:41:52 -- scripts/common.sh@335 -- # IFS=.-: 00:30:28.732 02:41:52 -- scripts/common.sh@335 -- # read -ra ver1 00:30:28.732 02:41:52 -- scripts/common.sh@336 -- # IFS=.-: 00:30:28.732 02:41:52 -- scripts/common.sh@336 -- # read -ra ver2 00:30:28.732 02:41:52 -- scripts/common.sh@337 -- # local 'op=<' 00:30:28.732 02:41:52 -- scripts/common.sh@339 -- # ver1_l=2 00:30:28.732 02:41:52 -- scripts/common.sh@340 -- # ver2_l=1 00:30:28.732 02:41:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:28.732 02:41:52 -- scripts/common.sh@343 -- # case "$op" in 00:30:28.732 02:41:52 -- scripts/common.sh@344 -- # : 1 00:30:28.732 02:41:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:28.732 02:41:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:28.732 02:41:52 -- scripts/common.sh@364 -- # decimal 1 00:30:28.732 02:41:52 -- scripts/common.sh@352 -- # local d=1 00:30:28.732 02:41:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:28.732 02:41:52 -- scripts/common.sh@354 -- # echo 1 00:30:28.732 02:41:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:28.732 02:41:52 -- scripts/common.sh@365 -- # decimal 2 00:30:28.732 02:41:52 -- scripts/common.sh@352 -- # local d=2 00:30:28.732 02:41:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:28.732 02:41:52 -- scripts/common.sh@354 -- # echo 2 00:30:28.732 02:41:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:28.732 02:41:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:28.732 02:41:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:28.732 02:41:52 -- scripts/common.sh@367 -- # return 0 00:30:28.732 02:41:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:28.732 02:41:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:28.732 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.732 --rc genhtml_branch_coverage=1 00:30:28.732 --rc genhtml_function_coverage=1 00:30:28.732 --rc genhtml_legend=1 00:30:28.732 --rc geninfo_all_blocks=1 00:30:28.732 --rc geninfo_unexecuted_blocks=1 00:30:28.732 00:30:28.732 ' 00:30:28.733 02:41:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:28.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.733 --rc genhtml_branch_coverage=1 00:30:28.733 --rc genhtml_function_coverage=1 00:30:28.733 --rc genhtml_legend=1 00:30:28.733 --rc geninfo_all_blocks=1 00:30:28.733 --rc geninfo_unexecuted_blocks=1 00:30:28.733 00:30:28.733 ' 00:30:28.733 02:41:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:28.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.733 --rc genhtml_branch_coverage=1 00:30:28.733 --rc genhtml_function_coverage=1 00:30:28.733 --rc genhtml_legend=1 00:30:28.733 --rc geninfo_all_blocks=1 00:30:28.733 --rc geninfo_unexecuted_blocks=1 00:30:28.733 00:30:28.733 ' 00:30:28.733 02:41:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:28.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.733 --rc genhtml_branch_coverage=1 00:30:28.733 --rc genhtml_function_coverage=1 00:30:28.733 --rc genhtml_legend=1 00:30:28.733 --rc geninfo_all_blocks=1 00:30:28.733 --rc geninfo_unexecuted_blocks=1 00:30:28.733 00:30:28.733 ' 00:30:28.733 02:41:52 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:28.733 02:41:52 -- nvmf/common.sh@7 -- # uname -s 00:30:28.733 02:41:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:28.733 02:41:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:28.733 02:41:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:28.733 02:41:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:28.733 02:41:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:28.733 02:41:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:28.733 02:41:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:28.733 02:41:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:28.733 02:41:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:28.733 02:41:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:28.733 02:41:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.733 02:41:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.733 02:41:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:28.733 02:41:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:28.733 02:41:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:28.733 02:41:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:28.733 02:41:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:28.733 02:41:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:28.733 02:41:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:28.733 02:41:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.733 02:41:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.733 02:41:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.733 02:41:52 -- paths/export.sh@5 -- # export PATH 00:30:28.733 02:41:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.733 02:41:52 -- nvmf/common.sh@46 -- # : 0 00:30:28.733 02:41:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:28.733 02:41:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:28.733 02:41:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:28.733 02:41:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:28.733 02:41:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:28.733 02:41:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:28.733 02:41:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:28.733 02:41:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:28.733 02:41:52 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:28.733 02:41:52 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:28.733 02:41:52 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:28.733 02:41:52 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:28.733 02:41:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:28.733 02:41:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:28.733 02:41:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:28.733 02:41:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:28.733 02:41:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:28.733 02:41:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:28.733 02:41:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:28.733 02:41:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.733 02:41:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:28.733 02:41:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:28.733 02:41:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:28.733 02:41:52 -- common/autotest_common.sh@10 -- # set +x 00:30:30.693 02:41:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:30.693 02:41:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:30.693 02:41:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:30.693 02:41:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:30.693 02:41:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:30.693 02:41:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:30.693 02:41:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:30.693 02:41:55 -- nvmf/common.sh@294 -- # net_devs=() 00:30:30.693 02:41:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:30.693 02:41:55 -- nvmf/common.sh@295 -- # e810=() 00:30:30.693 02:41:55 -- nvmf/common.sh@295 -- # local -ga e810 00:30:30.693 02:41:55 -- nvmf/common.sh@296 -- # x722=() 00:30:30.693 02:41:55 -- nvmf/common.sh@296 -- # local -ga x722 00:30:30.693 02:41:55 -- nvmf/common.sh@297 -- # mlx=() 00:30:30.693 02:41:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:30.693 02:41:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:30.693 02:41:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:30.693 02:41:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:30.693 02:41:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.693 02:41:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:30.693 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:30.693 02:41:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.693 02:41:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:30.693 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:30.693 02:41:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.693 02:41:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.693 02:41:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.693 02:41:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:30.693 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:30.693 02:41:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.693 02:41:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.693 02:41:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.693 02:41:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.693 02:41:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:30.693 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:30.693 02:41:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.693 02:41:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:30.693 02:41:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:30.693 02:41:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:30.693 02:41:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:30.693 02:41:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:30.693 02:41:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:30.693 02:41:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:30.693 02:41:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:30.693 02:41:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:30.693 02:41:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:30.693 02:41:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:30.693 02:41:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:30.693 02:41:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:30.693 02:41:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:30.693 02:41:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:30.693 02:41:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:30.693 02:41:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:30.693 02:41:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:30.693 02:41:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:30.693 02:41:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:30.693 02:41:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:30.694 02:41:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:30.694 02:41:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:30.694 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:30.694 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:30:30.694 00:30:30.694 --- 10.0.0.2 ping statistics --- 00:30:30.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:30.694 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:30:30.694 02:41:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:30.694 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:30.694 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:30:30.694 00:30:30.694 --- 10.0.0.1 ping statistics --- 00:30:30.694 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:30.694 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:30:30.694 02:41:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:30.694 02:41:55 -- nvmf/common.sh@410 -- # return 0 00:30:30.694 02:41:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:30.694 02:41:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:30.694 02:41:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:30.694 02:41:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:30.694 02:41:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:30.694 02:41:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:30.694 02:41:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:30.694 02:41:55 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:30.694 02:41:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:30.694 02:41:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:30.694 02:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.694 ************************************ 00:30:30.694 START TEST nvmf_target_disconnect_tc1 00:30:30.694 ************************************ 00:30:30.694 02:41:55 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:30.694 02:41:55 -- host/target_disconnect.sh@32 -- # set +e 00:30:30.694 02:41:55 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:30.694 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.952 [2024-11-27 02:41:55.353256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.952 [2024-11-27 02:41:55.353462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.952 [2024-11-27 02:41:55.353511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x993270 with addr=10.0.0.2, port=4420 00:30:30.952 [2024-11-27 02:41:55.353562] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:30.952 [2024-11-27 02:41:55.353583] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:30.952 [2024-11-27 02:41:55.353596] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:30.952 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:30.952 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:30.952 Initializing NVMe Controllers 00:30:30.952 02:41:55 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:30.952 02:41:55 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:30.952 02:41:55 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:30.952 02:41:55 -- common/autotest_common.sh@1142 -- # return 0 00:30:30.952 02:41:55 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:30.952 02:41:55 -- host/target_disconnect.sh@41 -- # set -e 00:30:30.952 00:30:30.952 real 0m0.092s 00:30:30.952 user 0m0.034s 00:30:30.952 sys 0m0.057s 00:30:30.952 02:41:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:30.952 02:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.952 ************************************ 00:30:30.952 END TEST nvmf_target_disconnect_tc1 00:30:30.952 ************************************ 00:30:30.952 02:41:55 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:30.952 02:41:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:30.952 02:41:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:30.952 02:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.952 ************************************ 00:30:30.952 START TEST nvmf_target_disconnect_tc2 00:30:30.952 ************************************ 00:30:30.952 02:41:55 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:30.952 02:41:55 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:30.952 02:41:55 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:30.952 02:41:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:30.952 02:41:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:30.952 02:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.952 02:41:55 -- nvmf/common.sh@469 -- # nvmfpid=2201983 00:30:30.952 02:41:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:30.952 02:41:55 -- nvmf/common.sh@470 -- # waitforlisten 2201983 00:30:30.952 02:41:55 -- common/autotest_common.sh@829 -- # '[' -z 2201983 ']' 00:30:30.952 02:41:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:30.952 02:41:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:30.952 02:41:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:30.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:30.952 02:41:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:30.952 02:41:55 -- common/autotest_common.sh@10 -- # set +x 00:30:30.952 [2024-11-27 02:41:55.442123] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:30.952 [2024-11-27 02:41:55.442203] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:30.952 EAL: No free 2048 kB hugepages reported on node 1 00:30:30.952 [2024-11-27 02:41:55.505482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:31.210 [2024-11-27 02:41:55.586295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.211 [2024-11-27 02:41:55.586456] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.211 [2024-11-27 02:41:55.586475] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:31.211 [2024-11-27 02:41:55.586487] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.211 [2024-11-27 02:41:55.586567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:31.211 [2024-11-27 02:41:55.586712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:31.211 [2024-11-27 02:41:55.586732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:31.211 [2024-11-27 02:41:55.586736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:31.775 02:41:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:31.775 02:41:56 -- common/autotest_common.sh@862 -- # return 0 00:30:31.775 02:41:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:31.775 02:41:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:31.775 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 02:41:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:32.033 02:41:56 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 Malloc0 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 [2024-11-27 02:41:56.441270] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 [2024-11-27 02:41:56.469544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:32.033 02:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:32.033 02:41:56 -- common/autotest_common.sh@10 -- # set +x 00:30:32.033 02:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:32.033 02:41:56 -- host/target_disconnect.sh@50 -- # reconnectpid=2202142 00:30:32.033 02:41:56 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:32.033 02:41:56 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:32.033 EAL: No free 2048 kB hugepages reported on node 1 00:30:33.940 02:41:58 -- host/target_disconnect.sh@53 -- # kill -9 2201983 00:30:33.940 02:41:58 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 [2024-11-27 02:41:58.495173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Write completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 [2024-11-27 02:41:58.495486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.940 Read completed with error (sct=0, sc=8) 00:30:33.940 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Write completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 Read completed with error (sct=0, sc=8) 00:30:33.941 starting I/O failed 00:30:33.941 [2024-11-27 02:41:58.495824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.941 [2024-11-27 02:41:58.495996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.496250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.496449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.496691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.496815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.496939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.497191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.497414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.497639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.497781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.497913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.498174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.498361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.498629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.498824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.498985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.499068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.499311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.499543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.499782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.499907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.500025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.500236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.500484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.500723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.500830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.500944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.501084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.501109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.941 qpair failed and we were unable to recover it. 00:30:33.941 [2024-11-27 02:41:58.501191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.941 [2024-11-27 02:41:58.501308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.501333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.501419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.501540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.501566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.501738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.501765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.501916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.502153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.502411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.502679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.502798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.502948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.503168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.503459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.503746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.503865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.503979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.504196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.504437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.504685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.504871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.505009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.505242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.505474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.505698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.505835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.505986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.506186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.506409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.506650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.506785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.506976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.507236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.507477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.507711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.507850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.508007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.508093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.508118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.508205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.508296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.942 [2024-11-27 02:41:58.508321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.942 qpair failed and we were unable to recover it. 00:30:33.942 [2024-11-27 02:41:58.508429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.508513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.508545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.508668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.508784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.508809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.508923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Read completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 Write completed with error (sct=0, sc=8) 00:30:33.943 starting I/O failed 00:30:33.943 [2024-11-27 02:41:58.509394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:33.943 [2024-11-27 02:41:58.509550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.509810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.509982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.510122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.510425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.510622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.510814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.510957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.511069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.511361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.511603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.511821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.511987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.512137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.512421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.512677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.512789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.512944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.513191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.513656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.513818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.943 qpair failed and we were unable to recover it. 00:30:33.943 [2024-11-27 02:41:58.513932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.514072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.943 [2024-11-27 02:41:58.514097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.514208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.514545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.514802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.514948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.515034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.515264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.515519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.515706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.515889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.516117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.516374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.516619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.516847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.516994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.517141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.517406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.517721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.517823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.517942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.518194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.518398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.518677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.518823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.518935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.519174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.519376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.519614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.519883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.519994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.520037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.520139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.520297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.520323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.520413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.520529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.944 [2024-11-27 02:41:58.520555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.944 qpair failed and we were unable to recover it. 00:30:33.944 [2024-11-27 02:41:58.520694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.520778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.520802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.520885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.521170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.521414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.521702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.521888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.521974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.522112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.522334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.522604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.522834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.522945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.523095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.523314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.523537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.523859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.523965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.524104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.524327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.524514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.524789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.524954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.525039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.525263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.525536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.525762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.525902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.526015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.526248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.526494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.526729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.526842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.526952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.527029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.527054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.945 qpair failed and we were unable to recover it. 00:30:33.945 [2024-11-27 02:41:58.527147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.945 [2024-11-27 02:41:58.527232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.527257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.527363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.527503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.527536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.527657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.527770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.527795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.527877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.528179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.528433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.528711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.528827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.528929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.529118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.529317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.529517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.529810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.529973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.530052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.530302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.530500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.530822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.530963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.531068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.531328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.531549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.531787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.531954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.532076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.532278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.532541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.532742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.532882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.532963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.533212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.533473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.533753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.533892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.946 [2024-11-27 02:41:58.533989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.534071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.946 [2024-11-27 02:41:58.534096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.946 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.534213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.534485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.534802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.534917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.535026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.535273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.535544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.535859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.535984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.536126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.536395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.536683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.536879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.536979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.537094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.537322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.537522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.537781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.537922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.538032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.538259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.538571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.538789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.538922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.539009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.539309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.539632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.539879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.539970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.540129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.540353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.540548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.540825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.540955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.541036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.541146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.541171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.947 qpair failed and we were unable to recover it. 00:30:33.947 [2024-11-27 02:41:58.541251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.541327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.947 [2024-11-27 02:41:58.541352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.541486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.541624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.541649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.541738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.541843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.541867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.541982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.542317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.542550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.542785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.542926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.543054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.543276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.543476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.543758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.543904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.543983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.544214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.544419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.544652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.544851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.544992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.545136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.545373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.545629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.545874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.545984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.546106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.546344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.546571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.546845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.546958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.547082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.547301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.547536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.547757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.547889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.548030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.548168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.548193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.948 qpair failed and we were unable to recover it. 00:30:33.948 [2024-11-27 02:41:58.548309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.548418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.948 [2024-11-27 02:41:58.548442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.548537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.548644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.548669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.548765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.548879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.548903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.549050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.549318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.549594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.549824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.549991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.550108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.550352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.550579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.550802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.550920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.551033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.551279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.551498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.551849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.551988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.552094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.552330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.552557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.552789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.552921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.553061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.553294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.553542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.553777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.553921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.554065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.554277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.554513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.949 [2024-11-27 02:41:58.554685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.949 qpair failed and we were unable to recover it. 00:30:33.949 [2024-11-27 02:41:58.554848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.554952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.554976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.555091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.555308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.555531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.555741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.555884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.555973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.556183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.556412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.556742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.556892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.557024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.557314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.557618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.557759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.557872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.558162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.558460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.558739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.558848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.558972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.559209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.559434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.559691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.559870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.559982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.560254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.560507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.560802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.560924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.561080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.561339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.561616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.561793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.561932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.562026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.562053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.950 [2024-11-27 02:41:58.562190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.562288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.950 [2024-11-27 02:41:58.562315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.950 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.562418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.562535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.562561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.562651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.562795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.562821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.562909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.563117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.563299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.563521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.563780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.563894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.564017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.564315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.564569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.564798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.564962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.565102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.565233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.565271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.565380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.565543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:33.951 [2024-11-27 02:41:58.565574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:33.951 qpair failed and we were unable to recover it. 00:30:33.951 [2024-11-27 02:41:58.565733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.565816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.565841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.565945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.566267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.566539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.566866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.566995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.567125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.567386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.567649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.567761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.567895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.568168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.568418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.568752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.568906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.569015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.569272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.569545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.569838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.569977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.570088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.570372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.570620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.238 qpair failed and we were unable to recover it. 00:30:34.238 [2024-11-27 02:41:58.570852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.238 [2024-11-27 02:41:58.570928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.570953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.571038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.571262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.571443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.571698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.571860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.571980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.572200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.572468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.572749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.572892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.572977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.573233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.573509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.573730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.573913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.574029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.574316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.574558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.574802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.574964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.575047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.575336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.575637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.575904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.575989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.576095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.576439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.576658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.576851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.576993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.577106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.577290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.577550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.577733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.239 [2024-11-27 02:41:58.577870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.578005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.239 [2024-11-27 02:41:58.578030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.239 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.578134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.578432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.578701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.578817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.578931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.579229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.579522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.579802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.579940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.580067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.580347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.580536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.580748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.580931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.581085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.581370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.581649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.581847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.581999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.582132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.582375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.582692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.582828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.582938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.583155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.583448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.583772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.583912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.584045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.584345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.584592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.584842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.584959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.585069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.585281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.240 [2024-11-27 02:41:58.585472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.240 [2024-11-27 02:41:58.585636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.240 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.585769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.585858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.585885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.586017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.586293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.586520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.586781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.586936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.587067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.587313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.587618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.587837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.587994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.588104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.588363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.588601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.588761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.588855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.589185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.589372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.589681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.589798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.589934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.590162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.590385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.590662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.590778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.590895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.591113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.591468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.591732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.591892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.591994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.592224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.592501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.592799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.592991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.241 [2024-11-27 02:41:58.593107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.593219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.241 [2024-11-27 02:41:58.593244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.241 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.593388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.593493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.593518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.593612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.593761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.593788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.593919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.593999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.594156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.594406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.594695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.594887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.594998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.595150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.595378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.595612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.595845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.595960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.596070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.596256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.596539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.596777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.596938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.597022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.597370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.597664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.597874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.597962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.598102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.598360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.598591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.598804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.598908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.599001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.599116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.242 [2024-11-27 02:41:58.599140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.242 qpair failed and we were unable to recover it. 00:30:34.242 [2024-11-27 02:41:58.599243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.599535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.599785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.599893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.599999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.600227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.600490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.600772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.600929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.601071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.601311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.601564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.601761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.601918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.602034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.602220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.602495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.602793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.602934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.603110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.603448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.603733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.603867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.603978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.604286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.604504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.604742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.604897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.605013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.605261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.605551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.605802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.605912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.605997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.606219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.243 [2024-11-27 02:41:58.606540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.243 [2024-11-27 02:41:58.606677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.243 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.606757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.606884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.606908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.607043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.607254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.607501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.607713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.607819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.607908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.608171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.608463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.608979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.609094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.609308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.609533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.609774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.609891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.610007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.610283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.610575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.610832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.610942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.611056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.611274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.611523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.611716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.611850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.611958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.612247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.612491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.612724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.612864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.613000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.613242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.613550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.244 qpair failed and we were unable to recover it. 00:30:34.244 [2024-11-27 02:41:58.613834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.244 [2024-11-27 02:41:58.613978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.614096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.614327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.614555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.614797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.614952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.615070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.615356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.615617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.615835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.615969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.616059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.616289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.616507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.616727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.616902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.617028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.617286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.617535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.617782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.617993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.618079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.618266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.618521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.618824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.618937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.619075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.619340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.619604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.619851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.619955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.620095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.620362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.620559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.620845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.620974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.621001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.245 qpair failed and we were unable to recover it. 00:30:34.245 [2024-11-27 02:41:58.621139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.245 [2024-11-27 02:41:58.621251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.621276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.621433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.621555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.621584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.621706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.621815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.621839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.621971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.622233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.622456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.622653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.622805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.622908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.623184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.623453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.623703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.623844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.623936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.624175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.624425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.624688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.624852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.624984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.625211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.625514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.625784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.625890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.625963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.626251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.626544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.626818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.626992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.627074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.627277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.627506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.627809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.627966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.628133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.628214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.628238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.628365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.628462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.628489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.246 qpair failed and we were unable to recover it. 00:30:34.246 [2024-11-27 02:41:58.628605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.246 [2024-11-27 02:41:58.628743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.628768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.628857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.628977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.629107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.629393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.629723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.629857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.629989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.630227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.630584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.630844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.630976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.631150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.631373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.631590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.631845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.631967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.632103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.632374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.632647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.632797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.632900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.633152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.633419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.633702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.633834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.633998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.634280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.634537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.634745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.634939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.635054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.635182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.635224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.247 qpair failed and we were unable to recover it. 00:30:34.247 [2024-11-27 02:41:58.635378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.635491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.247 [2024-11-27 02:41:58.635516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.635710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.635786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.635811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.635899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.635987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.636197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.636475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.636727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.636892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.637010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.637262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.637511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.637739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.637873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.637996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.638239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.638502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.638727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.638857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.638979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.639225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.639457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.639708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.639862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.640000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.640252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.640499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.640719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.640849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.640929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.641225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.641488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.641737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.641903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.642037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.642252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.642523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.248 qpair failed and we were unable to recover it. 00:30:34.248 [2024-11-27 02:41:58.642724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.248 [2024-11-27 02:41:58.642852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.642879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.643011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.643274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.643515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.643835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.643969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.644100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.644361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.644611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.644754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.644919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.645165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.645414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.645709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.645832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.645959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.646174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.646442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.646718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.646876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.647002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.647275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.647574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.647821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.647951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.648052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.648278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.648495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.648755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.648882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.649030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.649213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.649473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.649738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.649879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.650022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.650128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.650152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.249 qpair failed and we were unable to recover it. 00:30:34.249 [2024-11-27 02:41:58.650256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.249 [2024-11-27 02:41:58.650387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.650415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.650507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.650626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.650651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.650789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.650883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.650908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.651022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.651236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.651483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.651768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.651876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.651987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.652204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.652433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.652766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.652873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.652987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.653205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.653466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.653741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.653873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.654001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.654261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.654563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.654818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.654957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.655054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.655351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.655675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.655835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.655928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.656174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.656418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.656658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.656846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.657010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.657289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.657552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.250 qpair failed and we were unable to recover it. 00:30:34.250 [2024-11-27 02:41:58.657832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.250 [2024-11-27 02:41:58.657958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.657983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.658160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.658438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.658683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.658846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.658931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.659156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.659397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.659676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.659834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.659956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.660209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.660455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.660740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.660845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.660986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.661256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.661518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.661796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.661958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.662066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.662277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.662511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.662775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.662963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.663078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.663322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.663573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.663870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.663997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.664097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.664402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.664694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.664842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.664920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.665011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.665037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.251 qpair failed and we were unable to recover it. 00:30:34.251 [2024-11-27 02:41:58.665126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.665241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.251 [2024-11-27 02:41:58.665287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.665415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.665512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.665547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.665716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.665855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.665896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.666016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.666319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.666608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.666714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.666875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.667151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.667483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.667755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.667862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.667975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.668250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.668533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.668777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.668884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.669001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.669243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.669522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.669800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.669960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.670039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.670358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.670607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.670745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.670890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.671216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.671468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.671658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.671770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.671905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.672022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.672050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.252 qpair failed and we were unable to recover it. 00:30:34.252 [2024-11-27 02:41:58.672193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.672311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.252 [2024-11-27 02:41:58.672337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.672472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.672597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.672641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.672751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.672871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.672896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.673003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.673229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.673543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.673800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.673939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.674036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.674306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.674590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.674758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.674891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.675158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.675399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.675593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.675834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.675971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.676137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.676388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.676642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.676758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.676897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.677134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.677384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.677651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.677880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.677996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.678119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.678384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.678636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.678890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.678995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.679126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.679385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.253 qpair failed and we were unable to recover it. 00:30:34.253 [2024-11-27 02:41:58.679601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.253 [2024-11-27 02:41:58.679753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.679890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.679993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.680104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.680397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.680660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.680776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.680884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.681124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.681431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.681689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.681846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.681943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.682239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.682571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.682729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.682876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.683198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.683446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.683725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.683900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.684013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.684274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.684547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.684768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.684906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.685092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.685357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.685610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.685836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.685992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.686117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.686351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.686585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.686865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.686991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.687031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.687172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.687257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.687282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.254 qpair failed and we were unable to recover it. 00:30:34.254 [2024-11-27 02:41:58.687438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.254 [2024-11-27 02:41:58.687542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.687572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.687665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.687790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.687817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.687960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.688181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.688374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.688639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.688873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.688989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.689098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.689427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.689715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.689850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.689938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.690263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.690502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.690730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.690856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.690993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.691216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.691453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.691744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.691884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.691997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.692203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.692499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.692758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.692867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.692988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.693236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.693451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.693728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.693890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.694029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.694235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.694475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.255 qpair failed and we were unable to recover it. 00:30:34.255 [2024-11-27 02:41:58.694740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.255 [2024-11-27 02:41:58.694832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.694856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.694998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.695220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.695549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.695852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.695973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.696094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.696318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.696559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.696785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.696964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.697103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.697360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.697639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.697765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.697928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.698172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.698501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.698799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.698931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.699057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.699339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.699602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.699791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.699936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.700055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.700332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.700557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.700859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.700981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.701009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.256 qpair failed and we were unable to recover it. 00:30:34.256 [2024-11-27 02:41:58.701135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.701260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.256 [2024-11-27 02:41:58.701285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.701437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.701530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.701556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.701665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.701774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.701801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.701928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.702122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.702424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.702667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.702810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.702942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.703162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.703407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.703652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.703814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.703929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.704220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.704468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.704792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.704896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.705010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.705308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.705560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.705844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.705986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.706125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.706408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.706635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.706883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.706983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.707169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.707401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.707639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.707872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.707970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.708002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.708107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.708184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.708209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.257 [2024-11-27 02:41:58.708348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.708441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.257 [2024-11-27 02:41:58.708465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.257 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.708575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.708717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.708745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.708860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.708970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.708995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.709126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.709401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.709706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.709846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.709926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.710239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.710460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.710714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.710822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.710925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.711255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.711503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.711789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.711959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.712100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.712353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.712581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.712754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.712899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.713205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.713537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.713847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.713983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.714128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.714372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.714555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.714802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.714906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.714998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.715226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.715467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.715775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.715905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.258 qpair failed and we were unable to recover it. 00:30:34.258 [2024-11-27 02:41:58.716034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.716122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.258 [2024-11-27 02:41:58.716147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.716234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.716456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.716756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.716872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.716957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.717265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.717538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.717765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.717904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.718021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.718283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.718576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.718862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.718977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.719077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.719303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.719614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.719893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.719978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.720117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.720386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.720695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.720804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.720915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.721226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.721511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.721753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.721940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.722029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.722265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.722538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.722807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.722934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.723044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.723375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.259 qpair failed and we were unable to recover it. 00:30:34.259 [2024-11-27 02:41:58.723641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.259 [2024-11-27 02:41:58.723859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.724023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.724326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.724633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.724857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.724998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.725109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.725356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.725669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.725830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.725955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.726266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.726539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.726769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.726891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.727000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.727282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.727529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.727834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.727991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.728081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.728335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.728625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.728766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.728879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.729173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.729452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.729790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.729934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.730122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.730433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.730660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.730803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.730892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.731157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.731454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.260 qpair failed and we were unable to recover it. 00:30:34.260 [2024-11-27 02:41:58.731731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.260 [2024-11-27 02:41:58.731815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.731843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.731969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.732197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.732449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.732687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.732801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.732914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.733209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.733512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.733783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.733952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.734142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.734359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.734674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.734813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.734929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.735191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.735459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.735731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.735844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.735962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.736320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.736575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.736848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.736972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.737117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.737363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.737692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.737848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.737984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.738180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.261 [2024-11-27 02:41:58.738434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.261 [2024-11-27 02:41:58.738602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.261 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.738714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.738826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.738851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.738956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.739231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.739495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.739747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.739883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.739969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.740164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.740433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.740715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.740863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.741001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.741277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.741533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.741748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.741848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.741936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.742158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.742448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.742758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.742863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.742973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.743251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.743536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.743775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.743946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.744061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.744345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.744568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.744843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.744964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.745078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.745377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.745641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.745832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.262 [2024-11-27 02:41:58.745932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.746071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.262 [2024-11-27 02:41:58.746096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.262 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.746208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.746536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.746791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.746918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.747069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.747388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.747724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.747837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.748026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.748323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.748551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.748794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.748943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.749076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.749372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.749758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.749868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.749950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.750173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.750447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.750694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.750913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.751013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.751261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.751473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.751764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.751902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.752017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.752207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.752580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.752793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.752953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.753216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.753487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.753724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.753860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.263 [2024-11-27 02:41:58.753974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.754085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.263 [2024-11-27 02:41:58.754110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.263 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.754223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.754503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.754800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.754920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.755089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.755365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.755628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.755865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.755984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.756070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.756417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.756643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.756861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.756944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.757236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.757545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.757750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.757904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.758070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.758307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.758546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.758813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.758947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.759048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.759400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.759690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.759803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.759933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.760182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.760496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.760781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.760882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.760966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.761315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.761603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.761791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.264 [2024-11-27 02:41:58.761879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.762021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.264 [2024-11-27 02:41:58.762046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.264 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.762132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.762397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.762659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.762772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.762926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.763178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.763456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.763701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.763818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.763947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.764325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.764573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.764797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.764898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.765214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.765478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.765716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.765875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.765951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.766184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.766385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.766661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.766764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.766874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.767259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.767488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.767741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.767879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.768015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.768346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.265 qpair failed and we were unable to recover it. 00:30:34.265 [2024-11-27 02:41:58.768589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.265 [2024-11-27 02:41:58.768715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.768857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.768946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.768971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.769086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.769337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.769551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.769800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.769925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.770050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.770401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.770687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.770795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.770921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.771172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.771428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.771636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.771796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.771919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.772200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.772502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.772794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.772948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.773023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.773274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.773477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.773707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.773844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.773932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.774134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.774359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.774608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.774770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.775268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.775492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.775772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.775890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.266 qpair failed and we were unable to recover it. 00:30:34.266 [2024-11-27 02:41:58.775979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.266 [2024-11-27 02:41:58.776124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.776237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.776559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.776829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.776990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.777094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.777297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.777656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.777879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.777994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.778201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.778451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.778685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.778831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.778972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.779287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.779567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.779792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.779930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.780154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.780394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.780697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.780838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.780940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.781207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.781471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.781699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.781817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.781908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.782154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.782371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.782607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.782895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.782988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.783098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.783362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.267 qpair failed and we were unable to recover it. 00:30:34.267 [2024-11-27 02:41:58.783640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.267 [2024-11-27 02:41:58.783765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.783793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.783924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.784180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.784501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.784810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.784956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.785065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.785328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.785556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.785869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.785986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.786065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.786290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.786536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.786790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.786902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.787016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.787265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.787517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.787739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.787853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.787960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.788256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.788482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.788727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.788912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.789047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.789389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.789662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.789867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.789984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.790122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.790353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.790600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.268 [2024-11-27 02:41:58.790838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.268 [2024-11-27 02:41:58.790957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.268 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.791099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.791314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.791559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.791857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.791983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.792112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.792423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.792683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.792804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.792907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.793213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.793484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.793690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.793833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.793926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.794164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.794386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.794686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.794827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.794918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.795159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.795409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.795618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.795876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.795996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.796168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.796503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.796781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.796966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.797080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.797359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.797682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.797824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.797962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.798223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.269 [2024-11-27 02:41:58.798462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.269 [2024-11-27 02:41:58.798629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.269 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.798780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.798907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.798933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.799023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.799273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.799564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.799858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.799987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.800100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.800347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.800627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.800842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.800970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.801259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.801620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.801903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.801998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.802179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.802471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.802669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.802790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.802932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.803211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.803427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.803659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.803803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.803898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.804155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.804411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.804654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.804784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.804920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.805061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.805087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.805212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.805331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.270 [2024-11-27 02:41:58.805358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.270 qpair failed and we were unable to recover it. 00:30:34.270 [2024-11-27 02:41:58.805442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.805544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.805593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.805725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.805878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.805907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.806005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.806286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.806594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.806761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.806862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.807172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.807479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.807751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.807910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.807999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.808258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.808520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.808777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.808898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.809021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.809276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.809576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.809858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.809965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.810115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.810400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.810690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.810804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.810896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.811130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.811386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.811626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.811758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.811879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.812161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.812445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.812690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.812796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.271 qpair failed and we were unable to recover it. 00:30:34.271 [2024-11-27 02:41:58.812937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.813015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.271 [2024-11-27 02:41:58.813058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.813184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.813473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.813711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.813845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.814007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.814318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.814639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.814872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.814989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.815106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.815354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.815617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.815845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.815952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.816068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.816339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.816555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.816778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.816918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.817028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.817280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.817587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.817757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.817900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.818214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.818530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.818777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.818920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.819021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.819340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.819630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.819879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.819988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.820098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.820268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.820296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.820442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.820579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.820605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.272 qpair failed and we were unable to recover it. 00:30:34.272 [2024-11-27 02:41:58.820724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.272 [2024-11-27 02:41:58.820812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.820839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.820966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.821220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.821444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.821723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.821885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.822014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.822290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.822589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.822815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.822978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.823088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.823315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.823571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.823849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.823989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.824077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.824305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.824536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.824766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.824958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.825123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.825398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.825660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.825865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.825983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.826094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.826319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.826548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.826776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.826878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.826965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.827219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.827477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.273 [2024-11-27 02:41:58.827712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.273 [2024-11-27 02:41:58.827916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.273 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.828053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.828341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.828582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.828862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.828996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.829136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.829368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.829618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.829761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.829914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.830205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.830483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.830724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.830835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.830925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.831175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.831434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.831764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.831904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.832000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.832293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.832581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.832796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.832953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.833073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.833263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.833544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.833832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.833971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.834092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.834374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.274 qpair failed and we were unable to recover it. 00:30:34.274 [2024-11-27 02:41:58.834588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.274 [2024-11-27 02:41:58.834733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.834821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.834953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.834982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.835101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.835350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.835627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.835913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.835999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.836107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.836365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.836604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.836767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.836915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.837240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.837517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.837748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.837860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.837941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.838214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.838460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.838684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.838821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.838936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.839245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.839483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.839753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.839893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.839978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.840264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.840540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.840755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.840921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.841077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.841362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.841594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.275 [2024-11-27 02:41:58.841841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.275 [2024-11-27 02:41:58.841977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.275 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.842097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.276 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.842412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.276 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.842712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.276 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.842917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.842997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.843022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.276 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.843111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.843220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.276 [2024-11-27 02:41:58.843246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.276 qpair failed and we were unable to recover it. 00:30:34.276 [2024-11-27 02:41:58.843339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-27 02:41:58.843462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-27 02:41:58.843487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-27 02:41:58.843588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-27 02:41:58.843696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-27 02:41:58.843721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-27 02:41:58.843819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.843905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.843931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.844060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.844300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.844495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.844791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.844910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.845002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.845232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.845426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.845663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.845859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.845996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.846112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.846309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.846598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.846760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.846889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.847139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.847478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.847701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.847909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.847999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.848168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.848420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.848624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.848872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.848985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.849110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.849387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.849625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.849769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.849883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.850007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.850032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.850146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.850229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.850256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-27 02:41:58.850352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-27 02:41:58.850434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.850459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.850582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.850665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.850690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.850781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.850920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.850945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.851032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.851326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.851544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.851775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.851890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.851983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.852249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.852503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.852805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.852921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.853012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.853268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.853538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.853801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.853950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.854040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.854327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.854604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.854783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.854910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.855434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.855737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.855920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.856021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.856276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.856514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.856780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.856938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.857084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.857345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.857637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-27 02:41:58.857748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-27 02:41:58.857834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.857925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.857951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.858042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.858295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.858607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.858859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.858977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.859110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.859367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.859668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.859801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.859886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.860149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.860376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.860587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.860837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.860951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.861091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.861343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.861545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.861793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.861899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.862040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.862267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.862499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.862708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.862840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.862966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.863273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.863542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.863876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.863958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.864195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.864480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-27 02:41:58.864768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-27 02:41:58.864877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.865041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.865272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.865583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.865864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.865979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.866116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.866413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.866653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.866772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.866888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.867155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.867405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.867670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.867811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.867892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.868109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.868323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.868579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.868835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.868978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.869065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.869301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.869611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.869841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.869960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.870078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.870300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.870521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.870750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.870852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.870988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.871197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.871480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.871753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.871870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-27 02:41:58.871979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-27 02:41:58.872077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.872233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.872551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.872807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.872943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.873059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.873280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.873537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.873762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.873896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.874038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.874253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.874533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.874784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.874949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.875090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.875377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.875627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.875879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.875994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.876121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.876377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.876618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.876846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.876989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.877080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.877401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.877706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.877855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.877981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.878104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.878133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-27 02:41:58.878229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.878326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-27 02:41:58.878354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.878506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.878626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.878653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.878746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.878866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.878892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.879006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.879264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.879510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.879780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.879944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.880059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.880338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.880647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.880767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.880933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.881157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.881389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.881661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.881883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.881994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.882111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.882418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.882706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.882894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.883038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.883324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.883540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.883755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.883863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.883955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.884154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.884388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.884669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.884834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.884974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.885198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-27 02:41:58.885391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-27 02:41:58.885541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.885694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.885799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.885825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.885941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.886221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.886515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.886777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.886911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.887062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.887364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.887637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.887855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.887975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.888095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.888361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.888568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.888821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.888961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.889048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.889307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.889581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.889736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.889893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.890156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.890430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.890640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.890866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.890978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.891069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.891311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.891621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.891855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.891997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-27 02:41:58.892108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.892194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-27 02:41:58.892217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.892330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.892435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.892463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.892586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.892712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.892740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.892866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.892984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.893149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.893379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.893662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.893803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.893900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.894191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.894448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.894758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.894887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.895014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.895246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.895482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.895833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.895985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.896147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.896375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.896618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.896876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.896978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.897060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.897281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.897555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.897842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.897984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.898128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.898468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.898728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.898895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.899047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.899310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.899567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-27 02:41:58.899876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-27 02:41:58.899988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.900110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.900357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.900647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.900779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.900888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.901139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.901338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.901542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.901745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.901947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.902035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.902287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.902515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.902762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.902869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.902956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.903217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.903442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.903706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.903824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.903954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.904166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.904407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.904663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.904906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.904987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.905128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.905386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.905626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.905766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.905908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.906178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.906422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.906668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-27 02:41:58.906783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-27 02:41:58.906898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.907116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.907372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.907630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.907809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.907924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.908170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.908418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.908690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.908795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.908909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.909157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.909408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.909626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.909851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.909957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.910069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.910296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.910503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.910821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.910957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.911052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.911277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.911498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.911746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.911856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.911947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.912263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.912496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-27 02:41:58.912755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-27 02:41:58.912882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.912976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.913244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.913468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.913723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.913839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.913929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.914251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.914503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.914766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.914928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.915018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.915295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.915564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.915818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.915972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.916134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.916355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.916620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.916816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.916957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.917041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.917299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.917568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.917824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.917968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.918123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.918378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.918656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.918798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.918877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.919119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.919345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.919625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.919806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.919918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.920006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.920031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-27 02:41:58.920144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.920257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-27 02:41:58.920283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.920400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.920507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.920540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.920653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.920798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.920823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.920917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.920996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.921186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.921479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.921719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.921844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.921937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.922188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.922448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.922651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.922796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.922905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.923137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.923362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.923599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.923783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.923898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.923985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.924220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.924502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.924850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.924977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.925097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.925316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.925554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.925725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.925882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.926137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.926367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.926599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.926833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.926979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.927095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.927173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-27 02:41:58.927200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-27 02:41:58.927309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.927533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.927736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.927865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.927964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.928232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.928452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.928697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.928841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.928959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.929147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.929359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.929634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.929855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.929995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.930115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.930352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.930608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.930813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.930931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.931148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.931343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.931590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.931811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.931982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.932074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.932304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.932506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.932745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.932897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.932990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.933249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.933518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.933784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.933921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.934007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.934094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-27 02:41:58.934120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-27 02:41:58.934236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.934548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.934797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.934967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.935083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.935304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.935573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.935805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.935965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.936081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.936304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.936620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.936792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.936911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.937152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.937376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.937619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.937758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.937882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.938170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.938480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.938719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.938870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.938970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.939202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.939427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.939670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.939800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.939901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.940184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.940383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-27 02:41:58.940666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-27 02:41:58.940755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.940779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.940897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.941205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.941491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.941734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.941847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.941960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.942199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.942448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.942712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.942848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.942975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.943180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.943435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.943785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.943922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.944054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.944299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.944499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.944792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.944927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.945042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.945278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.945554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.945808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.945943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.946068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.946306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.946559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.946780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.946933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.947054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.947318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.947552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-27 02:41:58.947787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-27 02:41:58.947906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.947986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.948305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.948566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.948798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.948940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.949047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.949339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.949603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.949829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.949941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.950058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.950309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.950533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.950760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.950872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.950973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.951277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.951559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.951799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.951921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.952044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.952258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.952491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.952798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.952964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.953056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.953341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.953628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.953787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.953919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.954187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.954415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.954702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.954814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.954941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.955030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.955056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-27 02:41:58.955167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-27 02:41:58.955283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.955309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.955449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.955559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.955586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.955673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.955791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.955817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.955902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.956183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.956443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.956721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.956832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.956950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.957210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.957505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.957789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.957940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.958040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.958303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.958560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.958781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.958890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.958986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.959242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.959449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.959708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.959827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.959939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.960160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.960425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.960662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.960827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.960944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.961263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.961590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.961819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.961997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.962123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.962245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.962274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.962380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.962502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-27 02:41:58.962537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-27 02:41:58.962640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.962769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.962796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.962915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.963170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.963446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.963712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.963850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.963958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.964207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.964469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.964737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.964878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.964960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.965162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.965421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.965664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.965831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.965944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.966168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.966431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.966703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.966852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.966959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.967260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.967467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.967787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.967926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.968016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.968211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.968412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.968682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.968881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.968997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.969102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.969398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-27 02:41:58.969668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-27 02:41:58.969806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.969901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.970150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.970353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.970683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.970788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.970900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.971177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.971408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.971729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.971869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.971989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.972244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.972534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.972789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.972893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.972983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.973204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.973446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.973693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.973868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.974010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.974279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.974562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.974819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.974957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.975045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.975299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.975573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.975837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.975948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-27 02:41:58.976033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.976141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-27 02:41:58.976166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.976284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.976479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.976706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.976826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.976917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.977150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.977381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.977629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.977833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.977977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.978094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.978342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.978575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.978774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.978882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.978969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.979231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.979551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.979782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.979923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.980043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.980342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.980634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.980828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.980971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.981089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.981335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.981633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.981867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.981977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.982137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.982379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.982642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.982851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.982987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-27 02:41:58.983130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-27 02:41:58.983225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.983374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.983635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.983856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.983968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.984085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.984302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.984571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.984786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.984949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.985056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.985312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.985637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.985849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.985967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.986094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.986326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.986582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.986793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.986898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.987007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.987264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.987496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.987745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.987857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.987977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.988194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.988421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.988648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.988792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.988912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.989241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.989534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.989810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.989947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-27 02:41:58.990118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-27 02:41:58.990269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.990298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.990387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.990515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.990554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.990659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.990750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.990776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.990895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.991170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.991431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.991696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.991810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.991907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.992162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.992425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.992697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.992821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.992962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.993220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.993451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.993682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.993898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.993982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.994086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.994313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.994537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.994766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.994933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.995023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.995257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.995480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.995691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.995862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.995972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.996228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.996423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.996714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-27 02:41:58.996905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.996985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-27 02:41:58.997012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.997159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.997421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.997638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.997837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.997938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.998041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.998262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.998485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.998717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.998888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.999006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.999256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.999532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:58.999761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:58.999896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.000004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.000233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.000455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.000747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.000855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.000940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.001159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.001386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.001666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.001884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.001979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.002112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.002340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.002640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.002811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.002925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.003011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-27 02:41:59.003038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-27 02:41:59.003152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.003412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.003700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.003814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.003932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.004158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.004350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.004556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.004782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.004926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.005019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.005242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.005457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.005740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.005875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.005982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.006206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.006479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.006758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.006906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.006986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.007269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.007518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.007752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.007864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.007986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.008252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.008546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.008847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.008981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.009114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.009363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.009645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.009775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.009903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.010034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.010065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-27 02:41:59.010166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-27 02:41:59.010248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.010274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.010418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.010544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.010574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.010706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.010832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.010860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.010953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.011215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.011495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.011732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.011840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.011958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.012185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.012429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.012648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.012898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.012985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.013129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.013357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.013603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.013865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.013984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.014105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.014361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.014597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.014857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.014984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.015096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.015348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.015596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.015856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.015962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.016074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.016318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.016573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.016839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.016962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.017096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.017208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.017234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-27 02:41:59.017354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-27 02:41:59.017496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.017521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.017615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.017732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.017775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.017917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.018176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.018411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.018636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.018746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.018891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.019176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.019437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.019648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.019881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.019974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.020133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.020384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.020585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.020814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.020977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.021119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.021348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.021617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.021752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.021917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.022216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.022562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.022808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.022935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.023060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.023353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.023639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.023789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.023930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.024126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.024315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-27 02:41:59.024567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-27 02:41:59.024746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.024862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.025171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.025462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.025669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.025783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.025878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.026216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.026494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.026826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.026972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.027093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.027320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.027586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.027813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.027924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.028041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.028293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.028565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.028825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.028966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.029092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.029346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.029604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.029891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.029977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.030181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.030404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.030691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.030796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.030915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.031180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.031458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.031683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.031886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.031988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-27 02:41:59.032103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-27 02:41:59.032216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.032326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.032572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.032831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.032943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.033060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.033313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.033514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.033771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.033882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.033965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.034182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.034441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.034657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.034827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.034939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.035162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.035473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.035754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.035900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.035995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.036273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.036554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.036795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.036928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.037047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.037289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.037533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.037759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-27 02:41:59.037876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-27 02:41:59.037967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.038197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.038429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.038664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.038803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.038917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.039142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.039381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.039653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.039914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.039996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.040134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.040335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.040531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.040739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.040909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.041055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.041255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.041501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.041778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.041908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.042028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.042262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.042515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.042775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.042898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.043056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.043310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.043510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.043770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.043888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.043989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.044257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.044548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-27 02:41:59.044738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-27 02:41:59.044864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.044984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.045262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.045538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.045840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.045998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.046156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.046390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.046617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.046752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.046905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.047156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.047428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.047714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.047881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.048031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.048333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.048595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.048862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.048989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.049133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.049429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.049706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.049909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.050003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.050258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.050513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.050855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.050989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.051073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.051370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.051662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.051775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.051941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.052195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.052455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-27 02:41:59.052668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-27 02:41:59.052762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.052788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.052912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.052998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.053149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.053411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.053680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.053814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.053926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.054207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.054495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.054740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.054902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.054990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.055262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.055561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.055789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.055929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.056022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.056262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.056578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.056808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.056917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.057032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.057319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.057651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.057775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.057879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.058149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.058476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.058743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.058856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.058979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.059233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.059565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.059715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.059849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.060004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.060029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-27 02:41:59.060181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2317e00 is same with the state(5) to be set 00:30:34.600 [2024-11-27 02:41:59.060380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.060520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-27 02:41:59.060565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.060666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.060813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.060840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.060935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.061218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.061439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.061711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.061825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.061934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.062172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.062382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.062622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.062837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.062973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.063063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.063262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.063482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.063748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.063860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.063967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.064186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.064470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.064816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.064997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.065168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.065395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.065642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.065784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.065906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.066168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.066387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.066623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.066829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.066968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.067087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.067198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.067225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.067345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.067430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.067456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-27 02:41:59.067571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-27 02:41:59.067680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.067707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.067795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.067911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.067937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.068054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.068283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.068463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.068664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.068846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.068996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.069107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.069367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.069608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.069836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.069951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.070031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.070250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.070495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.070800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.070933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.071042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.071352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.071608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.071813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.071947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.072039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.072377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.072617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.072840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.072952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.073065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.073178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.073204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.073293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.073402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-27 02:41:59.073429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-27 02:41:59.073558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.073650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.073678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.073776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.073883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.073909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.073996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.074333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.074608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.074812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.074918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.075052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.075343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.075642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.075780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.075913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.076194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.076418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.076654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.076807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.076922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.077220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.077463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.077784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.077922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.078034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.078266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.078462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.078671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.078812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.078943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.079187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.079417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.079669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.079782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.079906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.080192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.080413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-27 02:41:59.080681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-27 02:41:59.080818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.080898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.080984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.081097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.081509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.081737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.081873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.081989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.082278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.082554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.082781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.082929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.083070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.083335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.083570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.083823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.083960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.084079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.084320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.084535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.084775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.084893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.085253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.085510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.085773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.085926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.086031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.086302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.086574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.086865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.086982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.087064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.087318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.087622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.087794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-27 02:41:59.087876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-27 02:41:59.088031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.088217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.088522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.088776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.088938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.089091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.089360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.089599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.089803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.089954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.090087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.090343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.090551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.090840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.090953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.091047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.091352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.091635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.091734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.091895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.092191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.092471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.092706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.092859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.092956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.093202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.093429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.093709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.093877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.094017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.094237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.094530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.094760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.094902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.094999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.095117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.095145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-27 02:41:59.095273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.095406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-27 02:41:59.095434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.095565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.095697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.095723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.095805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.095944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.095988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.096151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.096453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.096677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.096917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.096998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.097167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.097456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.097748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.097875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.098010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.098199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.098451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.098676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.098819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.098907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.099138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.099446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.099661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.099873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.099987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.100096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.100358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.100679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.100821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.100944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.101170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.101395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.101691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-27 02:41:59.101858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-27 02:41:59.101996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.102229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.102492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.102734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.102870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.103006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.103250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.103432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.103711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.103923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.104044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.104348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.104610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.104859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.104968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.105086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.105287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.105606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.105773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.105874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.106129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.106395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.106632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.106833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.106935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.107125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.107377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.107606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.107833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.107934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.108017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.108233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.108454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.108702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.108827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.108928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.109027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-27 02:41:59.109055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-27 02:41:59.109163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.109461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.109717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.109852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.109965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.110156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.110361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.110657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.110825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.110989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.111251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.111632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.111887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.111990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.112115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.112393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.112663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.112899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.112986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.113131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.113424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.113741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.113945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.114062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.114262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.114522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.114791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.114953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.115084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.115343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.115541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.115759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.115876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.116013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.116289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-27 02:41:59.116473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-27 02:41:59.116620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.116737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.116891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.116923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.117032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.117282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.117507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.117813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.117951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.118082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.118298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.118601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.118859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.118984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.119102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.119355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.119651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.119792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.119886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.120195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.120472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.120726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.120838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.120948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.121229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.121505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.121824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.121929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.122009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.122215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.122480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.122796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.122935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.123028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.123236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.123437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.123702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.123831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-27 02:41:59.123946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.124027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-27 02:41:59.124052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.124146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.124409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.124677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.124798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.124954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.125321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.125565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.125817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.125969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.126130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.126440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.126677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.126821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.126916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.127205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.127471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.127730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.127878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.128019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.128241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.128522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.128787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.128916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.129012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.129258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.129539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.129734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.129872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-27 02:41:59.129991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-27 02:41:59.130142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.130175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.130306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.130448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.130473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.130598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.130747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.130772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.130890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.131173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.131439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.131678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.131827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.131979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.132213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.132487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.132733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.132903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.132990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.133276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.133566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.133807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.133964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.134325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.134553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.134777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.134964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.135069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.135305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.135572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.135792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.135906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.136016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.136104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-27 02:41:59.136129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-27 02:41:59.136239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.136536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.136742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.136923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.137021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.137258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.137509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.137784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.137940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.138035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.138308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.138523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.138805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.138944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.139077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.139292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.139552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.139748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.139925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.140015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.140336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.140575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.140798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.140962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.141102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.141294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.141583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.141806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-27 02:41:59.141968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-27 02:41:59.142095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.142401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.142676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.142814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.142950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.143255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.143511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.143810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.143935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.144022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.144316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.144539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.144783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.144903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.145010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.145314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.145643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.145842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.145950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.146069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.146334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.146609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.146824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.146968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.147092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.147358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.147562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.147759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.147904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.147992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.148286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.148543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.148760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-27 02:41:59.148896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-27 02:41:59.148970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.149274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.149530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.149722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.149859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.149947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.150255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.150483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.150677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.150869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.150989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.151073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.151326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.151583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.151837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.151963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.152090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.152289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.152506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.152855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.152997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.153080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.153389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.153664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.153838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.153942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.154191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.154498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.154748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.154882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-27 02:41:59.155008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.155130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-27 02:41:59.155157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.155329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.155553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.155860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.155984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.156068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.156335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.156581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.156867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.156999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.157138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.157394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.157685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.157806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.157925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.158171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.158423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.158671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.158812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.158896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.159154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.159374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.159613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.159848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.159989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.160128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.160357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.160608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.160746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.160888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.161152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.161453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.161729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.161872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.161976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.162175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.162446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-27 02:41:59.162713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-27 02:41:59.162794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.162819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.162934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.163187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.163457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.163697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.163852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.164015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.164257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.164520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.164774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.164915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.165028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.165301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.165556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.165832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.165976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.166151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.166393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.166599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.166835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.166973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.167059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.167370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-27 02:41:59.167659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-27 02:41:59.167814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.167929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.168182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.168385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.168680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.168849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.168970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.169310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.169601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.169827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.169968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.170053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.170272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.170515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.170738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.170872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.171012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.171239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.171468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-27 02:41:59.171658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-27 02:41:59.171771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.171801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.171893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.171981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.172098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.172382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.172663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.172785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.172905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.173216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.173503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.173768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.173936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.174190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.174476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.174714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.174845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.174959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.175196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.175451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.175753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.175894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.175996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.176244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.176532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.176737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.176853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.176969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.177249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.177505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.177737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.177872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.177978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.178273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.178488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.178801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.178940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.179045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.179293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.179571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.179786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.179914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.180040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.180154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.180182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-27 02:41:59.180286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-27 02:41:59.180375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.180400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.180507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.180591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.180616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.180725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.180834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.180859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.180966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.181190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.181449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.181708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.181810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.181922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.182208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.182578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.182832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.182976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.183058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.183363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.183567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.183789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.183895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.183980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.184191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.184421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.184656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.184780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.184912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.185223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.185514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.185768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.185874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.186012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.186297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.186582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.186720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.186905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.187144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.187351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.187628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.187890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.187976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.188091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.188320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-27 02:41:59.188607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-27 02:41:59.188751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.188859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.188950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.188978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.189104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.189448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.189705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.189850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.189942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.190250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.190462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.190717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.190903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.190989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.191149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.191356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.191639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.191838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.191991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.192102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.192323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.192518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.192852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.192979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.193127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.193406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.193660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.193797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.193947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.194208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.194413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.194711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.194829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.194956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.195283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.195510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.195774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.195918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.196005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.196231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.196512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.196817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.196995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.197021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.197128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.197243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.197268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-27 02:41:59.197378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-27 02:41:59.197465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.197490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.197581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.197664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.197690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.197840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.197951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.197976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.198087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.198325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.198609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.198873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.198989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.199170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.199471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.199721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.199864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.199947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.200217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.200431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.200702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.200846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.200992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.201245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.201477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.201724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.201830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.201929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.202270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.202512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.202770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.202938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.203044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.203303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.203510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.203736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.203898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.203987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.204182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.204395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-27 02:41:59.204653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-27 02:41:59.204793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.204880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.205141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.205362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.205612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.205847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.205953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.206070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.206330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.206562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.206780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.206922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.207055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.207266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.207536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.207728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.207840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.207946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.208217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.208427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.208676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.208842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.208957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.209190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.209681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.209817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.209890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.210184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.210393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.210604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.210845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.210959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.211104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.211329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.211608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.211784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.211898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.212017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.212208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.212510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-27 02:41:59.212715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-27 02:41:59.212843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.212871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.212965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.213213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.213478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.213718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.213859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.213971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.214239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.214479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.214779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.214894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.215041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.215282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.215504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.215739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.215882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.215995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.216290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.216518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.216709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.216816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.216901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.217116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.217343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.217561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.217764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.217880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.217977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.218249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.218437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.218691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.218857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.218977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.219185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.219388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.219622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.219815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.219974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.220077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.220328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.220648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-27 02:41:59.220789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-27 02:41:59.220900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.221180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.221430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.221674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.221820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.221938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.222180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.222374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.222673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.222775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.222907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.223136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.223404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.223684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.223788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.223919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.224181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.224408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.224623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.224824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.224968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.225098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.225352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.225633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.225831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.225934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.226026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.226220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.226497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.226707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.226836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.226966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.227223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.227507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.227737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.227876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.227960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.228256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.228484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.228771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.228945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-27 02:41:59.229070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.229151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-27 02:41:59.229176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.229292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.229538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.229751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.229872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.229966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.230224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.230489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.230745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.230851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.230935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.231133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.231382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.231623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.231880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.231984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.232114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.232316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.232519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.232719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.232858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.232969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.233175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.233377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.233581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.233804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.233964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.234065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.234295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.234574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.234764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.234881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.234998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.235279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.235532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.235734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.235858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-27 02:41:59.236010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.236120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-27 02:41:59.236145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.236256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.236466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.236691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.236828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.236969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.237222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.237480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.237727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.237869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.237962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.238211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.238436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.238657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.238857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.238981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.239089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.239306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.239570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.239765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.239921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.240044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.240342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.240542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.240783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.240923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.241004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.241227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.241413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.241656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.241850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.241967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.242057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.242319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.242569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.242795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.242926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.243012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.243201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.243445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.243727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.243859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-27 02:41:59.243967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.244052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-27 02:41:59.244080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.244213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.244464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.244680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.244842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.244933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.245222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.245447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.245694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.245804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.245894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.246166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.246445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.246687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.246842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.247012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.247253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.247481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.247699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.247808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.248568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.248683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.248709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.248828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.248947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.248982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.249123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.249382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.249662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.249770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.249903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.250180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.250375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.250661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.250906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.250995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.251192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.251439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.251767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.251905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.252017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.252245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.252596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.252871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.252996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.253024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.253125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.253246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.253274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-27 02:41:59.253366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.253485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-27 02:41:59.253513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.253636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.253730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.253756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.253874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.253957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.253981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.254130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.254398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.254682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.254847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.254932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.255170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.255415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.255738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.255890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.256007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.256300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.256567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.256798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.256931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.257031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.257292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.257530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.257724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.257842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.257956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.258247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.258481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.258746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.258867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.258999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.259252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.259470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.259709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.259840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.259977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.260222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.260478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.260706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.260816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.260922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.261190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.261439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.261681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.261803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-27 02:41:59.261937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-27 02:41:59.262044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.262177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.262433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.262685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.262823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.262940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.263195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.263450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.263727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.263845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.263927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.264184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.264383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.264644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.264759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.264884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.265113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.265389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.265650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.265782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.265910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.266124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.266379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.266629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.266885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.266995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.267110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.267367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.267615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.267828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.267978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.268067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.268382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.268690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.268846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.268971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.269112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.269142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.269260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.269371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.269399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-27 02:41:59.269505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-27 02:41:59.269609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.269635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.269720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.269825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.269851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.270001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.270271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.270475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.270693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.270802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.270940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.271208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.271426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.271724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.271871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.271987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.272200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.272454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.272707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.272841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.272967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.273257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.273585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.273829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.273963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.274100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.274354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.274603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.274807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.274922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.275019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.275223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.275482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.275681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.275792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.275895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.276192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.276389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.276609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.276869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.276975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.277065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.277280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.277554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-27 02:41:59.277666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-27 02:41:59.277755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.277830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.277871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.277967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.278295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.278492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.278747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.278924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.279081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.279285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.279475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.279687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.279873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.279982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.280098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.280356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.280556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.280775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.280975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.281094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.281295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.281551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.281741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.281915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.281987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.282092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.282358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.282597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.282731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.282887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.283184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.283486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.283751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.283915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.284057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.284262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.284554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.284830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.284947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.285082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.285330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.285563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.285810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-27 02:41:59.285945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-27 02:41:59.286032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.286253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.286496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.286699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.286813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.286902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.287153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.287433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.287662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.287867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.287979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.288091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.288293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.288480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.288700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.288864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.288992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.289195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.289453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.289711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.289852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.289988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.290317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.290571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.290855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.290997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.291089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.291327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.291551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.291877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.291997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.292110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.292397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.292635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.292872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.292986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.293107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.293415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.293679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.293820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.293905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.294038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.294067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-27 02:41:59.294165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.294260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-27 02:41:59.294304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.294387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.294494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.294520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.294615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.294693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.294718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.294837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.295135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.295373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.295650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.295768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.295884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.296124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.296427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.296815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.296922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.297183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.297430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.297659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.297777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.297907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.298132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.298337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.298597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.298821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.298932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.299044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.299315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.299551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.299751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.299856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.299950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.300207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.300450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.300726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.300873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.301004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.301219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.301462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-27 02:41:59.301759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-27 02:41:59.301843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.301868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.301948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.302190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.302443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.302678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.302893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.302995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.303132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.303355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.303611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.303802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.303941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.304043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.304258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.304505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.304742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.304877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.304975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.305200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.305411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.305711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.305849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.305936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.306215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.306395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.306663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.306863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.306994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.307101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.307359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.307601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.307799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.307926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.308062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.308333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.308608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.308853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.308954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.309054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.309287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.309557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-27 02:41:59.309672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-27 02:41:59.309813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.309908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.309941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.310031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.310296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.310565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.310791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.310943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.311053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.311249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.311464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.311697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.311839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.311992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.312231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.312522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.312777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.312951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.313047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.313288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.313546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.313780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.313891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.313998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.314213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.314473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.314766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.314915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.315022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.315305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.315626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.315800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.315936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.316167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.316417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.316657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.316781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.316940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.317154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.317384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.317681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.317796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.317931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.318070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.318094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.318170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.318299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-27 02:41:59.318327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-27 02:41:59.318454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.318563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.318605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.318752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.318841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.318866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.318974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.319208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.319423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.319670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.319797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.319919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.320147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.320436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.320698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.320835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.320926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.321126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.321312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.321529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.321746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.321872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.322010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.322219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.322442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.322675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.322859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.322962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.323045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.323287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.323522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.323716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.323831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.323920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.324116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.324330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.324639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.324881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.324989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.325133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.325376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.325633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.325796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-27 02:41:59.325932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.326033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-27 02:41:59.326058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.326174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.326465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.326684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.326889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.326996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.327110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.327349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.327629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.327828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.327955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.328104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.328339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.328616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.328811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.328974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.329087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.329394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.329636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.329840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.329978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.330089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.330343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.330635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.330871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.330983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.331069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.331266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.331594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.331732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.331867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.332154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.332458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.332689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.332812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.332929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.333250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.333468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-27 02:41:59.333689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-27 02:41:59.333799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.333877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.333962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.333993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.334083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.334331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.334625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.334833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.334950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.335088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.335441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.335700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.335809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.335959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.336178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.336468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.336748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.336895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.336982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.337299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.337516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.337835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.337942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.338056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.338180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.338205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.338286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.338368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.338393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.338537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.339464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.339724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.339924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.340046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.340242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.340479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.340836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.340962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.341272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.341584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.341814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.341919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.342026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.342236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.342508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.342739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.342855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.342971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.343064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.343088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-27 02:41:59.343182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.343259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-27 02:41:59.343284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.343397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.343481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.343506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.343623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.343735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.343779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.343905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.343982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.344091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.344351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.344614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.344860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.344975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.345124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.345347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.345539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.345761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.345883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.345992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.346243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.346467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.346742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.346889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.347000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.347234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.347452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.347662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.347798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.347981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.348283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.348493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.348742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.348844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.348961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.349223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.349576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.349829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.349968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.350071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.350368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.350661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.350847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.350961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.351102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.351394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-27 02:41:59.351635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-27 02:41:59.351750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.351877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.351962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.351991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.352119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.352308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.352535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.352754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.352856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.352937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.353245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.353513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.353784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.353944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.354033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.354259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.354513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.354820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.354992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.355078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.355355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.355674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.355885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.355995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.356094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.356334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.356598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.356814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.356971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.357093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.357375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.357569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.357827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.357953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.358061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.358288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.358537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.358750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.358879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.358990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.359116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.359144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-27 02:41:59.359261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-27 02:41:59.359364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.359389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.359507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.359606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.359632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.359742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.359848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.359891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.359997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.360204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.360437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.360765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.360926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.361066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.361285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.361551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.361819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.361935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.362049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.362291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.362508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.362789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.362927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.363046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.363313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.363542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.363767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.363905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.364012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.364206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.364478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.364743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.364863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.364952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.365205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.365490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.365727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.365836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.365937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.366161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.366377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.366654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.366801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.366892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.367160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.367411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-27 02:41:59.367600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-27 02:41:59.367685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.367709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.367792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.367893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.367918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.368001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.368248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.368462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.368677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.368790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.368903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.369145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.369451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.369687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.369887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.369995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.370109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.370305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.370623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.370826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.370932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.371032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.371263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.371561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.371852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.371966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.372085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.372327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.372577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.372766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.372928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.373093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.373348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.373613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.373846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.373953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.374090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.374359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.374636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.374826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.374961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.375126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.375415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.375725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.375833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-27 02:41:59.375912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-27 02:41:59.376004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.376139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.376490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.376746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.376892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.377040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.377337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.377573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.377827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.377992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.378105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.378299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.378535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.378787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.378957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.379095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.379301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.379615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.379755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.379929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.380200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.380531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.380810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.380977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.381117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.381371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.381686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.381846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.381976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.382274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.382517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.382753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.382868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.382975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.383200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.383450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.383662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.383805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.383925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.384179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.384425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.384629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-27 02:41:59.384766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-27 02:41:59.384851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.385178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.385423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.385740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.385903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.385991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.386280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.386500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.386812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.386965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.387084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.387378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.387632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.387772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.387927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.388195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.388494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.388784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.388899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.389017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.389267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.389551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.389831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.389963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.390152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.390462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.390733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.390841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.390957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.391220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.391522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.391765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.391898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.391983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.392207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.392436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.392696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.392824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-27 02:41:59.392941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.393078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-27 02:41:59.393107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.393270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.393506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.393748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.393910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.393994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.394258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.394514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.394795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.394909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.395027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.395315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.395581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.395834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.395984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.396106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.396413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.396672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.396898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.396983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.397129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.397391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.397634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.397808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.397941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.398187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.398370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.398629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.398737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.398870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.399163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.399450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.399652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.399794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.399933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.400186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.400443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.400720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.400854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.400975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.401274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.401521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-27 02:41:59.401798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-27 02:41:59.401938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.402073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.402289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.402549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.402767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.402902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.403004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.403358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.403610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.403808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.403947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.404052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.404338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.404608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.404805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.404914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.405050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.405321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.405575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.405827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.405949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.406052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.406274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.406511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.406763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.406871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.406975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.407197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.407428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.407708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.407810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.407947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.408226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.408450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.408681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.408787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.408929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.409184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.409476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.409708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.409820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.409946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.410071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.410099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-27 02:41:59.410198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.410291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-27 02:41:59.410320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.410421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.410510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.410582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.410700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.410808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.410853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.410973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.411253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.411520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.411731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.411865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.411988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.412327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.412606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.412803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.412964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.413103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.413351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.413583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.413792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.413920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.414013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.414290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.414571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.414776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.414884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.414993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.415266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.415507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.415731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.415845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.415967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.416221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.416445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.416703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.416893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.416986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.417164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.417485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.417740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.417894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.417995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.418256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.418520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-27 02:41:59.418748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-27 02:41:59.418841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.418868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.419020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.419340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.419572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.419794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.419944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.420097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.420318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.420630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.420793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.420936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.421174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.421437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.421645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.421766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.421909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.422144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.422398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.422594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.422863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.422995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.423079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.423308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.423589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.423749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.423883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.424167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.424387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.424641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.424762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.424888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.425150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.425395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.425588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.425790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.425899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.425992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.426090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.426120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.426229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.426345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.426373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-27 02:41:59.426507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-27 02:41:59.426598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.426624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.426711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.426841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.426869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.426951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.427179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.427498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.427732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.427871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.427997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.428263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.428582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.428823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.428982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.429080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.429306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.429564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.429811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.429983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.430078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.430327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.430630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.430838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.430940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.431069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.431330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.431595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.431799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.431899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.431985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.432320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.432581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.432801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.432933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.433029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.433321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.433576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.433846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.433955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.434091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.434350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.434644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.434888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.434985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-27 02:41:59.435013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-27 02:41:59.435137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.435376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.435631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.435857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.435992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.436091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.436372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.436658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.436813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.436937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.437174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.437377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.437687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.437803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.437970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.438256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.438459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.438693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.438805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.438940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.439269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.439567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.439770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.439889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.439977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.440186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.440395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.440650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.440894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.440976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.441165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.441414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.441693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.441819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.441946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.442175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.442398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.442637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.442832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.442990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.443105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.443225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.443253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.443352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.443459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-27 02:41:59.443485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-27 02:41:59.443594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.443683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.443708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.443806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.443904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.443932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.444031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.444274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.444561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.444760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.444935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.445028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.445324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.445623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.445862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.445985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.446146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.446346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.446643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.446894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.446979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.447090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.447337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.447544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.447729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.447843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.447924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.448121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.448363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.448670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.448880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.448993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.449068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.449268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.449519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.449725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.449840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.449925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.450198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.450417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.450710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.450842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.450972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.451244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-27 02:41:59.451553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-27 02:41:59.451674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.451783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.451861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.451886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.452046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.452267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.452556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.452761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.452930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.453054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.453387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.453637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.453739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.453890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.454137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.454403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.454736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.454907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.455011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.455282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.455538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.455811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.455982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.456121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.456392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.456660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.456806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.456907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.457155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.457383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.457703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.457915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.457996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.458124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.458347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.458637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.458785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.458924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.459146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.459346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-27 02:41:59.459570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-27 02:41:59.459668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.459773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.459898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.459926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.460013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.460275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.460460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.460721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.460882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.460995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.461224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.461508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.461748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.461891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.462005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.462248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.462478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.462690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.462882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.462994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.463105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.463319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.463515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.463727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.463853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.463954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.464215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.464462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.464660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.464803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.464921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.465153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.465403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.465617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.465811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.465942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.466029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.466255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.466512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.466747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.466885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.467000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.467078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.467103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.467190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.467282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.467308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-27 02:41:59.468069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-27 02:41:59.468170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.468197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.468317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.468410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.468435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.468558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.468673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.468698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.468843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.469159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.469493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.469704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.469856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.469961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.470215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.470495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.470771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.470954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.471067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.471314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.471562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.471819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.471952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.472093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.472370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.472620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.472823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.472963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.473088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.473314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.473508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.473797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.473932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.474017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.474232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.474540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.474768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.474876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.474969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.475231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.475506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.475750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.475927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.476007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.476227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.476489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-27 02:41:59.476734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-27 02:41:59.476829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.476854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.476963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.477213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.477469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.477715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.477864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.477953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.478222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.478499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.478746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.478874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.479006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.479232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.479453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.479659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.479769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.479958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.480174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.480422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.480653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.480888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.480993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.481098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.481333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.481636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.481832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.481964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.482094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.482310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.482573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.482815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.482921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.483052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.483354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.483550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.483805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.483975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.484065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.484293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.484555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-27 02:41:59.484781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-27 02:41:59.484892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.485001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.485260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.485553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.485778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.485917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.486010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.486295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.486539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.486772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.486909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.486994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.487260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.487491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.487720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.487872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.488004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.488194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.488445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.488672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.488808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.488891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.489157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.489440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.489715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.489894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.490032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.490264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.490495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.490710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.490833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.490998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.491248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.491436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.491762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.491899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.491991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.492238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-27 02:41:59.492517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-27 02:41:59.492643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.492769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.492858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.492887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.492978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.493263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.493481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.493782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.493919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.494037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.494269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.494493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.494732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.494842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.494966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.495232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.495423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.495658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.495821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.495907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.496110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.496344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.496537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-27 02:41:59.496780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-27 02:41:59.496919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.496945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.497081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.497442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.497704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.497824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.497981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.498269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.498533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.498758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.498903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.499035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.499297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.499564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.499788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.499939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.500064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.500328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.500584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.500811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.500925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.501043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.501266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.501520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.501810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.501922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.502041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.502130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.502155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-27 02:41:59.502348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.502434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-27 02:41:59.502461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.502623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.502738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.502764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.502876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.503167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.503449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.503693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.503805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.503935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.504209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.504506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.504713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.504828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.504919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.505163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.505410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.505649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.505790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.505916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.506166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.506405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.506722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.506833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.506953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.507211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.507403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.507660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-27 02:41:59.507777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-27 02:41:59.507880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.508143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.508363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.508578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.508806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.508941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.509074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.509169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.509194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.509300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.509408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.509434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.229 qpair failed and we were unable to recover it. 00:30:35.229 [2024-11-27 02:41:59.509530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.229 [2024-11-27 02:41:59.509619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.509645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.509725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.509845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.509875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.509955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.510153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.510414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.510698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.510843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.510926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.511174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.511373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.511620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.511816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.511977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.512061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.512361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.512672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.512779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.512876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.513168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.513458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.513741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.513844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.513929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.514153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.514400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.514685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.514841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.514956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.515142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.515358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.515624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.515815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.515928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.516041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.516191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.516216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.230 qpair failed and we were unable to recover it. 00:30:35.230 [2024-11-27 02:41:59.516292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.516407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.230 [2024-11-27 02:41:59.516431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.516547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.516639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.516664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.516786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.516901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.516926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.517064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.517298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.517511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.517775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.517948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.518090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.518373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.518592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.518824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.518991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.519103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.519332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.519551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.519799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.519929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.520014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.520235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.520485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.520678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.520782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.520938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.521195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.521415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.521676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.521844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.521920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.522125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.522372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.522597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.522784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.522910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.522991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.523078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.523103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.231 qpair failed and we were unable to recover it. 00:30:35.231 [2024-11-27 02:41:59.523209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.231 [2024-11-27 02:41:59.523323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.523350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.523563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.523589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.523706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.523792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.523819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.523915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.524143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.524408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.524658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.524788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.524888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.525116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.525373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.525650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.525778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.525913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.526162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.526416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.526660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.526798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.526899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.527163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.527385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.527657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.527881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.527994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.528114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.528313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.528575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.528781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.528894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.528980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.529179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.529428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.529664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.232 qpair failed and we were unable to recover it. 00:30:35.232 [2024-11-27 02:41:59.529915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.232 [2024-11-27 02:41:59.529997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.530138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.530365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.530599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.530852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.530988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.531106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.531304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.531535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.531734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.531880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.531962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.532205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.532439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.532678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.532899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.532984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.533107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.533339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.533583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.533783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.533899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.533989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.534250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.534474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.534808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.534902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.535156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.535374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.535595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.535803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.535948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.536058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.536149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.536181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.233 [2024-11-27 02:41:59.536320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.536460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.233 [2024-11-27 02:41:59.536486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.233 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.536605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.536688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.536716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.536829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.536913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.536940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.537057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.537260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.537471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.537727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.537854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.537978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.538242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.538466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.538705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.538840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.538953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.539153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.539449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.539708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.539825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.539940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.540167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.540414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.540681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.540878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.540993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.541133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.541366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.541604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.234 qpair failed and we were unable to recover it. 00:30:35.234 [2024-11-27 02:41:59.541839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.234 [2024-11-27 02:41:59.541947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.542058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.542279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.542495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.542698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.542893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.542976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.543115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.543338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.543579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.543776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.543887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.543971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.544201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.544430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.544634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.544821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.544956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.545043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.545246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.545464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.545707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.545830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.545941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.546167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.546391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.546608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.546852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.546991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.547102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.547329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.547562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.547765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.547905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.548020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.548106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.235 [2024-11-27 02:41:59.548132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.235 qpair failed and we were unable to recover it. 00:30:35.235 [2024-11-27 02:41:59.548240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.548508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.548802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.548951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.549050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.549275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.549535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.549816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.549924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.550040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.550243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.550495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.550757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.550857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.550968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.551250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.551451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.551681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.551909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.551985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.552095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.552279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.552513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.552784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.552898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.552984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.553204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.553457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.553676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.553873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.553983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.554102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.554324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.554576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.236 [2024-11-27 02:41:59.554789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.236 [2024-11-27 02:41:59.554976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.236 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.555097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.555323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.555555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.555819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.555921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.556008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.556238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.556469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.556682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.556881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.556999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.557090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.557346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.557574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.557821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.557960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.558075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.558352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.558599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.558799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.558914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.559059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.559275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.559467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.559702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.559811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.559927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.560175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.560405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.560624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.560845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.560983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.561088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.561198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.561224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.561360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.561475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.561500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.237 qpair failed and we were unable to recover it. 00:30:35.237 [2024-11-27 02:41:59.561602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.237 [2024-11-27 02:41:59.561716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.561743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.561827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.561942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.561973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.562062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.562292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.562573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.562799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.562943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.563025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.563253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.563540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.563763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.563929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.564054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.564258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.564496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.564751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.564869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.564951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.565152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.565390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.565640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.565903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.565987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.566099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.566297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.566516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.566772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.566920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.567034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.567272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.238 [2024-11-27 02:41:59.567469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.238 [2024-11-27 02:41:59.567618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.238 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.567704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.567785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.567810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.567894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.568145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.568372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.568613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.568855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.568999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.569107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.569342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.569602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.569839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.569994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.570114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.570347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.570606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.570866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.570970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.571048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.571282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.571547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.571771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.571890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.572008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.572227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.572483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.572712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.572841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.572957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.573186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.573447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.573646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.573756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.573864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.574001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.574026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.239 [2024-11-27 02:41:59.574112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.574188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.239 [2024-11-27 02:41:59.574212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.239 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.574330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.574587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.574802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.574917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.575024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.575241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.575461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.575709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.575825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.575934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.576147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.576363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.576557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.576784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.576926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.577007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.577309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.577589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.577822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.577968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.578080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.578277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.578522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.578772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.578884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.578965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.579225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.579469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.579741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.579857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.579972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.580228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.580487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.580750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.580864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.240 [2024-11-27 02:41:59.580943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.581060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.240 [2024-11-27 02:41:59.581085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.240 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.581206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.581459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.581659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.581846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.581985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.582097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.582323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.582529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.582718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.582831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.582922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.583172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.583402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.583657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.583763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.583874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.584155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.584366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.584637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.584867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.584981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.585134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.585341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.585556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.585783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.585919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.586035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.586316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.586513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.586704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.586854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.586969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.587187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.587471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.241 qpair failed and we were unable to recover it. 00:30:35.241 [2024-11-27 02:41:59.587716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.241 [2024-11-27 02:41:59.587823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.587940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.588171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.588390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.588652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.588871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.588982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.589071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.589316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.589568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.589794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.589901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.589985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.590230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.590730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.590864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.590978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.591189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.591410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.591639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.591859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.591964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.592079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.592330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.592561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.592781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.592916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.593028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.593258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.593458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.593682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.593883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.593993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.594110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.594201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.242 [2024-11-27 02:41:59.594225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.242 qpair failed and we were unable to recover it. 00:30:35.242 [2024-11-27 02:41:59.594334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.594553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.594801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.594914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.595027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.595224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.595423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.595644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.595828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.595965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.596049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.596265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.596515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.596700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.596810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.596925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.597174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.597371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.597567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.597789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.597898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.598007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.598192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.598440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.598701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.598832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.598942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.599174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.599397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.599692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.243 qpair failed and we were unable to recover it. 00:30:35.243 [2024-11-27 02:41:59.599895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.599977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.243 [2024-11-27 02:41:59.600001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.600085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.600310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.600541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.600741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.600872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.600956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.601179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.601402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.601617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.601864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.601983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.602097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.602338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.602588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.602813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.602923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.603033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.603290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.603517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.603745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.603857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.603943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.604183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.604419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.604684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.604817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.604909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.605160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.605404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.605674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.605892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.605976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.606001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.606094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.606178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.606204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.244 [2024-11-27 02:41:59.606287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.606399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.244 [2024-11-27 02:41:59.606425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.244 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.606538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.606629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.606654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.606762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.606904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.606929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.607070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.607287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.607506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.607740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.607880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.608019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.608245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.608457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.608695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.608832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.608951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.609238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.609456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.609709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.609815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.609897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.610120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.610304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.610512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.610786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.610925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.611012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.611267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.611535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.611721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.611836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.611950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.612178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.612399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.612595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.612792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.612929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.245 qpair failed and we were unable to recover it. 00:30:35.245 [2024-11-27 02:41:59.613024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.613162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.245 [2024-11-27 02:41:59.613187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.613269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.613494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.613748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.613860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.614139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.614371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.614606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.614840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.614999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.615123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.615369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.615634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.615835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.615974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.616065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.616314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.616571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.616789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.616928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.617056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.617247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.617475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.617738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.617869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.617979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.618200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.618400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.618672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.618827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.618967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.619187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.619441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.619671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.619786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.246 qpair failed and we were unable to recover it. 00:30:35.246 [2024-11-27 02:41:59.619891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.620006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.246 [2024-11-27 02:41:59.620033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.620118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.620313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.620557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.620829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.620949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.621029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.621218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.621437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.621692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.621875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.621984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.622151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.622352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.622553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.622738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.622878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.622998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.623217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.623442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.623699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.623815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.623923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.624136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.624349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.624573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.624838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.624950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.625026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.625224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.625459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.625697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.625910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.625992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.626017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.626122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.626234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.247 [2024-11-27 02:41:59.626258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.247 qpair failed and we were unable to recover it. 00:30:35.247 [2024-11-27 02:41:59.626400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.626657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.626880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.626992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.627132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.627408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.627652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.627882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.627996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.628165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.628423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.628624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.628849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.628993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.629081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.629315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.629547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.629769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.629883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.629975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.630175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.630392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.630683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.630889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.630979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.631085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.631268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.631493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.631723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.631828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.631943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.632033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.632057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.248 qpair failed and we were unable to recover it. 00:30:35.248 [2024-11-27 02:41:59.632171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.248 [2024-11-27 02:41:59.632285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.632398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.632627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.632855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.632967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.633057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.633278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.633487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.633724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.633832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.633924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.634171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.634398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.634681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.634833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.634921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.635184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.635462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.635690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.635875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.635981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.636121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.636345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.636597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.636818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.636935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.637029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.637269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.637481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.637675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.637812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.637896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.638146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.638398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.638623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-27 02:41:59.638834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-27 02:41:59.638940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.638966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.639078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.639303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.639539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.639822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.639957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.640037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.640258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.640482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.640710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.640861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.640973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.641230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.641535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.641751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.641861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.641956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.642155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.642392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.642648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.642869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.642978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.643118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.643343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.643588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.643822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.643931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.644040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.644292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.644521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.644732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.644866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.644979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.645240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.645464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-27 02:41:59.645688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-27 02:41:59.645772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.645795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.645905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.646153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.646405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.646645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.646787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.646879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.647159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.647406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.647646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.647837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.647974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.648064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.648247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.648438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.648678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.648811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.648896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.649126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.649343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.649550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.649766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.649929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.650038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.650237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.650433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.650693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.650894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.650981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.651089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.651327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.651585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.651805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.651965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.652044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.652159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-27 02:41:59.652183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-27 02:41:59.652296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.652529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.652724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.652864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.652942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.653154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.653380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.653647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.653881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.653992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.654132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.654323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.654545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.654798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.654942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.655029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.655225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.655451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.655655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.655884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.655991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.656132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.656368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.656586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.656785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.656921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.657009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.657252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.657454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.657685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.657799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.657910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.658006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-27 02:41:59.658031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-27 02:41:59.658151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.658375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.658645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.658787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.658872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.659156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.659428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.659688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.659803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.659915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.660123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.660367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.660602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.660861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.660978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.661122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.661355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.661568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.661824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.661984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.662064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.662254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.662478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.662693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.662833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.662949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.663201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.663396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.663586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.663803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.663916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.663996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.664214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.664481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.664716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-27 02:41:59.664880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-27 02:41:59.664997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.665218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.665454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.665666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.665878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.665980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.666122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.666349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.666549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.666767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.666867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.666977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.667175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.667400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.667636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.667886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.667976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.668093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.668343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.668541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.668781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.668914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.669004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.669277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.669536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.669741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.669878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.669974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.670170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.670373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.670612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.670837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.670946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.671062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.671145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.671171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.671257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.671371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-27 02:41:59.671396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-27 02:41:59.671480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.671569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.671594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.671713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.671819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.671843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.671927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.672175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.672410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.672616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.672864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.672995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.673074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.673318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.673560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.673759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.673897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.673980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.674197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.674385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.674625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.674848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.674981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.675064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.675280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.675467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.675694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.675858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.676005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.676222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.676471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.676675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.676820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.676902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.677133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.677365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.677600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.677859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-27 02:41:59.677973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-27 02:41:59.678090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.678312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.678595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.678788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.678920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.679049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.679311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.679566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.679820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.679929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.680040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.680233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.680448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.680680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.680793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.680881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.681155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.681381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.681610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.681812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.681920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.682035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.682303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.682521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.682779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.682943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.683028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.683222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.683463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.683708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.683867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.683951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.684234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.684462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-27 02:41:59.684692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-27 02:41:59.684837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.684953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.685219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.685413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.685617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.685875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.685989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.686125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.686349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.686575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.686791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.686894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.686982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.687210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.687434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.687661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.687854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.687995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.688138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.688363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.688597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.688810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.688922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.689045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.689266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.689483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.689721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.689828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.689917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.690165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.690478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-27 02:41:59.690717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-27 02:41:59.690831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.690856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.690970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.691196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.691379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.691617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.691867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.691991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.692109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.692311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.692593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.692789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.692892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.693035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.693252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.693478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.693735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.693876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.693961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.694193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.694412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.694640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.694867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.694984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.695061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.695254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.695534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.695738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.695845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.695959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.696191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.696413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.696643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.696843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.696956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-27 02:41:59.697068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.697172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-27 02:41:59.697198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.697310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.697556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.697810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.697922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.698038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.698265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.698505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.698756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.698893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.698974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.699163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.699354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.699583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.699776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.699916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.700028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.700280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.700518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.700791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.700891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.700971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.701212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.701415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.701652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.701892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.701977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.702117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.702345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.702570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.702796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.702922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.703009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.703258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.703489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-27 02:41:59.703727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-27 02:41:59.703863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.703975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.704226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.704443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.704699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.704837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.704958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.705166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.705387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.705651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.705867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.705977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.706079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.706309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.706538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.706749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.706887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.706977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.707170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.707375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.707632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.707846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.707957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.708095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.708310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.708509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.708753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.708894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.709014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.709252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.709720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.709865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.709984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.710209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-27 02:41:59.710430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-27 02:41:59.710571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.710680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.710791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.710814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.710900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.711120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.711399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.711677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.711901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.711975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.712088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.712337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.712553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.712799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.712935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.713077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.713318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.713543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.713772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.713884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.713973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.714276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.714544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.714804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.714909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.714993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.715247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.715492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.715722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.715836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.715946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.716135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.716390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-27 02:41:59.716620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-27 02:41:59.716723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.716747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.716836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.716940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.716965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.717076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.717282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.717502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.717730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.717838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.717941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.718169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.718398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.718658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.718792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.718901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.719171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.719393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.719600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.719806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.719921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.720009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.720236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.720455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.720716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.720825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.720939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.721156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.721402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.721595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.721847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.721987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.722108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.722328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.722565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.722753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.722863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.722957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.723066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-27 02:41:59.723091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-27 02:41:59.723206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.723455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.723675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.723785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.723927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.724179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.724402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.724653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.724899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.724989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.725106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.725317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.725570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.725776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.725888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.726027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.726235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.726487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.726720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.726856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.726968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.727193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.727466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.727710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.727817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.727899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.728174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.728449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.728755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.728892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.728995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.729254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.729488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.729750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.729881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.729970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.730051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-27 02:41:59.730075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-27 02:41:59.730159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.730388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.730669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.730809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.730919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.731149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.731404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.731669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.731906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.731995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.732162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.732360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.732628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.732849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.732992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.733078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.733334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.733539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.733794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.733934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.734045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.734300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.734547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.734770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.734875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.735016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.735241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.735482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.735701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.735808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.735930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.736234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.736463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.736689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.736801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.736919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.737034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-27 02:41:59.737058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-27 02:41:59.737166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.737392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.737610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.737858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.737968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.738085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.738313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.738537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.738750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.738859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.738940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.739190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.739433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.739650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.739874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.739978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.740117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.740341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.740592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.740865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.740971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.741055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.741238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.741508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.741739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.741837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.741944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.742222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.742434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.742657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.742908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.742987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.743127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.743381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.743644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-27 02:41:59.743744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-27 02:41:59.743832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.743967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.743991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.744108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.744334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.744560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.744756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.744860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.745004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.745252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.745431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.745674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.745892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.745997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.746119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.746372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.746598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.746810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.746943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.747085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.747285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.747498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.747805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.747907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.747994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.748248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.748478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.748704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.748833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.748922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.749140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.749358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-27 02:41:59.749607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-27 02:41:59.749693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.749718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.749801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.749916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.749939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.750029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.750255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.750466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.750722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.750830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.750942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.751147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.751362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.751603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.751856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.751992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.752161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.752392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.752681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.752815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.752931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.753113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.753389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.753646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.753852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.753992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.754130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.754345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.754570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.754795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.754963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.755080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.755355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.755581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.755802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.755933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.756048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.756127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.756151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.756268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.756387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.756411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-27 02:41:59.756519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-27 02:41:59.756639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.170365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.170715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.170846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.170873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.170991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.171228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.171433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.171661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.171768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.171895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.172156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.172408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.172629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.172835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.172982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.173115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.173430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.173669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.173865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.173981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.174097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.174328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.174587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.174849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.174986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.876 qpair failed and we were unable to recover it. 00:30:35.876 [2024-11-27 02:42:00.175100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.876 [2024-11-27 02:42:00.175217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.175364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.175598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.175805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.175954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.176043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.176274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.176512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.176762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.176884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.176972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.177170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.177383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.177605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.177810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.177918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.178032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.178312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.178522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.178775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.178927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.179020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.179220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.179447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.179691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.179836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.179961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.180195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.180421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.180641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.180881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.180996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.181133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.181395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.877 [2024-11-27 02:42:00.181631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.877 [2024-11-27 02:42:00.181740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.877 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.181826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.181906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.181930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.182054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.182285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.182504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.182766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.182901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.182996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.183214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.183412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.183651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.183852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.183958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.184100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.184297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.184501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.184721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.184836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.184911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.185132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.185375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.185613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.185809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.185933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.186053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.186368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.186577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.186804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.186952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.187030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.187259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.187494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.187770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.187892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.188021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.188105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.188129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.878 qpair failed and we were unable to recover it. 00:30:35.878 [2024-11-27 02:42:00.188219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.878 [2024-11-27 02:42:00.188312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.188337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.188428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.188610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.188636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.188726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.188813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.188839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.188963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.189275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.189563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.189784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.189908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.190023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.190258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.190494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.190733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.190850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.190978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.191250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.191556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.191788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.191927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.192041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.192318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.192504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.192750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.192895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.192990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.193251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.193496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.193722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.193903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.193981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.194124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.194401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.194659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.194768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.194878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.195001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.195031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.195175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.195365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.879 [2024-11-27 02:42:00.195390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.879 qpair failed and we were unable to recover it. 00:30:35.879 [2024-11-27 02:42:00.195475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.195572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.195597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.195714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.195902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.195927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.196068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.196295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.196622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.196786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.196907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.197126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.197370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.197642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.197895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.197979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.198116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.198333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.198555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.198794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.198897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.199006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.199231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.199470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.199714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.199821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.199937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.200120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.200329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.200522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.200862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.200990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.201015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.201134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.201209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.880 [2024-11-27 02:42:00.201234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.880 qpair failed and we were unable to recover it. 00:30:35.880 [2024-11-27 02:42:00.201356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.201598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.201814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.201939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.202051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.202260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.202481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.202773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.202941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.203083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.203388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.203692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.203803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.203922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.204118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.204345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.204638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.204860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.204966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.205082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.205300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.205534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.205783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.205924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.206046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.206306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.206582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.206841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.206978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.207145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.207376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.207644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.207784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.207925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.208184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.881 [2024-11-27 02:42:00.208435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.881 [2024-11-27 02:42:00.208562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.881 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.208679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.208764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.208788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.208871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.209154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.209424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.209659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.209871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.209982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.210071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.210283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.210469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.210711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.210814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.210902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.211159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.211402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.211673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.211879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.211993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.212081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.212279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.212536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.212763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.212899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.212986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.213217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.213413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.213628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.213811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.213920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.213999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.214215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.214432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.214650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.214759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.882 qpair failed and we were unable to recover it. 00:30:35.882 [2024-11-27 02:42:00.214904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.215018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.882 [2024-11-27 02:42:00.215043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.215146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.215364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.215575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.215818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.215929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.216010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.216203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.216425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.216673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.216873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.216980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.217061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.217290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.217484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.217686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.217884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.217995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.218092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.218344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.218556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.218791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.218905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.219017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.219265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.219455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.219677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.219890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.219980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.220225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.220468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.220715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.220911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.220994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.221018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.221120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.221307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.221332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.883 qpair failed and we were unable to recover it. 00:30:35.883 [2024-11-27 02:42:00.221409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.883 [2024-11-27 02:42:00.221522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.221553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.221635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.221776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.221801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.221925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.222251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.222480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.222712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.222850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.222935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.223159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.223383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.223591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.223791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.223931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.224017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.224231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.224447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.224699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.224867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.224955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.225197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.225383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.225622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.225853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.225961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.226051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.226294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.226552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.226780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.226919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.226999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.227234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.227417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.227629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.227818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.884 [2024-11-27 02:42:00.227952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.884 qpair failed and we were unable to recover it. 00:30:35.884 [2024-11-27 02:42:00.228027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.228248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.228440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.228641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.228887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.228985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.229091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.229312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.229723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.229863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.229939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.230154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.230378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.230677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.230857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.230962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.231052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.231285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.231502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.231729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.231838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.231944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.232153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.232369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.232580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.232841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.232954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.233064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.233312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.233492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.885 qpair failed and we were unable to recover it. 00:30:35.885 [2024-11-27 02:42:00.233769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.885 [2024-11-27 02:42:00.233882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.233906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.234018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.234267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.234486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.234764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.234884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.234989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.235206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.235420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.235688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.235889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.235995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.236107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.236335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.236564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.236797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.236931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.237050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.237275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.237532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.237750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.237893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.238032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.238292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.238572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.238764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.238913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.239017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.239217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.239438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.239631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.239845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.239936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.240178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.886 [2024-11-27 02:42:00.240393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.886 [2024-11-27 02:42:00.240606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.886 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.240693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.240865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.240890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.240981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.241458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.241737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.241862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.241953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.242184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.242416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.242677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.242881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.242993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.243100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.243326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.243556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.243769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.243908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.243996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.244349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.244614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.244834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.244947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.245056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.245278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.245535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.245813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.245917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.246035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.246307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.246537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.246768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.246925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.247013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.247203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.887 qpair failed and we were unable to recover it. 00:30:35.887 [2024-11-27 02:42:00.247421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.887 [2024-11-27 02:42:00.247637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.247748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.247885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.247910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.248015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.248208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.248437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.248677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.248816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.248930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.249172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.249424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.249620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.249848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.249962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.250080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.250305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.250531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.250723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.250866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.250979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.251197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.251460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.251687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.251827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.251919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.252143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.252439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.252661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.252799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.252911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.253184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.253409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.253629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.253852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.253992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.254017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.254099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.254173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.254198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.888 qpair failed and we were unable to recover it. 00:30:35.888 [2024-11-27 02:42:00.254314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.888 [2024-11-27 02:42:00.254425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.254449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.254556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.254657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.254682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.254764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.254881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.254906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.255008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.255266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.255459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.255658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.255768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.255915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.256139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.256428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.256656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.256888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.256979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.257090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.257315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.257567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.257777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.257889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.257979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.258233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.258466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.258679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.258821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.258938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.259158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.259445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.259641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.259864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.259962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.260042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.260285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.260561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.260792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.260928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.889 qpair failed and we were unable to recover it. 00:30:35.889 [2024-11-27 02:42:00.261022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.889 [2024-11-27 02:42:00.261102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.261212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.261467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.261701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.261835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.261957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.262230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.262424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.262647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.262874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.262986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.263093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.263308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.263561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.263768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.263879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.263967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.264215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.264462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.264659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.264884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.264997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.265109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.265296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.265533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.265747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.265884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.265996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.266240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.266432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.890 [2024-11-27 02:42:00.266691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.890 [2024-11-27 02:42:00.266799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.890 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.266887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.267123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.267346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.267562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.267788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.267905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.267996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.268214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.268469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.268687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.268821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.268914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.269188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.269454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.269686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.269914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.269994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.270102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.270326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.270583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.270810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.270946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.271035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.271334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.271746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.271876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.272001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.272233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.272461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.272703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.272818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.272937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.273193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.891 qpair failed and we were unable to recover it. 00:30:35.891 [2024-11-27 02:42:00.273472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.891 [2024-11-27 02:42:00.273589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.273684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.273796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.273822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.273963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.274190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.274402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.274666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.274807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.274927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.275145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.275378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.275612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.275835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.275975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.276093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.276339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.276556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.276772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.276876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.276993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.277246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.277497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.277731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.277841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.277934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.278153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.278388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.278599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.278812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.278938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.279026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.279287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.279552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.279804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.279912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.280052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.280193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.280218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.892 qpair failed and we were unable to recover it. 00:30:35.892 [2024-11-27 02:42:00.280301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.892 [2024-11-27 02:42:00.280380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.280404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.280654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.280679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.280793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.280901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.280926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.281033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.281256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.281456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.281656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.281803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.281933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.282153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.282407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.282682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.282795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.282933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.283133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.283323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.283551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.283754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.283886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.283992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.284263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.284480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.284696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.284843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.284964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.285153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.285354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.285613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.285803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.285921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.286037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.286262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.286505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.286773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.893 [2024-11-27 02:42:00.286901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.893 qpair failed and we were unable to recover it. 00:30:35.893 [2024-11-27 02:42:00.287027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.287243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.287507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.287757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.287912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.288031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.288251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.288507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.288718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.288859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.288967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.289232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.289468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.289707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.289841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.289952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.290170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.290412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.290655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.290862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.290979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.291120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.291352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.291631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.291902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.291998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.292167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.292397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.292603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.292835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.292948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.894 qpair failed and we were unable to recover it. 00:30:35.894 [2024-11-27 02:42:00.293036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.894 [2024-11-27 02:42:00.293183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.293292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.293557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.293790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.293937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.294026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.294213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.294497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.294710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.294849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.294963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.295194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.295393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.295649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.295876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.295982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.296071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.296331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.296538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.296768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.296884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.297003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.297261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.297533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.297747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.297863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.297943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.298194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.298423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.298679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.298823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.298911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.299143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.299393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.895 [2024-11-27 02:42:00.299600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.895 [2024-11-27 02:42:00.299708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.895 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.299791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.299880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.299906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.300029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.300253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.300506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.300719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.300889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.300976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.301223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.301453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.301714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.301814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.301923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.302134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.302326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.302540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.302784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.302925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.303045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.303266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.303529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.303762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.303931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.304014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.304242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.304457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.304649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.304861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.304967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.305064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.305289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.305545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.305777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.305940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.306025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.306139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.306165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.896 qpair failed and we were unable to recover it. 00:30:35.896 [2024-11-27 02:42:00.306248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.896 [2024-11-27 02:42:00.306328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.306353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.306492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.306587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.306613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.306734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.306817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.306842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.306955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.307211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.307433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.307671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.307905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.307989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.308092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.308401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.308619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.308828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.308967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.309083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.309302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.309519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.309759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.309895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.309980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.310250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.310501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.310718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.310886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.311001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.311219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.311475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.311726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.311864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.311942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.312053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.312079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.897 qpair failed and we were unable to recover it. 00:30:35.897 [2024-11-27 02:42:00.312167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.897 [2024-11-27 02:42:00.312307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.312333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.312444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.312548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.312579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.312710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.312797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.312824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.312944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.313191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.313469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.313695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.313834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.313945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.314174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.314404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.314626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.314847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.314956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.315053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.315269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.315474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.315758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.315896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.316016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.316275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.316488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.316731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.316855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.316972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.317200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.317405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.317704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.317822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.317934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.318185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.318414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.318698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.318807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.898 qpair failed and we were unable to recover it. 00:30:35.898 [2024-11-27 02:42:00.318925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.898 [2024-11-27 02:42:00.319027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.319168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.319430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.319673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.319781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.319928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.320186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.320462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.320687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.320797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.320915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.321194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.321434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.321641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.321781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.321924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.322183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.322442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.322671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.322795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.322914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.323163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.323363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.323618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.323854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.323968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.324059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.324244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.324471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.324695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.324811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.899 qpair failed and we were unable to recover it. 00:30:35.899 [2024-11-27 02:42:00.324897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.899 [2024-11-27 02:42:00.325012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.325150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.325391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.325619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.325815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.325947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.326026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.326274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.326506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.326752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.326886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.326969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.327199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.327445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.327654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.327837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.327972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.328083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.328317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.328535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.328779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.328884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.328966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.329184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.329384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.329622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.329861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.329994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.330148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.330398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.330620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.330886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.330999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.331114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.331196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.331222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.331337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.331455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.900 [2024-11-27 02:42:00.331482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.900 qpair failed and we were unable to recover it. 00:30:35.900 [2024-11-27 02:42:00.331597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.331737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.331762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.331922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.332132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.332353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.332584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.332822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.332962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.333048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.333243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.333517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.333763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.333898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.333983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.334203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.334423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.334707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.334812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.334926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.335150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.335383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.335610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.335853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.335983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.336064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.336307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.336561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.336789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.336899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.336988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.337209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.337434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.337658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.337770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.337916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.338023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.338048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-27 02:42:00.338161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.338277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-27 02:42:00.338302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.338414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.338536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.338567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.338684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.338795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.338820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.339164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.339378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.339639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.339841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.339980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.340063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.340292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.340551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.340732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.340838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.340929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.341177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.341403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.341659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.341874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.341976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.342069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.342321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.342546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.342735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.342872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.342963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.343176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.343384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.343620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.343860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.343993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.344100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.344318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.344542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-27 02:42:00.344744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-27 02:42:00.344857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.344882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.345003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.345233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.345431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.345668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.345873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.345985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.346059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.346258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.346508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.346730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.346866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.346950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.347167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.347354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.347586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.347782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.347917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.348040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.348247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.348427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.348652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.348789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.348908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.349160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.349414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.349635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.349889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.349986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.350125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.350357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.350613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-27 02:42:00.350837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-27 02:42:00.350938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.351032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.351259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.351474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.351706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.351812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.351896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.352118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.352348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.352590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.352796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.352904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.352981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.353196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.353439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.353648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.353848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.353977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.354088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.354317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.354504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.354767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.354911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.354998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.355603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.355806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.355915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.356055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.356255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.356488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.356695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.356835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-27 02:42:00.356924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-27 02:42:00.357038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.357155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.357381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.357625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.357817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.357947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.358056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.358242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.358439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.358652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.358887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.358976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.359112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.359302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.359518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.359777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.359905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.359987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.360234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.360430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.360638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.360838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.360974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.361092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.361279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.361531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.361756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.361872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.362017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.362288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.362512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.362718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.362859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.362940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.363031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.363056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-27 02:42:00.363130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.363216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-27 02:42:00.363241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.363356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.363588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.363815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.363932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.364043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.364284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.364487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.364726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.364839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.364922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.365149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.365378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.365610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.365901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.365983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.366110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.366318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.366578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.366838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.366950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.367040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.367231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.367471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.367700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.367850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.367932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.368180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.368371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.368649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.368787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.368901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.369162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.369379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.369602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-27 02:42:00.369804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-27 02:42:00.369910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.369995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.370219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.370405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.370654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.370853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.370974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.371069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.371322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.371554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.371751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.371873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.371957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.372203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.372431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.372637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.372866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.372986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.373081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.373322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.373531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.373723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.373832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.373923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.374148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.374326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.374538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.374761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.374888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.374965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.375182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.375381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.375622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.375839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.375965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-27 02:42:00.376041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-27 02:42:00.376127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.376244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.376423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.376629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.376808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.376957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.377048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.377262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.377443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.377685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.377837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.377921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.378174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.378371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.378589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.378771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.378908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.379000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.379225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.379417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.379668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.379891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.379974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.380117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.380342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.380543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.380731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.380845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.380933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.381128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-27 02:42:00.381346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-27 02:42:00.381487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.381614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.381704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.381729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.381812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.381932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.381957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.382031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.382522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.382789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.382935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.383025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.383249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.383500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.383703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.383859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.383969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.384153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.384390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.384621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.384823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.384972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.385083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.385342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.385590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.385789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.385890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.385997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.386244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.386431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.386662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.386889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.386994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.387102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.387355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.387573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.387767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.387936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-27 02:42:00.388050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-27 02:42:00.388155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.388269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.388521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.388733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.388858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.388938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.389134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.389367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.389622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.389851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.389957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.390073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.390262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.390514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.390741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.390855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.390949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.391177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.391387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.391624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.391883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.391969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.392115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.392337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.392625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.392823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.392933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.393021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.393239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.393459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.393666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.393778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.394107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.394301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-27 02:42:00.394407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-27 02:42:00.394496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.394592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.394618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.394733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.394846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.394870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.394956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.395246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.395498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.395743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.395844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.395958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.396202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.396413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.396621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.396859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.396975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.397094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.397288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.397500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.397744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.397881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.397976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.398196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.398459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.398685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.398824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.398912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.399176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.399427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.399674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.399888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.399975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.400115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.400331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.400531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.400708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.400854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-27 02:42:00.400935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.401024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-27 02:42:00.401049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.401147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.401365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.401580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.401772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.401870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.401980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.402257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.402480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.402754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.402870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.402954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.403202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.403435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.403653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.403878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.403984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.404077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.404310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.404569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.404792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.404916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.405027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.405245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.405444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.405675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.405881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.405991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.406080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.406317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.406579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.406809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.406946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.407068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.407291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-27 02:42:00.407478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-27 02:42:00.407628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.407716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.407804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.407830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.407943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.408176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.408416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.408672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.408889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.408978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.409114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.409349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.409561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.409782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.409926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.410036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.410282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.410582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.410787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.410905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.410993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.411431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.411627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.411820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.411928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.412016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.412210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.412416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.412627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.412825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.412962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-27 02:42:00.413069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.413150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-27 02:42:00.413175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.413293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.413530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.413731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.413828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.413924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.414189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.414394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.414643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.414750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.414893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.415152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.415385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.415577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.415826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.415934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.416045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.416266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.416459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.416658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.416795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.416916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.417134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.417333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.417564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.417766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.417915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.418036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.418265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.418472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.418693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.418880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.418983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.419074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.419189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.419214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.419303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.419401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.419426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-27 02:42:00.419535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-27 02:42:00.419623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.419648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.419736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.419887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.419912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.420021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.420273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.420472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.420726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.420851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.420966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.421149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.421428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.421640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.421778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.421911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.422129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.422379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.422590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.422809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.422954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.423092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.423284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.423549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.423772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.423912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.424019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.424233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.424496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.424697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.424816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.424962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.425213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.425689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.425843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.425960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.426471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.426695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-27 02:42:00.426806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-27 02:42:00.426909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.427169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.427375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.427582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.427782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.427896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.428015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.428322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.428555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.428781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.428902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.428978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.429216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.429450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.429684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.429814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.429934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.430129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.430329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.430561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.430786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.430896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.431010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.431223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.431434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.431647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.431833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.431947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.432095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.432307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.432556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.432788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.432906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.432996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.433114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.433141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-27 02:42:00.433266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.433385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-27 02:42:00.433410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.433509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.433606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.433632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.433776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.433863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.433897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.433977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.434207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.434399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.434634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.434860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.434973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.435117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.435206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.435231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.435315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.435398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.435424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.436170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.436450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.436672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.436817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.436932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.437183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.437415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.437645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.437851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.437998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.438087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.438296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.438504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.438730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.438883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.438971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.439161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.439387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.439623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-27 02:42:00.439847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-27 02:42:00.439955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.439980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.440093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.440286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.440577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.440682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.441373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.441548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.441576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.441718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.441821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.441846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.441943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.442164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.442401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.442630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.442800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.442916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.443135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.443366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.443605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.443824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.443967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.444081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.444308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.444552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.444791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.444940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.445026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.445242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.445433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.445643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.445873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.445996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.446106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.446306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.446599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.446834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.446978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-27 02:42:00.447062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.447145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-27 02:42:00.447170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.447260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.447540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.447761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.447906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.448026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.448231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.448439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.448656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.448866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.448979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.449097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.449350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.449626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.449833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.449961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.450061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.450262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.450466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.450707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.450823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.450954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.451228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.451482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.451778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.451898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.452002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.452232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.452429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.452651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.452790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.452924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.453180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.453414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-27 02:42:00.453706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-27 02:42:00.453790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.453816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.453861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2317e00 (9): Bad file descriptor 00:30:35.920 [2024-11-27 02:42:00.454019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.454321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.454557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.454763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.454903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.455016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.455232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.455431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.455680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.455795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.455893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.456146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.456404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.456617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.456874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.456994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.457113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.457328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.457549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.457801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.457927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.458043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.458297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.458493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.458765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.458879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.458972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.459228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.459460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.459722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.459829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.459917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.460119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.460316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.460516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-27 02:42:00.460723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-27 02:42:00.460826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.460949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.461209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.461412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.461628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.461873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.461990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.462069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.462286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.462553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.462765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.462874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.462987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.463199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.463447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.463643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.463858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.463973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.464120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.464341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.464544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.464744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.464887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.464972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.465171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.465440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.465681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.465807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.465908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.466133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.466380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.466636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.466842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.466948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.467036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.467249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.467440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-27 02:42:00.467653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-27 02:42:00.467784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-27 02:42:00.467878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-27 02:42:00.467998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-27 02:42:00.468023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:36.205 [2024-11-27 02:42:00.468136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.205 qpair failed and we were unable to recover it. 00:30:36.205 [2024-11-27 02:42:00.468329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.205 qpair failed and we were unable to recover it. 00:30:36.205 [2024-11-27 02:42:00.468538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.205 qpair failed and we were unable to recover it. 00:30:36.205 [2024-11-27 02:42:00.468726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.205 [2024-11-27 02:42:00.468834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.468970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.469245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.469514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.469735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.469882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.469995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.470204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.470397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.470618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.470822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.470943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.471058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.471265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.471460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.471685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.471794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.471884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.472159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.472363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.472566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.472767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.472905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.472994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.473221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.473429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.473657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.473884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.473996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.474111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.474342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.474543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.474759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.206 [2024-11-27 02:42:00.474883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.206 qpair failed and we were unable to recover it. 00:30:36.206 [2024-11-27 02:42:00.474994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.475182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.475413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.475683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.475797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.475883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.476128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.476366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.476608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.476814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.476971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.477061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.477252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.477464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.477699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.477807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.477956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.478172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.478364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.478590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.478793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.478939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.479023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.479230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.479466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.479675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.479877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.479977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.480089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.480337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.480538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.480790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.480902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.481028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.481116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.481142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.207 qpair failed and we were unable to recover it. 00:30:36.207 [2024-11-27 02:42:00.481263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.207 [2024-11-27 02:42:00.481385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.481411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.481498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.481585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.481612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.481697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.481817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.481843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.481926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.482160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.482351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.482557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.482779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.482888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.482973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.483180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.483411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.483638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.483847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.483986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.484097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.484328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.484515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.484708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.484909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.484991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.485129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.485327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.485547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.485754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.485870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.485984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.486205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.486379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.486599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.486872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.486992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.487017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.487109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.487201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 [2024-11-27 02:42:00.487226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.208 qpair failed and we were unable to recover it. 00:30:36.208 [2024-11-27 02:42:00.487336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.208 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2201983 Killed "${NVMF_APP[@]}" "$@" 00:30:36.208 [2024-11-27 02:42:00.487417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.487442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.487538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.487675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 02:42:00 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:36.209 [2024-11-27 02:42:00.487761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.487851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.487876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 02:42:00 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:36.209 [2024-11-27 02:42:00.487969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:36.209 [2024-11-27 02:42:00.488055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 02:42:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:36.209 [2024-11-27 02:42:00.488171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- common/autotest_common.sh@10 -- # set +x 00:30:36.209 [2024-11-27 02:42:00.488312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.488400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.488658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.488852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.488982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.489063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.489307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.489493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.489686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.489828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.489914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.490170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.490363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.490593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.490791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.490934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.491063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.491175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.491201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 02:42:00 -- nvmf/common.sh@469 -- # nvmfpid=2202719 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.491293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- nvmf/common.sh@470 -- # waitforlisten 2202719 00:30:36.209 02:42:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:36.209 [2024-11-27 02:42:00.491412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.491438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.491516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- common/autotest_common.sh@829 -- # '[' -z 2202719 ']' 00:30:36.209 [2024-11-27 02:42:00.491614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.491639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 02:42:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.491734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:36.209 [2024-11-27 02:42:00.491904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:36.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:36.209 [2024-11-27 02:42:00.491930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 02:42:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:36.209 [2024-11-27 02:42:00.492015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 02:42:00 -- common/autotest_common.sh@10 -- # set +x 00:30:36.209 [2024-11-27 02:42:00.492120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.492264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.492518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.492728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.492856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.209 qpair failed and we were unable to recover it. 00:30:36.209 [2024-11-27 02:42:00.492949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.209 [2024-11-27 02:42:00.493031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.493177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.493369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.493580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.493812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.493921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.494009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.494215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.494446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.494643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.494907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.494987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.495112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.495311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.495554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.495778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.495937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.496026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.496301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.496541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.496746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.496891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.496983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.497252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.497482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.497689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.497889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.497978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.498003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.210 [2024-11-27 02:42:00.498088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.498199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.210 [2024-11-27 02:42:00.498224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.210 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.498347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.498593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.498835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.498986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.499080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.499350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.499617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.499816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.499959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.500047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.500318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.500564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.500762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.500924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.501032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.501277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.501531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.501651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.501750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.502449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.502493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.502648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.502745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.502770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.502892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.503137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.503341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.503569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.503796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.503958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.504067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.504305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.504520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.504780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.504896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.504990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.505197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.505425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.211 qpair failed and we were unable to recover it. 00:30:36.211 [2024-11-27 02:42:00.505663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.211 [2024-11-27 02:42:00.505803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.505914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.505993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.506111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.506316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.506521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.506737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.506870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.506958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.507179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.507412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.507643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.507837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.507982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.508128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.508440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.508663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.508863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.508977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.509150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.509433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.509633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.509844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.509954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.510067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.510270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.510536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.510764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.510872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.510964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.511192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.511479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.511697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.511838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.511914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.512031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.512056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.512139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.512292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.512317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.212 qpair failed and we were unable to recover it. 00:30:36.212 [2024-11-27 02:42:00.512412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.212 [2024-11-27 02:42:00.512495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.512520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.512646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.512738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.512763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.512846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.512961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.512986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.513140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.513376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.513625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.513850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.513975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.514084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.514357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.514625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.514825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.514990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.515084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.515302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.515536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.515773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.515921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.516036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.516246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.516502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.516766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.516886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.516985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.517290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.517539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.517744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.517891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.518006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.518232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.518465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.518690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.518807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.518901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.519016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.519042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.519178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.519267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.213 [2024-11-27 02:42:00.519294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.213 qpair failed and we were unable to recover it. 00:30:36.213 [2024-11-27 02:42:00.519419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.519629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.519844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.519960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.520070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.520296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.520557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.520768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.520914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.520998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.521234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.521458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.521686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.521792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.521890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.522125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.522359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.522565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.522789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.522956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.523050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.523326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.523550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.523749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.523872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.523989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.524211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.524448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.524691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.524880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.524987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.525104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.525367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.525557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.214 [2024-11-27 02:42:00.525748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.214 [2024-11-27 02:42:00.525885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.214 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.525961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.526176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.526369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.526619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.526820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.526925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.527042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.527237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.527426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.527642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.527829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.527969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.528047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.528282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.528496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.528728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.528842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.528925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.529200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.529401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.529672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.529877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.529992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.530107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.530315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.530534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.530763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.530886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.530976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.531123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.531148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.531231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.531337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.531362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.215 qpair failed and we were unable to recover it. 00:30:36.215 [2024-11-27 02:42:00.531486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.215 [2024-11-27 02:42:00.531614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.531640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.531727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.531816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.531843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.531965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.532189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.532414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.532640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.532877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.532986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.533124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.533314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.533551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.533741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.533857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.533964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 [2024-11-27 02:42:00.534079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.534154] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:36.216 [2024-11-27 02:42:00.534214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.534414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.534683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.534795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.534916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.535222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.535457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.535675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.535793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.535901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.536144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.536398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.536614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.536848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.536961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.537047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.537254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.537503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.537734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.216 [2024-11-27 02:42:00.537850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.216 qpair failed and we were unable to recover it. 00:30:36.216 [2024-11-27 02:42:00.537935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.538193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.538391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.538589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.538795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.538908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.539003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.539239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.539463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.539719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.539915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.539996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.540109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.540368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.540595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.540782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.540892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.540973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.541225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.541471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.541771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.541896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.541983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.542199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.542420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.542684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.542802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.542918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.543122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.543421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.543658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.543893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.543996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.544118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.544202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.544226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.217 [2024-11-27 02:42:00.544388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.544504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.217 [2024-11-27 02:42:00.544537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.217 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.544631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.544736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.544761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.544853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.544933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.544958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.545051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.545279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.545490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.545718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.545841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.545954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.546149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.546379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.546620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.546851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.546962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.547051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.547280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.547503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.547737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.547849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.547958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.548168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.548388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.548621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.548824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.548945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.549054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.549335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.549538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.549805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.549953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.550084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.550278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.550552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.550767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.550934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.218 qpair failed and we were unable to recover it. 00:30:36.218 [2024-11-27 02:42:00.551041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.218 [2024-11-27 02:42:00.551131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.551243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.551475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.551712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.551908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.551995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.552135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.552361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.552602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.552837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.552936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.553028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.553248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.553486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.553726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.553870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.553958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.554226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.554455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.554669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.554799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.554919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.555129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.555354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.555601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.555839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.555990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.556082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.556313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.556557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.219 [2024-11-27 02:42:00.556787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.219 [2024-11-27 02:42:00.556925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.219 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.557017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.557223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.557447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.557676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.557820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.557914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.558140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.558361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.558611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.558846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.558952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.559041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.559286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.559519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.559724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.559840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.559963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.560192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.560452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.560692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.560840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.560961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.561169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.561438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.561698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.561817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.561943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.562179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.562416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.562678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.562902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.562993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.563114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.563317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.220 qpair failed and we were unable to recover it. 00:30:36.220 [2024-11-27 02:42:00.563510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.220 [2024-11-27 02:42:00.563680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.563705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.563790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.563877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.563905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.563980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.564196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.564412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.564635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.564864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.564973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.565062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.565337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.565563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.565782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.565893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.566008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.566212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.566415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.566657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.566844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.566958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.567052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.567277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.567537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.567730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.567856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.567964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.568157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.568378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.568612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.568845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.568978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.569068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.569299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.569531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.569757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.221 [2024-11-27 02:42:00.569896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.221 qpair failed and we were unable to recover it. 00:30:36.221 [2024-11-27 02:42:00.569987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.570190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.570401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.570684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.570793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.570895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.571126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.571331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.571540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.571767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.571917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.572005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.572201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.572398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.222 [2024-11-27 02:42:00.572487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.572617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.572761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.572887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.573141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.573377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.573645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.573751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.573895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.574119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.574331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.574592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.574792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.574908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.575022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.575223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.575518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.575753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.575880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.575971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.576062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.576090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.576190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.576272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.576298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.222 qpair failed and we were unable to recover it. 00:30:36.222 [2024-11-27 02:42:00.576387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.222 [2024-11-27 02:42:00.576487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.576513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.576618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.576712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.576738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.576861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.576943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.576969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.577097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.577329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.577585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.577853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.577996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.578123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.578330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.578564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.578787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.578921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.579046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.579267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.579529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.579761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.579882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.579967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.580183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.580662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.580912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.580997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.581108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.581364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.581581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.581787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.581917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.582010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.582230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.582460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.582667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.582885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.582974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.223 [2024-11-27 02:42:00.583000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.223 qpair failed and we were unable to recover it. 00:30:36.223 [2024-11-27 02:42:00.583116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.583343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.583555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.583807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.583921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.584014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.584228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.584425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.584636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.584880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.584998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.585087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.585284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.585491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.585744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.585864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.585958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.586184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.586407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.586690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.586898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.586981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.587120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.587354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.587595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.587805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.587943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.588058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.588276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.588488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.224 qpair failed and we were unable to recover it. 00:30:36.224 [2024-11-27 02:42:00.588717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.224 [2024-11-27 02:42:00.588801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.588835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.588922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.589190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.589439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.589667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.589905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.589991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.590111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.590337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.590537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.590767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.590885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.590985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.591189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.591436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.591638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.591862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.591970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.592047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.592244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.592426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.592636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.592847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.592981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.593120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.593346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.593549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.593774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.593897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.594010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.594221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.594489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.594698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.594813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.594921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.595003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.225 [2024-11-27 02:42:00.595030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.225 qpair failed and we were unable to recover it. 00:30:36.225 [2024-11-27 02:42:00.595127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.595332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.595612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.595811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.595976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.596059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.596253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.596501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.596704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.596826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.596912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.597115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.597336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.597572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.597789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.597894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.597980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.598188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.598418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.598656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.598861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.598980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.599089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.599314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.599493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.599710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.599826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.599912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.600167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.600378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.600581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.600808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.600926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.601006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.601118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.601149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.226 [2024-11-27 02:42:00.601240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.601321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.226 [2024-11-27 02:42:00.601346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.226 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.601427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.601635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.601828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.601971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.602090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.602314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.602535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.602729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.602836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.602928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.603184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.603450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.603669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.603889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.603991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.604080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.604294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.604528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.604712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.604827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.604912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.605135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.605311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.605573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.605774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.605880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.605965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.606159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.606352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.606559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.606744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.606883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.606964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.607201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.227 qpair failed and we were unable to recover it. 00:30:36.227 [2024-11-27 02:42:00.607416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.227 [2024-11-27 02:42:00.607563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.607652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.607744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.607769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.607885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.607972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.607997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.608102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.608334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.608520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.608750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.608869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.608984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.609199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.609454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.609663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.609785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.609901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.610236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.610416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.610644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.610864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.610988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.611072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.611345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.611565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.611783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.611888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:36.228 [2024-11-27 02:42:00.611911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.611995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.612193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.612421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.612643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.612845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.612987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.228 [2024-11-27 02:42:00.613083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.613197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.228 [2024-11-27 02:42:00.613222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.228 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.613316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.613551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.613780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.613916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.614006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.614263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.614515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.614759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.614911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.614990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.615239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.615458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.615715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.615836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.615912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.616134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.616353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.616602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.616815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.616934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.617032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.617240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.617460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.617720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.617834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.617932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.618198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.618405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.618658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.618806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.618890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.619137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.619400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.619638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.229 [2024-11-27 02:42:00.619778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.229 qpair failed and we were unable to recover it. 00:30:36.229 [2024-11-27 02:42:00.619870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.619985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.620099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.620301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.620567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.620844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.620956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.621074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.621305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.621539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.621754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.621878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.621992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.622207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.622452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.622728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.622839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.622952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.623138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.623333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.623569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.623765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.623887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.624006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.624238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.624446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.624671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.624891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.624983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.625125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.625338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.625588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.625786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.625945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.626055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.626147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.626174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-27 02:42:00.626263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.626395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-27 02:42:00.626424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.626513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.626685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.626710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.626807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.626923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.626948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.627036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.627236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.627453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.627684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.627892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.627997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.628079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.628316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.628535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.628741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.628857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.628944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.629202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.629428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.629705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.629808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.629929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.630179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.630386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.630619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.630814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.630927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.631007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.631264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.631452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.631714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.631825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.631942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.632150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.632407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.632610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-27 02:42:00.632713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-27 02:42:00.632796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.632909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.632935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.633022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.633246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.633465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.633661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.633892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.633996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.634086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.634294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.634487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.634727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.634845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.634936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.635198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.635440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.635679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.635801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.635887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.636116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.636321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.636518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.636908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.637021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.637238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.637432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.637661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.637781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.637915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.638115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.638307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.638567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.638769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.638886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-27 02:42:00.638980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.639089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-27 02:42:00.639114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.639201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.639460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.639665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.639898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.639989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.640102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.640332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.640590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.640785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.640955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.641077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.641303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.641519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.641735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.641852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.641968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.642165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.642365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.642575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.642760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.642902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.643015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.643245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.643498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.643721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.643835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.643949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.644144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.644377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.644680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-27 02:42:00.644866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-27 02:42:00.644946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.644972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.645057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.645327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.645542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.645757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.645893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.645987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.646177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.646388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.646607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.646864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.646996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.647121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.647331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.647568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.647767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.647924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.648033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.648288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.648519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.648723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.648864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.648946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.649168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.649423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.649627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.649851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.649961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.650046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.650275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.650470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.650708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.650823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.650914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.651053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.651078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-27 02:42:00.651175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.651263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-27 02:42:00.651290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.651434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.651670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.651875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.651987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.652092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.652283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.652514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.652720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.652859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.652947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.653149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.653344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.653565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.653779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.653915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.654037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.654235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.654476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.654691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.654858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.654932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.655152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.655381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.655596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.655791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.655908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.656004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.656199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.656400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.656654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.656841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.656949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.657046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.657328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-27 02:42:00.657561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-27 02:42:00.657702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.657787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.657870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.657896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.657975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.658191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.658442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.658674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.658871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.658981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.659093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.659310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.659517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.659723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.659859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.659956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.660154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.660370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.660634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.660864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.660966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.661075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.661296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.661515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.661742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.661843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.661934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.662162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.662378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.662625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.662881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.662977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.663085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.663367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.663575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.663795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.663902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-27 02:42:00.664009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-27 02:42:00.664115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.664229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.664432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.664641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.664879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.664999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.665085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.665313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.665563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.665745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.665859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.665973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.666218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.666434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.666659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.666773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.666895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.667125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.667355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.667661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.667887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.667977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.668111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.668317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.668538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.668764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.668862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.668943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.669130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.669360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.669631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.669824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.669934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.670022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.670100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.670127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-27 02:42:00.670216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.670325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-27 02:42:00.670350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.670443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.670559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.670586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.670732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.670850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.670876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.670957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.671201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.671446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.671646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.671881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.671989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.672110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.672337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.672559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.672784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.672923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.673006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.673227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.673447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.673714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.673834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.673924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.674133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.674365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.674589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.674817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.674958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.675038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.675283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.675491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.675706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.675854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.675963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.676050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-27 02:42:00.676075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-27 02:42:00.676187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.676415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.676659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.676795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.676913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.677109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.677343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.677548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.677804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.677950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.678071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.678301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.678505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.678708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.678857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.678973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.679237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.679474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.679744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.679850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.679945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.680178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.680413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.680620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.680832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.680947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.681154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.681411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.681683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.681900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.681982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.682089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.682297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.682500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-27 02:42:00.682741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-27 02:42:00.682907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.683025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.683308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.683513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.683773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.683935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.684026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.684137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.684162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.684284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.684403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.684430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.684544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.685217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.685429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.685713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.685838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.685959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.686187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.686444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.686725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.686835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.686922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.687191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.687398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.687600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.687790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.687940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.688017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.688212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.688417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.688626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.688861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.688968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.689082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.689287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.689511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.689719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-27 02:42:00.689836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-27 02:42:00.689952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.690211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.690418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.690690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.690827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.690956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.691171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.691369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.691637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.691878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.691994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.692106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.692296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.692509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.692806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.692935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.693023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.693251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.693472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.693708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.693858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.693942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.694157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.694384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.694628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.694767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.694885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.695146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.695387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.695592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.695800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.695949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.696076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.696272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-27 02:42:00.696496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-27 02:42:00.696642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.696727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.696869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.696895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.696982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.697214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.697439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.697679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.697903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.697985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.698137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.698381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.698588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.698806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.698944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.699030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.699249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.699460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.699701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.699862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.699978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.700171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.700394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.700624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.700817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.700954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.701071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.701270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.701515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.701724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.701840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.701949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.702041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.702066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-27 02:42:00.702152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.702240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-27 02:42:00.702265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.702349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.702461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.702487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.702620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.702727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.702752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.702870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.702979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.703118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.703320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.703516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.703770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.703877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.703958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.704237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.704488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.704724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.704888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.704977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.705174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.705409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.705638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.705835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.705951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.706030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.706241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.706436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.706674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.706880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.706998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.707077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.707272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.707517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.707774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.707904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.707993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.708273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.708480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-27 02:42:00.708706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-27 02:42:00.708781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.708806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.708901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.708982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.709120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.709322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.709533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.709781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.709884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.709962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.710255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.710440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.710673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.710782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.710894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.711140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.711372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.711592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.711859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.711976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.712106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.712361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712421] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:36.244 [2024-11-27 02:42:00.712450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.712568] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:36.244 [2024-11-27 02:42:00.712573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712590] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:36.244 [2024-11-27 02:42:00.712603] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:36.244 [2024-11-27 02:42:00.712655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.712673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:36.244 [2024-11-27 02:42:00.712776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:36.244 [2024-11-27 02:42:00.712752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:36.244 [2024-11-27 02:42:00.712755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:36.244 [2024-11-27 02:42:00.712864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.712893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.712990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.713194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.713395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.713611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.713813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.713926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.714011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.714206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-27 02:42:00.714427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-27 02:42:00.714540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.714626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.714705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.714730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.714821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.714897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.714922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.714996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.715170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.715359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.715575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.715793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.715926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.716010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.716232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.716445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.716647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.716855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.716969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.717054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.717255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.717491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.717709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.717818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.717909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.718120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.718295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.718496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.718702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.718812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.718906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.719137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.719358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.719552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.719770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.719924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.720016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.720104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.720130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.720212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.720295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.720320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-27 02:42:00.720408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-27 02:42:00.720512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.720543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.720628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.720711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.720737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.720833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.720916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.720942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.721030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.721229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.721429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.721648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.721856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.721989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.722112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.722345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.722546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.722753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.722870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.722960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.723159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.723388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.723596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.723794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.723914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.723996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.724191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.724412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.724628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.724836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.724965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.725058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.725285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.725483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.725693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.725881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.725986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.726095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.726372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.726600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-27 02:42:00.726797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-27 02:42:00.726915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.727028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.727221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.727435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.727671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.727878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.727984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.728128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.728318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.728556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.728754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.728874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.728959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.729185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.729419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.729638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.729879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.729997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.730114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.730340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.730540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.730770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.730877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.730972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.731195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.731387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.731591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.731808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.731909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.732009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.732230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.732449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.732649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-27 02:42:00.732766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-27 02:42:00.732857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.732954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.732980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.733071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.733274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.733471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.733730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.733830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.733918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.734121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.734353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.734597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.734828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.734971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.735062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.735251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.735473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.735666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.735890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.735984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.736091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.736317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.736516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.736742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.736857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.736957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.737199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.737384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.737652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.737845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.737959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.738050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.738258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.738456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.738716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.738903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.738983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.739008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.739120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.739228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.739258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.739344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.739419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-27 02:42:00.739445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-27 02:42:00.739539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.739620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.739647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.739735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.739827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.739853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.739945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.740138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.740353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.740547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.740763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.740883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.740963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.741180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.741393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.741593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.741790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.741908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.742003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.742221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.742436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.742667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.742894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.742975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.743087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.743323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.743564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.743752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.743856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.743955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.744172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.744369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.744581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.744774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.744882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.744969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.745160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.745343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.745570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.745829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.745944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.746030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.746145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.746171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-27 02:42:00.746254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.746344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-27 02:42:00.746370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.746455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.746582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.746609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.746725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.746814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.746840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.746925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.747129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.747320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.747513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.747726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.747836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.747916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.748116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.748338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.748534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.748739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.748854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.748948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.749177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.749400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.749624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.749829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.749937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.750052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.750241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.750420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.750627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.750825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.750973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.751056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.751300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.751568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.751769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.751882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.751976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.752202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.752397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.752619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.752824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.752934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.753023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.753142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.753168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.753260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.753341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-27 02:42:00.753368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-27 02:42:00.753452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.753579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.753607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.753688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.753797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.753823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.753908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.753988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.754098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.754295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.754515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.754721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.754833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.754928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.755125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.755345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.755532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.755752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.755875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.755955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.756206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.756465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.756698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.756902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.756983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.757093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.757342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.757537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.757741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.757861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.757949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.758141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.758393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-27 02:42:00.758592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-27 02:42:00.758697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.758779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.758917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.758944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.759040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.759240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.759437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.759671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.759898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.759979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.760088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.760311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.760521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.760724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.760841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.760926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.761182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.761395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.761641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.761788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.761907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.762200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.762440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.762660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.762872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.762982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.763070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.763265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.763485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.763726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.763830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.763911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.764023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.764049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-27 02:42:00.764180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.764255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-27 02:42:00.764281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.764367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.764607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.764821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.764936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.765055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.765249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.765443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.765670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.765889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.765992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.766098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.766301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.766545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.766752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.766875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.766954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.767139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.767363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.767587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.767851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.767973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.768061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.768255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.768476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.768694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.768883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.768989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.769068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.769249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.769444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.769687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.769886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.769996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.770101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.770347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.770550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.770767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.770870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.770951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.771071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.771096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-27 02:42:00.771176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.771266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-27 02:42:00.771291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.771375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.771581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.771807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.771918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.772033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.772252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.772435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.772657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.772885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.772994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.773078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.773328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.773576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.773773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.773879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.773959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.774177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.774395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.774586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.774808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.774951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.775046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.775245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.775430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.775620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.775809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.775941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.776048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.776271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.776494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.776726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.776917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.776997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.777105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.777290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.777520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.777724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.777825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.777914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.778023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.778048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.778130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.778216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-27 02:42:00.778243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-27 02:42:00.778362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.778445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.778470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.778612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.778713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.778742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.778853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.778981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.779103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.779306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.779544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.779741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.779909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.780030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.780274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.780470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.780675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.780865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.780972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.781090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.781319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.781512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.781779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.781884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.781961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.782170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.782368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.782614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.782840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.782954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.783070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.783268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.783466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.783699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.783818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.783929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.784112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.784337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-27 02:42:00.784541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-27 02:42:00.784660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.784750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.784831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.784857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.784968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.785214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.785412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.785649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.785877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.785987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.786100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.786294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.786512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.786729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.786894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.786976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.787174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.787436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.787686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.787917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.787997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.788103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.788330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.788609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.788800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.788941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.789030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.789250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.789484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.789716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.789839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.789920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.790131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.790342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.790560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.790757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.790905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.791018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.791215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.791420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.791637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.791860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-27 02:42:00.791966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-27 02:42:00.792048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.792246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.792492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.792705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.792915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.792994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.793131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.793321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.793556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.793776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.793918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.794004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.794229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.794444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.794674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.794870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.794981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.795060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.795309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.795504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.795761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.795897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.795983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.796166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.796370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.796603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.796787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.796950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.797035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.797284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.797479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.797673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.797871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.797981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.798100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.798280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.798466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.798699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.798810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.798921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.799010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.799036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-27 02:42:00.799120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-27 02:42:00.799229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.799367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.799608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.799805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.799922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.800002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.800214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.800423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.800630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.800828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.800963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.801050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.801270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.801516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.801755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.801904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.801987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.802185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.802435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.802670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.802863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.802979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.803123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.803316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.803540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.803763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.803873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.803957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.804211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.804448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.804694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.804812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.804903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.805113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.805295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.805529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.805739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.805847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.805986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.806068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.806093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.806214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.806305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.806330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.258 qpair failed and we were unable to recover it. 00:30:36.258 [2024-11-27 02:42:00.806443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.258 [2024-11-27 02:42:00.806537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.806577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.806691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.806769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.806794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.806933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.807128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.807353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.807550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.807784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.807901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.807978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.808171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.808391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.808619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.808808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.808937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.809047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.809235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.809459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.809687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.809907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.809986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.810089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.810302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.810576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.810771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.810885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.811009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.811240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.811429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.811638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.811864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.811974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.812055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.812322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.812540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.812732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.259 [2024-11-27 02:42:00.812833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.259 qpair failed and we were unable to recover it. 00:30:36.259 [2024-11-27 02:42:00.812945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.813128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.813326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.813560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.813777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.813890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.814035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.814227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.814421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.260 qpair failed and we were unable to recover it. 00:30:36.260 [2024-11-27 02:42:00.814658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.260 [2024-11-27 02:42:00.814737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.814762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.814845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.814966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.814991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.815079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.815292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.815533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.815788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.815959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.816065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.816309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.816599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.529 qpair failed and we were unable to recover it. 00:30:36.529 [2024-11-27 02:42:00.816848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.529 [2024-11-27 02:42:00.816951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.816980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.817098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.817287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.817514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.817724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.817825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.817936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.818163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.818379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.818567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.818817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.818926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.819010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.819198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.819431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.819675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.819882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.819993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.820126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.820388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.820608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.820798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.820907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.821021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.821221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.821412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.821637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.821865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.821965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.822054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.822273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.822483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.822681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.822903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.822989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.823101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.823307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.823543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.823768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.823905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.823997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.824216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.824441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.824649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.824843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.824947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.825028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.825257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.825451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.825678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.825900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.825976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.826089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.826308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.530 qpair failed and we were unable to recover it. 00:30:36.530 [2024-11-27 02:42:00.826516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.530 [2024-11-27 02:42:00.826684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.826711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.826819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.826898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.826923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.827039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.827225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.827426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.827621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.827845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.827944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.828020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.828206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.828390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.828616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.828861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.828966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.829050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.829265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.829453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.829681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.829906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.829996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.830101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.830282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.830498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.830708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.830917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.830993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.831097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.831315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.831539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.831762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.831907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.832003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.832221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.832414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.832616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.832817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.832926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.833011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.833263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.833447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.833642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.833843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.833952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.834038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.834232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.834443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.834666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.834888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.834992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.835106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.835287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.835504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.835707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.531 qpair failed and we were unable to recover it. 00:30:36.531 [2024-11-27 02:42:00.835916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.835995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.531 [2024-11-27 02:42:00.836021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.836148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.836333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.836530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.836734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.836855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.836950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.837195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.837395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.837619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.837834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.837943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.838031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.838245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.838462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.838661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.838872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.838980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.839062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.839285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.839474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.839669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.839857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.839974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.840077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.840263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.840450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.840657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.840846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.840979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.841073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.841272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.841496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.841726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.841885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.841977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.842220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.842416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.842657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.842901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.842979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.843088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.843330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.843575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.843794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.843907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.843985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.844167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.844362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.532 qpair failed and we were unable to recover it. 00:30:36.532 [2024-11-27 02:42:00.844641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.532 [2024-11-27 02:42:00.844740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.844768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.844895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.844981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.845155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.845354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.845541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.845725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.845831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.845919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.846179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.846403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.846634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.846826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.846937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.847021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.847233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.847410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.847605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.847830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.847964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.848042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.848223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.848436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.848653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.848831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.848966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.849046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.849230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.849444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.849636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.849834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.849945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.850028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.850217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.850439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.850659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.850874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.850982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.851071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.851267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.851497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.851714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.851844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.851956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.852148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.852336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.852531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.852777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.852888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.852999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.853212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.853404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.853615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.853797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.853944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.533 qpair failed and we were unable to recover it. 00:30:36.533 [2024-11-27 02:42:00.854056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.854136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.533 [2024-11-27 02:42:00.854163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.854278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.854479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.854692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.854800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.854909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.855124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.855346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.855535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.855750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.855886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.855994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.856206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.856394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.856695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.856923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.856999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.857135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.857320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.857530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.857787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.857895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.857977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.858164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.858356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.858588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.858812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.858968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.859045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.859239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.859456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.859649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.859836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.859945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.860028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.860209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.860406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.860634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.860820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.860955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.861066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.861292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.861521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.861746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.861884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.861997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.862231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.862459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.862659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.862898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.862977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.863090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.863279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.863470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.863673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.534 [2024-11-27 02:42:00.863907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.863985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.534 [2024-11-27 02:42:00.864011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.534 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.864128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.864316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.864546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.864792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.864932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.865017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.865243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.865486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.865680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.865827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.865941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.866135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.866329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.866516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.866741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.866852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.866936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.867160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.867371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.867595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.867788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.867918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.868001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.868191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.868433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.868632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.868844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.868947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.869060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.869317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.869515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.869729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.869835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.869916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.870148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.870340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.870602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.870811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.870950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.871042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.871251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.871474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.871669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.871865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.871974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.872058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.872277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.872453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.872689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.872811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.872896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.873132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.535 [2024-11-27 02:42:00.873336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.535 [2024-11-27 02:42:00.873482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.535 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.873637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.873719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.873744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.873850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.873968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.873994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.874073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.874295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.874513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.874714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.874836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.874916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.875199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.875389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.875634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.875851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.875957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.876045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.876275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.876504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.876720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.876842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.876962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.877163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.877381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.877598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.877803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.877921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.878032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.878231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.878423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.878657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.878905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.878989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.879095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.879325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.879562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.879800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.879912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.879992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.880242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.880426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.880643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.880893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.880979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.881088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.881306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.881516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.881735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.881880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.881963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.882205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.882410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.882619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.882809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.882947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.883029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.883246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.883459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.883649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.536 qpair failed and we were unable to recover it. 00:30:36.536 [2024-11-27 02:42:00.883821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.536 [2024-11-27 02:42:00.883897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.883922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.883996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.884171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.884371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.884597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.884794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.884937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.885023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.885223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.885416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.885625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.885844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.885959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.886041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.886231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.886452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.886648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.886868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.886985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.887098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.887352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.887557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.887762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.887873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.887963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.888157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.888375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.888584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.888772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.888908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.888999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.889194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.889387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.889575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.889772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.889877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.889965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.890173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.890376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.890614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.890839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.890946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.891065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.891252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.891441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.891632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.891866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.891978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.892063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.892298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.892495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.892726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.892892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.892979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.893213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.893393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.893637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.893861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.893971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.537 qpair failed and we were unable to recover it. 00:30:36.537 [2024-11-27 02:42:00.894056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.894133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.537 [2024-11-27 02:42:00.894159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.894245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.894439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.894665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.894866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.894973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.895057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.895262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.895499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.895732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.895851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.895939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.896158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.896487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.896830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.896933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.897017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.897217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.897400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.897670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.897892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.897975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.898128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.898378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.898574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.898770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.898879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.898991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.899181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.899387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.899604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.899818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.899957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.900035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.900225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.900463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.900652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.900878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.900989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.901095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.901317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.901509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.901735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.901840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.901916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.902113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.902333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.902550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.902745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.902886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.902995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.903211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.903430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.903651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.903789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.903919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.904043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.904071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.538 qpair failed and we were unable to recover it. 00:30:36.538 [2024-11-27 02:42:00.904201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.538 [2024-11-27 02:42:00.904284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.904401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.904606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.904830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.904944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.905032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.905297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.905536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.905732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.905836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.905963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.906158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.906380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.906623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.906835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.906971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.907051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.907243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.907425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.907638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.907856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.907991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.908085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.908277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.908457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.908658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.908872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.908988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.909120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.909302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.909482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.909696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.909892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.909975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.910116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.910316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.910502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.910699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.910884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.910998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.911079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.911271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.911458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.911645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.911829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.911935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.912011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.912228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.912417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.912619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.912812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.912950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.913038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.913257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.913456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.913663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.913877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.913991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.914072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.914281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-27 02:42:00.914454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-27 02:42:00.914561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.914673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.914750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.914776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.914861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.914937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.914962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.915067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.915263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.915479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.915682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.915804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.915878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.916126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.916349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.916551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.916777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.916887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.916970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.917154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.917368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.917595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.917870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.917981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.918071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.918291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.918484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.918712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.918852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.918960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.919176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.919358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.919601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.919824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.919970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.920055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.920237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.920420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.920639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.920848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.920961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.921053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.921297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.921491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.921695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.921915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.921996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.922109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.922331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.922516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.922741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.922865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.922944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.923138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.923357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.923563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.923774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.923887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.923969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.924055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.924081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.924167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.924243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.924269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-27 02:42:00.924377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-27 02:42:00.924455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.924480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.924615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.924696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.924721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.924819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.924927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.924953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.925037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.925223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.925430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.925657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.925874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.925999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.926102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.926321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.926521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.926761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.926868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.926978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.927197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.927419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.927650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.927839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.927938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.928924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.928999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.929231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.929425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.929619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.929820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.929956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.930069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.930277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.930472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.930680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.930880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.930990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.931129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.931318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.931545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.931731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.931874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.931952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.932170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.932368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.932566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.932793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.932896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.932973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.933176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.933388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.933611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.933806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.933951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.934915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-27 02:42:00.934994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.935079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-27 02:42:00.935104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.935181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.935377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.935621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.935811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.935912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.936873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.936945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.937164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.937399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.937621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.937816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.937927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.938042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.938264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.938493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.938737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.938846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.938925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.939111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.939326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.939508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.939704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.939891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.939977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.940087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.940326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.940522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.940730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.940833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.940917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.941186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.941370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.941555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.941753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.941853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.941940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.942117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.942359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.942552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.942748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.942847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.942960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.943150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.943366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.943564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.943772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.943905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.943979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.944229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.944413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.944623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.944812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.944913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.945002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.945204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.945395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.945624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-27 02:42:00.945819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-27 02:42:00.945927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.945952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.946043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.946226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.946433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.946712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.946874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.946963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.947168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.947368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.947577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.947782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.947889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.948006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.948274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.948499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.948734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.948834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.948923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.949128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.949317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.949566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.949751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.949915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.949995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.950233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.950424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.950643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.950862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.950977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.951084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.951268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.951458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.951662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.951842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.951949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.952023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.952240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.952457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.952712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.952832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.952915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.953113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.953383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.953612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.953837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.953942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.954044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.954236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.954461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.954664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.954868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.954983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.955090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.955369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.955562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.955761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.955863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.955979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.956201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-27 02:42:00.956389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-27 02:42:00.956502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.956622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.956700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.956734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.956816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.956908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.956935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.957079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.957297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.957493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.957728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.957867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.957949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.958148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.958349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.958547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.958772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.958911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.958997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.959214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.959431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.959621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.959851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.959961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.960051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.960261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.960451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.960675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.960811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.960925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.961158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.961348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.961575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.961795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.961904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.962018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.962212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.962402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.962617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.962804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.962942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.963028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.963224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.963422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.963635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.963831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.963968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.964075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.964267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.964531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.964756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.964865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.964948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.965170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.965365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.965555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.965739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.965900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.965993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.966209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.966400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.966598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.966815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.966924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.967002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.967198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.967416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.967619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.967825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.967936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-27 02:42:00.968047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-27 02:42:00.968188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.968296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.968487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.968689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.968891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.968975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.969084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.969298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.969510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.969707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.969811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.969899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.970148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.970369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.970600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.970829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.970939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.971016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.971203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.971419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.971658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.971871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.971979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.972089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.972335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.972562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.972784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.972892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.972978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.973219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.973400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.973604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.973825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.973964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.974074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.974290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.974553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.974749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.974854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.974962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.975185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.975407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.975606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.975797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.975933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.976013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.976204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.976393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.976604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.976828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.976967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.977045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.977300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.977484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.977720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.977916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.977997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.978135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.978340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.978554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.978789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.978892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.978976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.979049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-27 02:42:00.979074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-27 02:42:00.979163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.979393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.979638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.979830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.979938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.980016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.980214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.980424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.980623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.980813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.980924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.981003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.981199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.981407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.981643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.981869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.981977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.982068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.982287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.982471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.982674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.982780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.982919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.983108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.983335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.983565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.983797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.983905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.984016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.984233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.984428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.984638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.984824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.984932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.985031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.985263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.985458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.985652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.985850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.985961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.986042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.986240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.986531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.986734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.986847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.986925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.987108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.987328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.987533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.987756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.987859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.987966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.988215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.988443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.988671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.988883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.988999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.989072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.989274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.989458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.989663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.989887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.989993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.990075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.990297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-27 02:42:00.990496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-27 02:42:00.990634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.990717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.990825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.990851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.990932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.991121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.991341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.991599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.991825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.991934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.992017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.992229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.992449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.992667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.992859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.992961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.993048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.993314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.993562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.993750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.993852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.993945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.994132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.994314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.994492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.994717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.994907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.994992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.995130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.995318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.995507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.995695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.995911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.995999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.996105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.996290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.996498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.996710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.996889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.996996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.997110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.997314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.997541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.997729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.997841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.997981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.998199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.998384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.998583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.998765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.998875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.998957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.999164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.999396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.999586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.999769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:00.999907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:00.999982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.000200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.000394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.000593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.000773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.000880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.000957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.001163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.001386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.001583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-27 02:42:01.001775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-27 02:42:01.001887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.001970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.002200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.002409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.002615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.002831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.002946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.003029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.003217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.003432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.003670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.003893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.003999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.004081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.004266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.004505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.004714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.004908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.004988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.005131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.005314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.005499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.005742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.005850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.005974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.006190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.006401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.006619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.006851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.006979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.007132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.007352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.007540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.007733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.007874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.007954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.008151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.008373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.008608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.008857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.008963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.009056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.009277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.009464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.009690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.009806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.009949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.010162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.010353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.010556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.010765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.010869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.010950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.011171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.011357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.011596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.011832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.011934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.012016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.012221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.012401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-27 02:42:01.012502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-27 02:42:01.012626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.012707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.012733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.012831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.012906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.012932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.013047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.013281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.013503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.013712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.013891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.013992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.014072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.014296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.014521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.014716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.014911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.014988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.015095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.015294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.015514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.015707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.015810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.015919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.016107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.016334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.016544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.016746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.016854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.016934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.017131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.017372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.017609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.017853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.017984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.018096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.018326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.018529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.018726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.018837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.018922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.019121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.019318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.019508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.019749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.019857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.019967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.020156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.020375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.020592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.020800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.020933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.021017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.021201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.021381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.021651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.021838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.021975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.022064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.022253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.022466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.022659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.022858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.022958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.023035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.023220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.023426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.023634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-27 02:42:01.023881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.023992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-27 02:42:01.024017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.024094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.024281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.024477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.024680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.024921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.024999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.025146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.025337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.025567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.025785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.025916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.026004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.026205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.026455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.026656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.026844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.026978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.027063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.027257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.027447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.027679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.027881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.027983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.028079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.028265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.028482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.028711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.028829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.028920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.029142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.029335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.029559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.029761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.029868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.029951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.030164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.030346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.030533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.030726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.030837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.030921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.031108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.031297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.031597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.031797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.031909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.031997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.032214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.032420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.032653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.032853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.032952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.033032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.033226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.033425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.033653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.033758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.033898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.034115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.034295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.034481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-27 02:42:01.034721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-27 02:42:01.034804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.034828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.034917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.035123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.035320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.035512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.035709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.035822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.035903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.036119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.036343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.036559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.036758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.036867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.036940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.037132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.037343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.037583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.037782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.037889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.037985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.038165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.038359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.038596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.038786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.038892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.039912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.039991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.040210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.040415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.040642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.040824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.040953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.041041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.041255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.041469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.041706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.041804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.041897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.042110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.042291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.042487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.042682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.042890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.042977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.043081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.043300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.043484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.043703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.043890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.043972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.044085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.044271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.044457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.044654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.044834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.044945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.045051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.045246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.045430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.045627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-27 02:42:01.045851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-27 02:42:01.045935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.045961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.046036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.046234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.046425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.046615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.046862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.046966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.047051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.047272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.047467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.047654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.047835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.047942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.048017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.048246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.048472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.048695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.048885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.048982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.049091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.049286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.049483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.049702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.049818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.049935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.050161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.050343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.050567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.050783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.050897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.051007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.051194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.051408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.051602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.051819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.051928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.052071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.052266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.052447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.052650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.052863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.052965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.053050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.053246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.053482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.053695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.053801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.053893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.054118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.054306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.054535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.054721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.054832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.054915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.055142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.055338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.055573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.055764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.055875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.056017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.056233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.056417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.056623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-27 02:42:01.056814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-27 02:42:01.056955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.057046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.057301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.057528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.057718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.057920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.057997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.058107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.058296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.058517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.058745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.058855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.058965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.059176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.059365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.059596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.059865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.059963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.060037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.060227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.060410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.060621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.060853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.060954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.061033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.061248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.061449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.061678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.061879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.061987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.062063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.062240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.062475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.062675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.062890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.062996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.063110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.063297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.063512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.063705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.063857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.063940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.064125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.064348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.064556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.064756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.064865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.064947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.065135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.065369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.065566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.065755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.065863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.065971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.066225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.066411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.066626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.066849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.066962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.067060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.067269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.067473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.067668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.067870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.067978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.068003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-27 02:42:01.068116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-27 02:42:01.068224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.068330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.068546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.068752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.068866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.068959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.069146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.069327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.069547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.069735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.069881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.069958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.070147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.070348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.070596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.070803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.070906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.070982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.071203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.071447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.071656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.071880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.071988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.072079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.072262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.072437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.072639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.072881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.072991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.073106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.073305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.073496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.073861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.073973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.074185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.074373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.074604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.074803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.074904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.074984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.075175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.075397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.075621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.075811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.075910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.075992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.076205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.076417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.076614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.076810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.076984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.077090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.077272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.077489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.077715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.077902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.077988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.078108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.078294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.078538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.078778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.078881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.078957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.079173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.079367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-27 02:42:01.079604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-27 02:42:01.079743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.079851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.079930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.079956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.080030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.080224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.080443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.080659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.080859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.080961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.081048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.081247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.081467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.081683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.081876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.081978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.082091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.082300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.082490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.082688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.082884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.082989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.083063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.083253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.083506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.083700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.083927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.083999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.084106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.084315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.084500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.084700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.084833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.084920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.085109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.085282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.085499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.085713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.085827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.085902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.086118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.086340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.086583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.086778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.086918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.087003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.087214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.087423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.087680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.087858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.087963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-27 02:42:01.088076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.088158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-27 02:42:01.088184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.088258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.088473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.088705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.088919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.088996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.089102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.089300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.089484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.089713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.089903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.089986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.090104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.090287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.090502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.090710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.090846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.090932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.091123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.091331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.091543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.091774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.091883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.091989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.092187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.092391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.092590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.092798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.092904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.092987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.093193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.093446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.093645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.093833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.093930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.094012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.094227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.094447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.094698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.094809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.094896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.095142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.095381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.095613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.095800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.095901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-27 02:42:01.095979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.096060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-27 02:42:01.096085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.096158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.096372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.096614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.096806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.096910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.097049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.097232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.097476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.097675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.097902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.097981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.098097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.098275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.098496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.098722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.098839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.098952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.099165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.099384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.099610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.099789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.099894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.099978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.100157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.100330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.100519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.100743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.100845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.100929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.101144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.101318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.101498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.101746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.101843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.101925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.102109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.102321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.102500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.102737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.102850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.102929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.103123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.103344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.103555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.103770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.103874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.103964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.104076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.104101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-27 02:42:01.104187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-27 02:42:01.104272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.104374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.104567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.104754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.104858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.104944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.105170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.105354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.105542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.105732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.105850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.105940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.106149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.106390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.106749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.106856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.106941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.107140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.107354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.107559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.107751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.107858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.107979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.108168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.108350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.108533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.108746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.108855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.108938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.109162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.109385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.109582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.109764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.109942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.110022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.110222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.110413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.110603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.110797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.110898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.111007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.111197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.111374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-27 02:42:01.111487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-27 02:42:01.111572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.111661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.111687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.111772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.111855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.111881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.111971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.112155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.112393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.112580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.112793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.112902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.112980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.113198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.113396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.113594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.113788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.113922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.114916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.114998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.115217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.115411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.115642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.115830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.115936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.116016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.116203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.116403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.116631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.116814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.116942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.117022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.117214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.117402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.117607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.117804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.117909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.118016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.118191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.118433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.118667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.118796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.118908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.119132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.119326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.119536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-27 02:42:01.119720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-27 02:42:01.119826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.119934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.120147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.120351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.120544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.120743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.120845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.120933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.121140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.121318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.121518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.121716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.121822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.121900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.122129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.122316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.122492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.122715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.122848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.122931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.123148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.123362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.123586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.123766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.123894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.123991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.124190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.124390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.124598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.124816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.124950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.125034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.125228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.125403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.125599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.125800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.125916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.126023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.126244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.126459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.126656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.126864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.126966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.127097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.127349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.127561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.127742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.127853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.127937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.128017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.128041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-27 02:42:01.128123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-27 02:42:01.128209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.128314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.128506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.128717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.128866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.128945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.129132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.129346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.129540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.129774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.129888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.129999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.130245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.130432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.130632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.130742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.130858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.131156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.131375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.131566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.131753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.131866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.131948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.132143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.132363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.132590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.132775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.132894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.132985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.133196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.133454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.133677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.133817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.133927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.134115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.134370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.134613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.134794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.134910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.135002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.135212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.135457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.135665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.135887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.135987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.136076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.136262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.136498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-27 02:42:01.136745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-27 02:42:01.136861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.136946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.137184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.137411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.137640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.137830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.137977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.138085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.138325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.138572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.138811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.138923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.139005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.139269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.139458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.139644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.139838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.139999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.140089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.140283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.140471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.140690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.140831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.140918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.141116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.141328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.141513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.141713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.141900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.141982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.142087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.142272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.142486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.142696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.142845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.142942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.143134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.143375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.143593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.143801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.143941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.144026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.144244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.144434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.144633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-27 02:42:01.144741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-27 02:42:01.144877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.144952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.144978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.145057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.145256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.145468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.145698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.145803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.145927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.146149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.146376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.146628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.146826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.146947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.147061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.147255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.147448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.147646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.147848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.147966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.148078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.148301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.148530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.148719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.148833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.148953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.149178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.149371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.149585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.149798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.149911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.149999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.150213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-27 02:42:01.150390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-27 02:42:01.150533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.858 [2024-11-27 02:42:01.150624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.150704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.150733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.858 qpair failed and we were unable to recover it. 00:30:36.858 [2024-11-27 02:42:01.150826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.150924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.150949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.858 qpair failed and we were unable to recover it. 00:30:36.858 [2024-11-27 02:42:01.151029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.151111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.151138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.858 qpair failed and we were unable to recover it. 00:30:36.858 [2024-11-27 02:42:01.151222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.151321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.858 [2024-11-27 02:42:01.151347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.858 qpair failed and we were unable to recover it. 00:30:36.858 [2024-11-27 02:42:01.151428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.151648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.151842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.151942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.152027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.152251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.152475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.152675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.152857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.152969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.153083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.153303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.153534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.153724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.153915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.153997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.154108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.154306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.154492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.154730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.154853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.154938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.155130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.155319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.155561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.155757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.155864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.155945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.156169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.156355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.156560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.156796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.156917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.157004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.157088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.157114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.859 qpair failed and we were unable to recover it. 00:30:36.859 [2024-11-27 02:42:01.157198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.859 [2024-11-27 02:42:01.157280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.157387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.157628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.157833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.157955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.158042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.158255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.158452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.158690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.158797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.158881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.159109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.159301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.159519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.159738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.159876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.159959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.160142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.160421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.160646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.160840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.160938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.161020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.161209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.161443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.161634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.161825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.161921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.162013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.162228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.162450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.162683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.162904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.162985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.163010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.860 [2024-11-27 02:42:01.163104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.163191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.860 [2024-11-27 02:42:01.163217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.860 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.163303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.163531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.163726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.163864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.163947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.164175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.164368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.164584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.164775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.164922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.165005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.165194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.165376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.165634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.165836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.165972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.166083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.166273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.166491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.166755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.166863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.166941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.167137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.167366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.167596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.167784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.167895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.167972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.168191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.168402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.168624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.168822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.168933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.169026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.169102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.169129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.861 qpair failed and we were unable to recover it. 00:30:36.861 [2024-11-27 02:42:01.169210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.861 [2024-11-27 02:42:01.169294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.169456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.169657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.169837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.169948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.170064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.170245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.170441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.170671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.170894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.170977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.171081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.171320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.171552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.171773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.171885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.171978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.172167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.172417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.172608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.172836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.172941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.173025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.173212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.173508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.173831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.173963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.174037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.174227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.174423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.174613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.174826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.174938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.175018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.175125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.175150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.175231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.175316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.862 [2024-11-27 02:42:01.175342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.862 qpair failed and we were unable to recover it. 00:30:36.862 [2024-11-27 02:42:01.175422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.175657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.175843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.175980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.176060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.176241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.176453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.176646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.176757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.176869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.177166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.177394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.177598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.177843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.177976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.178064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.178281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.178471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.178655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.178864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.178994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.179107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.179295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.179550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.179748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.179848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.179940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.180150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.863 qpair failed and we were unable to recover it. 00:30:36.863 [2024-11-27 02:42:01.180337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.863 [2024-11-27 02:42:01.180445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.180556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.180745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.180770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.180959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.181144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.181334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.181566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.181708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.181816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.182117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.182306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.182549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.182744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.182848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.182958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.183137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.183325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.183534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.183767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.183915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.184002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.184219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.184437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.184649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.184868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.184978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.185089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.185273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.185465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.185660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.185839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.185941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.186030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.186282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.186580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.864 qpair failed and we were unable to recover it. 00:30:36.864 [2024-11-27 02:42:01.186763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.864 [2024-11-27 02:42:01.186842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.186867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.186956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.187142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.187396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.187650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.187832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.187938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.188056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.188248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.188434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.188623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.188849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.188955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.189035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.189222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.189433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.189631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.189830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.189953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.190042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.190235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.190464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.190689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.190874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.190990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.191106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.191328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.191545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.191756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.191897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.191980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.192174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.192364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.192580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-27 02:42:01.192688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-27 02:42:01.192822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.192904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.192929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.193069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.193253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.193479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.193746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.193882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.193960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.194143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.194355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.194554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.194778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.194884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.194990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.195180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.195411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.195643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.195823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.195937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.196020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.196226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.196403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.196613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.196808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.196945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.197026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.197289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.197502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.197732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.197879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.197984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.198203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.198397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.198642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-27 02:42:01.198841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-27 02:42:01.198954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.199044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.199234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.199460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.199646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.199844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.199950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.200086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.200301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.200490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.200700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.200816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.200928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.201131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.201339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.201561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.201759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.201867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.201962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.202155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.202373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.202666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.202887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.202994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.203075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.203265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.203481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.203682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.203881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.203991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.204070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.204145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.204170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.204268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.204377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.204402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-27 02:42:01.204483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-27 02:42:01.204583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.204608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.204693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.204781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.204807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.204886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.204968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.204993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.205111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.205344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.205582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.205807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.205916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.205996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.206212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.206396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.206605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.206797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.206912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.206994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.207209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.207402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.207643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.207827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.207928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.208016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.208099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.208126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.208206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.208289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.208314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-27 02:42:01.208511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-27 02:42:01.208632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.208658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.208741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.208828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.208854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.208939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.209142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.209345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.209537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.209768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.209882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.209966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.210156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.210377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.210615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.210823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.210927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.211033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.211236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.211453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.211697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.211826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.211937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.212116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.212300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.212523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.212740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.212855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.212936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.213126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.213316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.213537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.213758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.213894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.213977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.214171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-27 02:42:01.214384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-27 02:42:01.214602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.214749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.214828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.214853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.214936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.215124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.215308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.215614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.215843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.215949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.216024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.216237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.216431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.216633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.216834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.216969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.217048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.217276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.217458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.217772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.217883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.217969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.218152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.218341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.218615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.218834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.218935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.219044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.219150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.219176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.219264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.219338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.219363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-27 02:42:01.219443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-27 02:42:01.219522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.219556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.219671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.219751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.219776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.219865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.219944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.219969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.220048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.220247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.220429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.220629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.220851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.220962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.221047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.221270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.221512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.221712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.221903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.221988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.222091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.222283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.222480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.222742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.222851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.222965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.223184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.223408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.223669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.223894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.223979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.224113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.224322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.224506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.224731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.224841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.224965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.225043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.225067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-27 02:42:01.225176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.225286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-27 02:42:01.225311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.225401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.225481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.225506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.225612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.225769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.225807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.225919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.226119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.226342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.226543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.226773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.226944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.227024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.227273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.227466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.227662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.227867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.227972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.228094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.228289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.228507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.228711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.228824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.228904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.229136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.229376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.229555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.229770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.229884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.229965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.230149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.230368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-27 02:42:01.230632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-27 02:42:01.230749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.230830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.230939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.230964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.231044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.231233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.231431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.231647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.231832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.231962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.232076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.232297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.232479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.232673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.232858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.232975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.233065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.233248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.233472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.233663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.233858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.233967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.234052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.234268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.234447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.234674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-27 02:42:01.234879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.234992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-27 02:42:01.235017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.235092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.235301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.235536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.235738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.235846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.235924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.236127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.236314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.236507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.236715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.236859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.236940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.237155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.237341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.237623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.237842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.237976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.238066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.238263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.238450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.238680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.238782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.238871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.239115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.239302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.239485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.239726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.239845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.239926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.240123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.240303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.240491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-27 02:42:01.240727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-27 02:42:01.240811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.240837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.240916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.241109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.241326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.241512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.241741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.241889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.241999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.242212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.242423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.242625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.242890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.242976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.243087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.243274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.243487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.243725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.243843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.243934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.244135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.244408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.244600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.244818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.244922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.245004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.245120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.245146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.245224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.245360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.245386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-27 02:42:01.245466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-27 02:42:01.245588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.245614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.245732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.245808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.245833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.245917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.246112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.246321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.246513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.246743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.246881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.246971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.247193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.247388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.247622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.247810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.247911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.248008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.248195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.248404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.248613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.248832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.248930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.249007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.249226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.249409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.249645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.249867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.249977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.250090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.250331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.250562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.250749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.250854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.250939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.251127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-27 02:42:01.251310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-27 02:42:01.251420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.251501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.251696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.251884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.251995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.252071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.252270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.252493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.252712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.252830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.252916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.253113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.253325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.253549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.253777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.253912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.253994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.254185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.254378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.254620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.254853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.254964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.255051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.255233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.255419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.255647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.255833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.255941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.256019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.256235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.256424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.256620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.256849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.256979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-27 02:42:01.257068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.257144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-27 02:42:01.257169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.257278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.257517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.257743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.257860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.257950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.258149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.258355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.258612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.258809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.258911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.258999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.259250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.259508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.259781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.259911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.259999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.260209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.260435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.260635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.260832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.260939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.261022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.261277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.261475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.261673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.261854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.261996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.262080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.262167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.262192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.262276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.262361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-27 02:42:01.262386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-27 02:42:01.262466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.262581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.262607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.262691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.262773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.262798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.262883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.262992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.263126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.263332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.263516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.263714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.263849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.263930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.264146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.264332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.264510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.264705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.264807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.264915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.265129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.265339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.265540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.265770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.265936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.266020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.266289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.266483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.266718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.266825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.266905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.267131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.267315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.267537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.267755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.267871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.267950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.268167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-27 02:42:01.268354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-27 02:42:01.268460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.268556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.268654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.268683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.268794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.268875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.268900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.268992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.269220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.269467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.269688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.269891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.269973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.270116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.270309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.270495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.270693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.270826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.270942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.271156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.271402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.271597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.271789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.271936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.272043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.272230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.272448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.272638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.272745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.272885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.273111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.273302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.273542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.273737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.273919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.273997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.274114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.274302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-27 02:42:01.274518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-27 02:42:01.274609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.274635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.274717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.274796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.274821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.274910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.275133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.275315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.275506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.275696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.275885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.275995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.276103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.276294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.276519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.276704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.276838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.276915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.277142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.277349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.277537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.277726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.277853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.277939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.278135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.278374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.278585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.278792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.278900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.279015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.279199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.279448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.279685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.279785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.279892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.280108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.280331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-27 02:42:01.280436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-27 02:42:01.280514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.280601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.280627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.280733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.280828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.280853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.280938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.281114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.281355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.281550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.281734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.281851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.281941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.282157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.282570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.282761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.282874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.282960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.283141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.283328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.283515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.283725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.283833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.283948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.284126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.284319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.284534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.284719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.284830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.284939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.285164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.285378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-27 02:42:01.285583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-27 02:42:01.285703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.285792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.285870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.285896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.285986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.286245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.286455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.286652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.286852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.286952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.287032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.287219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.287437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.287658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.287844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.287984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.288084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.288288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.288503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.288707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.288900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.288983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.289124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.289344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.289546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.289734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.289845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.289926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.290139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.290354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.290539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.290737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.290847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.290935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.291014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.291039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.291120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.291234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.291261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-27 02:42:01.291340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-27 02:42:01.291446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.291471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.291564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.291644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.291669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.291776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.291875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.291904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.291992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.292183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.292379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.292581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.292786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.292895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.292975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.293164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.293363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.293575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.293769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.293870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.293950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.294162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.294361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.294546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.294755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.294860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.294976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.295208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.295449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.295669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.295859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.295959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.296047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.296258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.296491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.296685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.296787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.296865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.297006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.297031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.297112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.297193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-27 02:42:01.297218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-27 02:42:01.297302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.297515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.297743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.297844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.297925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.298193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.298403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.298601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.298806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.298912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.298992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.299248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.299439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.299633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.299817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.299953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.300037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.300250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.300434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.300647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.300830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.300968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.301044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.301259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.301445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.301643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.301883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.301985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.302066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.302308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.302502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.302699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.302892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.302977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.303003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-27 02:42:01.303093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.303172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-27 02:42:01.303201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.303316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.303504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.303686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.303866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.303970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.304057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.304265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.304445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.304639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.304872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.304973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.305055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.305285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.305462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.305652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.305964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.306053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.306261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.306468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.306665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.306849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.306954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.307036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.307287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.307508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.307772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.307889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.307971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.308186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.308405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.308631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.308849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.308955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-27 02:42:01.309067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-27 02:42:01.309173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.309308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.309496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.309693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.309828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.309909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.310117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.310383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x230a390 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.310608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.310863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.310976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.311058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.311303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.311499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.311725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.311847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.311938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.312153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.312339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.312542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.312758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.312875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.312958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.313148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.313341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.313543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.313733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.313850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.313965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.314045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.314070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.314151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.314289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.314315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-27 02:42:01.314396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-27 02:42:01.314477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.314503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.314602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.314682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.314707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.314786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.314901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.314926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.315006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.315193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.315429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.315667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.315853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.315993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.316111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.316329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.316540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.316739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.316881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.316969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.317167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.317397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.317619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.317803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.317913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.318024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.318216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.318427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.318635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.318859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.318964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.319047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.319301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.319492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.319734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.319871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.319950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.320154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.320340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-27 02:42:01.320443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-27 02:42:01.320521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.320635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.320661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.320746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.320822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.320848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.320963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.321153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.321361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.321552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.321741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.321845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.321930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.322106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.322324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.322501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.322778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.322889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.322971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.323165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.323387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.323626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.323855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.323965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.324052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.324271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.324466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.324673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.324810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.324892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.325106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.325286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.325502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.325729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.325843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.325923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.326108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-27 02:42:01.326317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-27 02:42:01.326423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.326505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.326636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.326661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.326741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.326853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.326878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.326953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.327166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.327350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.327576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.327762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.327883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.327970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.328247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.328455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.328658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.328863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.328975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.329085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.329276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.329522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.329725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.329911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.329993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.330097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.330276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.330533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.330756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.330878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.330954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.331207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.331425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.331649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.331860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.331965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.332040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.332153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.332177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.332259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.332396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-27 02:42:01.332420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-27 02:42:01.332510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.332622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.332650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.332778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.332864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.332890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.333011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.333201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.333418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.333620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.333808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.333926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.334037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.334229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.334440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.334641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.334864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.334963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.335049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.335232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.335428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.335655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.335874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.335987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.336103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.336310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.336554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.336748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.336857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.336970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.337195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.337426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.337646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.337842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.337976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.338060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.338273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-27 02:42:01.338453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-27 02:42:01.338568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.338651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.338727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.338752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.338847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.338929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.338954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.339042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.339243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.339422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.339650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.339842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.339984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.340103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.340319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.340555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.340771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.340924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.341026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.341231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.341419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.341648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.341851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.341960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.342071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.342265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.342486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.342698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.342806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.342918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.343114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.343331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.343553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-27 02:42:01.343745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-27 02:42:01.343880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.343964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.344173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.344367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.344558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.344774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.344884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.344970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.345149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.345352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.345588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.345788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.345923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.345999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.346181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.346366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.346589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.346785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.346900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.347042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.347225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.347474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.347689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.347827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.347940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.348138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.348362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.348587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.348811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.348924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.349010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.349196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.349444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.349668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-27 02:42:01.349888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-27 02:42:01.349976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.350112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.350295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.350492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.350695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.350829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.350954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.351142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.351385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.351592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.351788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.351924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.352000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.352200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.352430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.352660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.352802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.352887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.353151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.353348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.353621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.353861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.353981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.354089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.354296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.354558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.354747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.354892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.354972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.355187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.355378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.355567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.355757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.355861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-27 02:42:01.355971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.356045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-27 02:42:01.356070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.356151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.356366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.356572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.356788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.356895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.357006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.357189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.357413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.357624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.357846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.357984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.358070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.358285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.358472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.358695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.358876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.358988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.359101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.359358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.359562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.359784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.359890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.359974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.360158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.360340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.360536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.360757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.360867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.360947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.361158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.361372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.361594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.361829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.361972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-27 02:42:01.362048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-27 02:42:01.362126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.362239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.362428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.362702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.362816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.362909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.363148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.363359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.363587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.363816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.363924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.364008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.364227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.364425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.364640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.364824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.364941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.365029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.365252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.365444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.365639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.365851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.365958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.366049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.366292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.366500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.366726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.366829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.366937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.367014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.367039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-27 02:42:01.367135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-27 02:42:01.367221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.367324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.367601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.367778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.367883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.367962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.368174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.368399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.368607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.368825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.368930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.369005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.369229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.369424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.369656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.369873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.369975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.370070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.370258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.370449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.370671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.370893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.370980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.371117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.371339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.371540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.371728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.371848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.371933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.372170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.372359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.372575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.372789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.372902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.373016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.373103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-27 02:42:01.373128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-27 02:42:01.373212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.373434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.373636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.373865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.373971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.374056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.374254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.374447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.374708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.374880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.374962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.375195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.375442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.375651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.375843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.375947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.376089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.376293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.376484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.376677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.376889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.376994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.377073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.377315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.377543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.377741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.377880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.377967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.378154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.378369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.378591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.378783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.378927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.379015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.379098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.379124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-27 02:42:01.379210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.379320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-27 02:42:01.379346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.379434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.379667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.379863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.379970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.380110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.380300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.380523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.380722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.380920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.380998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.381132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.381340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.381573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.381770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.381885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.381995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.382223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.382412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.382650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.382844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.382952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.383037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.383264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.383482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.383719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.383858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.383942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.384128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.384323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.384508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.384703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.384915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.384996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.385022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.385100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.385179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-27 02:42:01.385205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-27 02:42:01.385314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.385538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.385734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.385841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.385926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.386182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.386407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.386654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.386846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.386953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.387034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.387214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.387409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.387688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.387789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.387896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.388143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.388329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.388568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.388785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.388893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.388981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.389169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.389394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.389591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.389776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.389891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.389981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.390168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.390355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.390556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.390745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.390847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.390931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.391018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.391044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-27 02:42:01.391156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-27 02:42:01.391237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.391351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.391554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.391753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.391898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.391987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.392173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.392387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.392613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.392842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.392948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.393034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.393214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.393408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.393616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.393850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.393960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.394073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.394268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.394455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.394729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.394878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.394958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.395160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.395377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.395587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.395784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.395915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.395994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.396202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-27 02:42:01.396389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-27 02:42:01.396567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.396648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.396725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.396751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.396877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.396954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.396980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.397064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.397311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.397509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.397716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.397854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.397935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.398154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.398367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.398601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.398786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.398956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.399048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.399238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.399422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.399648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.399855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.399967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.400049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.400237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.400423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.400624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.400885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.400993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.401138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.401332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.401520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.401740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.401841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.401921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.402108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.402329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-27 02:42:01.402437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-27 02:42:01.402547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.402657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.402682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.402796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.402871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.402896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.403005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.403189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.403406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.403633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.403828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.403926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.404066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.404292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.404480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.404707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.404902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.404982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.405088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.405340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.405546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.405796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.405935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.406023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.406246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.406434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.406639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.406842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.406978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.407069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.407283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.407507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.407701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.407808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.407894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.408119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.408343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.408562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.408753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-27 02:42:01.408870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-27 02:42:01.408977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.409200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.409404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.409602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.409799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.409916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.409999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.410192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.410378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.410603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.410794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.410914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.411002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.411224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.411479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.411704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.411836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.411953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.412148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.412334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.412516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.412747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.412861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.412964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.413202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.413385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.413599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.413804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.413917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.414003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.414226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.414481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.414704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.414841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.414923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.415146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-27 02:42:01.415349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-27 02:42:01.415487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.415583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.415669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.415698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.415808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.415887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.415920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.416035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.416234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.416426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.416654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.416906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.416989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.417128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.417322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.417507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.417748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.417864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.417946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.418183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.418384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.418584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.418808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.418918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.419892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.419974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.420238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.420432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.420691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.420892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.420992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.421119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.421306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-27 02:42:01.421487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-27 02:42:01.421637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.421730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.421818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.421844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.421925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.422116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.422311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.422507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.422714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.422855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.422946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.423211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.423441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.423664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.423909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.423997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.424114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.424334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.424551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.424750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.424861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.424946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.425170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.425359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.425556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.425752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.425899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-27 02:42:01.426008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.426087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-27 02:42:01.426113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.426196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.426392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.426586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.426813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.426955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.427037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.427275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.427468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.427700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.427806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.427890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.428112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.428294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.428480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.428680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.428837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.428937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.429155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.429369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.429569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.429752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.429861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.429936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.430196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.430391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.430621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.430760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.430892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.431122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.431314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.431490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.431709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.431814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.431891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.432002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.432028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-27 02:42:01.432107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-27 02:42:01.432215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.432325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.432539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.432763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.432876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.432987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.433180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.433405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.433620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.433841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.433943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.434055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.434274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.434491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.434779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.434895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d14000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.434981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.435176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.435406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.435606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.435798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.435908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.435987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.436173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.436389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.436588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.436842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.436984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.437069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.437253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.437544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.437733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.437880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.437964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.438047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.438073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-27 02:42:01.438150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.438240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-27 02:42:01.438267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.438351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.438542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.438742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.438849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.438987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.439246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.439463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.439723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.439874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.439959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.440182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.440365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.440560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.440791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.440895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.441893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.441975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.442193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.442394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.442631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.442892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.442995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.443078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.443267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.443447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.443701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.443817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.443939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.444028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.444054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.444172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.444247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.444274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-27 02:42:01.444384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-27 02:42:01.444494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.444539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.444624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.444734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.444760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.444845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.444981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.445084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.445269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.445450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.445565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.445674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.448608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.448636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.448726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.448812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.448839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.448921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.449108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.449333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.449558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.449778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.449892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.449975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.450198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.450445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.450666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.450870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.450980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.451065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.451300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.451490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.451677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.451874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.451978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.452055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.452165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-27 02:42:01.452190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-27 02:42:01.452277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.452464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.452703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.452909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.452988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.453096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.453321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.453553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.453737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.453883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.453973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.454175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-27 02:42:01.454368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-27 02:42:01.454505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.454606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.454687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.454713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.454793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.454881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.454908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.454994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.455209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.455409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.455605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.455791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.455899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.455981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.456159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.456382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.456592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.456779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.456891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.456967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.457071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.457097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.181 qpair failed and we were unable to recover it. 00:30:37.181 [2024-11-27 02:42:01.457206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.181 [2024-11-27 02:42:01.457317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.457425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.457623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.457838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.457950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.458032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.458259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.458458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.458664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.458793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 A controller has encountered a failure and is being reset. 00:30:37.182 [2024-11-27 02:42:01.458943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.459192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.459375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.459587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.459779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.459912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.460032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.460217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.460445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.460646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.460830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.460933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.461015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.461237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.461424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.461656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.461848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.461979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.462091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.462279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.462465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.462673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.462875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.462997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.182 [2024-11-27 02:42:01.463022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.182 qpair failed and we were unable to recover it. 00:30:37.182 [2024-11-27 02:42:01.463104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.463332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.463566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.463798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.463939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.464017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.464212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.464418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.464615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.464803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.464947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.465036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.465221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.465405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.465630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.465818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.465954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.466061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.466322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.466553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.466745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.466883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.466969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.467188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.467400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.467595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.467781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.467921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.468002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.468221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.468441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.468660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.468846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.468982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.183 qpair failed and we were unable to recover it. 00:30:37.183 [2024-11-27 02:42:01.469061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.183 [2024-11-27 02:42:01.469147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.469289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.469544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.469738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.469882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.469965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.470202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.470381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.470580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.470816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.470946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.471027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.471217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.471430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.471634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.471870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.471973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.472050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.472269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.472455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.472654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.472850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.472984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.473094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.473275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.473469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.473690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.473842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.473951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.474147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.474342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.474584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.474779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.474938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.184 qpair failed and we were unable to recover it. 00:30:37.184 [2024-11-27 02:42:01.475018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.475124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.184 [2024-11-27 02:42:01.475149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.475232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.475459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.475687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.475828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.475942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.476202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.476400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.476595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.476839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.476978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.477064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.477286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.477480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.477694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.477828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.477944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.478131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.478322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.478514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.478733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.478875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.478954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.479232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.479429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.479652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.479846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.479951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.480034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.480277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.480469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.480667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.480830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.480919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.481004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.481029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.481141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.481222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.185 [2024-11-27 02:42:01.481247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.185 qpair failed and we were unable to recover it. 00:30:37.185 [2024-11-27 02:42:01.481331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.481590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.481781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.481892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.482007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.482198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.482376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.482639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.482839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.482999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.483097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.483315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.483494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.483697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.483798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.483907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.484149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.484347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.484554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.484782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.484929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.485017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d18000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.485220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.485445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.485647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.485886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.485991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.486082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.486192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.486218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.486328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.486403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.486437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.186 qpair failed and we were unable to recover it. 00:30:37.186 [2024-11-27 02:42:01.486528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.186 [2024-11-27 02:42:01.486605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.486630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.486711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.486790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.486814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.486939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.487131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.487355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.487565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.487795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.487905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.487982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.488167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.488388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.488586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.488805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.488943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.489058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.489238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.489464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.489676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.489866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.489984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.490064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.490336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.490572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.490758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.490871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.490950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.491181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.491373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.491777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.491890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.491970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.492155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.187 qpair failed and we were unable to recover it. 00:30:37.187 [2024-11-27 02:42:01.492389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.187 [2024-11-27 02:42:01.492500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.492597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.492673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.492699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.492779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.492885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.492910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.492995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.493192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.493420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.493616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.493851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.493991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.494075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.494264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.494447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.494662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.494872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.494992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.495076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.495275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.495463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.495662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.495859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.495963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.496055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.496639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.496670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.496757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.496870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.496895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.497026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.497247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.497469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.497687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.497823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.497904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.498224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.498418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.498652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.498851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.498966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.188 qpair failed and we were unable to recover it. 00:30:37.188 [2024-11-27 02:42:01.499079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.188 [2024-11-27 02:42:01.499154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.499259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.499504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.499706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.499905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.499988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.500107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.500305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.500544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.500744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.500891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.501915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.501998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.502192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.502402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.502626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.502829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.502937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.503026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.503245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.503439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.503632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.503839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.503939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.504025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.504248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.504439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.504660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.189 [2024-11-27 02:42:01.504866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.189 [2024-11-27 02:42:01.504968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.189 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.505075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.505288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.505489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.505746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.505850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.505945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.506190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.506384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.506607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.506819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.506960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.507082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.507284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.507515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.507752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.507888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.507970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.508187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.508369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.508591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.508772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.508913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.508997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.509208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.509409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.509603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.509855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.509961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.510114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.510355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.190 qpair failed and we were unable to recover it. 00:30:37.190 [2024-11-27 02:42:01.510605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.190 [2024-11-27 02:42:01.510709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.510791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.510872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.510897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.510979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.511178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.511365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.511565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.511749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.511885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.511965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.512159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.512396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.512631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.512850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.512973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.513056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.513290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.513482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.513706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.513839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.513922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.514126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.514328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.514533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.514749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.514872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.514995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.515191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.515404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.515612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.515794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.515924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.516017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.516209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.191 [2024-11-27 02:42:01.516390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.191 [2024-11-27 02:42:01.516503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.191 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.516594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.516676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.516702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.516811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.516894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.516919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.517027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.517236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.517448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.517643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.517819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.517921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.518016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.518224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.518432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.518677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.518868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.518994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.519074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.519292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.519612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.519811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.519953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.520035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.520256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.520454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.520664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.520853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.520956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.521073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.521299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.521491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.521711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.521851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.521936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.522131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.522323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.192 [2024-11-27 02:42:01.522457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.192 qpair failed and we were unable to recover it. 00:30:37.192 [2024-11-27 02:42:01.522564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.522672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.522696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.522837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.522915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.522939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.523056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.523237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.523433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.523639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.523830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.523928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.524025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.524252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.524440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.524629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.524840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.524948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.525045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.525230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.525444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.525694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.525891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.525995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.526105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.526309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.526510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.526716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.526910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.526991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.527166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.527345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.527546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.527745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.527871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.527980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.528089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.528114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.528207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.528304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.528329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.193 qpair failed and we were unable to recover it. 00:30:37.193 [2024-11-27 02:42:01.528416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.193 [2024-11-27 02:42:01.528504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.528535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.528644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.528750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.528775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.528866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.528975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.529094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.529280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.529471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.529667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.529858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.529978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.530068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.530256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.530458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.530666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.530849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.530965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.531048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.531240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.531474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.531700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.531802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.531920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.532149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.532345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.532566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.532780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.532884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.533007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.533195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.533425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.533688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.533817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.533916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.534122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.194 [2024-11-27 02:42:01.534335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.194 [2024-11-27 02:42:01.534437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.194 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.534556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.534664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.534695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.534810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.534895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.534920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.535006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.535203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.535384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.535616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.535805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.535940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.536037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.536260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.536447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.536649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.536863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.536967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.537056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.537252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.537461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.537654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.537790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.537911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.538136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.538364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.538604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.538800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.538947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.539035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.539275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.539484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.539685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.195 qpair failed and we were unable to recover it. 00:30:37.195 [2024-11-27 02:42:01.539876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.195 [2024-11-27 02:42:01.539986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.540071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.540293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.540494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.540686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.540820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.540927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.541144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.541334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.541570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.541765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.541866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.541956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.542150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.542445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.542666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.542918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.542995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.543100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.543317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 02:42:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:37.196 [2024-11-27 02:42:01.543549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 02:42:01 -- common/autotest_common.sh@862 -- # return 0 00:30:37.196 [2024-11-27 02:42:01.543629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.543767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 02:42:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:37.196 [2024-11-27 02:42:01.543888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.543912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.543986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 02:42:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:37.196 [2024-11-27 02:42:01.544079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.196 [2024-11-27 02:42:01.544184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.544364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.544549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.544793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.544897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.545019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.545121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.545146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f9d20000b90 with addr=10.0.0.2, port=4420 00:30:37.196 qpair failed and we were unable to recover it. 00:30:37.196 [2024-11-27 02:42:01.545277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.545394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.196 [2024-11-27 02:42:01.545423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2317e00 with addr=10.0.0.2, port=4420 00:30:37.196 [2024-11-27 02:42:01.545441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2317e00 is same with the state(5) to be set 00:30:37.196 [2024-11-27 02:42:01.545468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2317e00 (9): Bad file descriptor 00:30:37.196 [2024-11-27 02:42:01.545488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:37.196 [2024-11-27 02:42:01.545503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:37.196 [2024-11-27 02:42:01.545541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:37.196 Unable to reset the controller. 00:30:37.196 02:42:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:37.196 02:42:01 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:37.196 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.196 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 Malloc0 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:37.197 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.197 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 [2024-11-27 02:42:01.589946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:37.197 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.197 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:37.197 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.197 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:37.197 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.197 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 [2024-11-27 02:42:01.618191] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:37.197 02:42:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.197 02:42:01 -- common/autotest_common.sh@10 -- # set +x 00:30:37.197 02:42:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.197 02:42:01 -- host/target_disconnect.sh@58 -- # wait 2202142 00:30:38.130 Controller properly reset. 00:30:42.311 Initializing NVMe Controllers 00:30:42.312 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:42.312 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:42.312 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:42.312 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:42.312 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:42.312 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:42.312 Initialization complete. Launching workers. 00:30:42.312 Starting thread on core 1 00:30:42.312 Starting thread on core 2 00:30:42.312 Starting thread on core 3 00:30:42.312 Starting thread on core 0 00:30:42.312 02:42:06 -- host/target_disconnect.sh@59 -- # sync 00:30:42.312 00:30:42.312 real 0m11.418s 00:30:42.312 user 0m34.094s 00:30:42.312 sys 0m7.189s 00:30:42.312 02:42:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:42.312 02:42:06 -- common/autotest_common.sh@10 -- # set +x 00:30:42.312 ************************************ 00:30:42.312 END TEST nvmf_target_disconnect_tc2 00:30:42.312 ************************************ 00:30:42.312 02:42:06 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:42.312 02:42:06 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:42.312 02:42:06 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:42.312 02:42:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:42.312 02:42:06 -- nvmf/common.sh@116 -- # sync 00:30:42.312 02:42:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:42.312 02:42:06 -- nvmf/common.sh@119 -- # set +e 00:30:42.312 02:42:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:42.312 02:42:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:42.312 rmmod nvme_tcp 00:30:42.312 rmmod nvme_fabrics 00:30:42.312 rmmod nvme_keyring 00:30:42.312 02:42:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:42.312 02:42:06 -- nvmf/common.sh@123 -- # set -e 00:30:42.312 02:42:06 -- nvmf/common.sh@124 -- # return 0 00:30:42.312 02:42:06 -- nvmf/common.sh@477 -- # '[' -n 2202719 ']' 00:30:42.312 02:42:06 -- nvmf/common.sh@478 -- # killprocess 2202719 00:30:42.312 02:42:06 -- common/autotest_common.sh@936 -- # '[' -z 2202719 ']' 00:30:42.312 02:42:06 -- common/autotest_common.sh@940 -- # kill -0 2202719 00:30:42.312 02:42:06 -- common/autotest_common.sh@941 -- # uname 00:30:42.312 02:42:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:42.312 02:42:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2202719 00:30:42.312 02:42:06 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:42.312 02:42:06 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:42.312 02:42:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2202719' 00:30:42.312 killing process with pid 2202719 00:30:42.312 02:42:06 -- common/autotest_common.sh@955 -- # kill 2202719 00:30:42.312 02:42:06 -- common/autotest_common.sh@960 -- # wait 2202719 00:30:42.571 02:42:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:42.571 02:42:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:42.571 02:42:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:42.571 02:42:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:42.571 02:42:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:42.571 02:42:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:42.571 02:42:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:42.571 02:42:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:45.109 02:42:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:45.109 00:30:45.109 real 0m16.455s 00:30:45.109 user 0m59.972s 00:30:45.109 sys 0m9.705s 00:30:45.109 02:42:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.109 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.109 ************************************ 00:30:45.109 END TEST nvmf_target_disconnect 00:30:45.109 ************************************ 00:30:45.109 02:42:09 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:45.109 02:42:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:45.109 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.109 02:42:09 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:45.109 00:30:45.109 real 22m54.794s 00:30:45.109 user 66m47.262s 00:30:45.109 sys 5m29.939s 00:30:45.109 02:42:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.109 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.109 ************************************ 00:30:45.109 END TEST nvmf_tcp 00:30:45.109 ************************************ 00:30:45.109 02:42:09 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:45.109 02:42:09 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:45.109 02:42:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:45.109 02:42:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.110 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.110 ************************************ 00:30:45.110 START TEST spdkcli_nvmf_tcp 00:30:45.110 ************************************ 00:30:45.110 02:42:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:45.110 * Looking for test storage... 00:30:45.110 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:45.110 02:42:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:45.110 02:42:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:45.110 02:42:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:45.110 02:42:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:45.110 02:42:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:45.110 02:42:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:45.110 02:42:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:45.110 02:42:09 -- scripts/common.sh@335 -- # IFS=.-: 00:30:45.110 02:42:09 -- scripts/common.sh@335 -- # read -ra ver1 00:30:45.110 02:42:09 -- scripts/common.sh@336 -- # IFS=.-: 00:30:45.110 02:42:09 -- scripts/common.sh@336 -- # read -ra ver2 00:30:45.110 02:42:09 -- scripts/common.sh@337 -- # local 'op=<' 00:30:45.110 02:42:09 -- scripts/common.sh@339 -- # ver1_l=2 00:30:45.110 02:42:09 -- scripts/common.sh@340 -- # ver2_l=1 00:30:45.110 02:42:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:45.110 02:42:09 -- scripts/common.sh@343 -- # case "$op" in 00:30:45.110 02:42:09 -- scripts/common.sh@344 -- # : 1 00:30:45.110 02:42:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:45.110 02:42:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:45.110 02:42:09 -- scripts/common.sh@364 -- # decimal 1 00:30:45.110 02:42:09 -- scripts/common.sh@352 -- # local d=1 00:30:45.110 02:42:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:45.110 02:42:09 -- scripts/common.sh@354 -- # echo 1 00:30:45.110 02:42:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:45.110 02:42:09 -- scripts/common.sh@365 -- # decimal 2 00:30:45.110 02:42:09 -- scripts/common.sh@352 -- # local d=2 00:30:45.110 02:42:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:45.110 02:42:09 -- scripts/common.sh@354 -- # echo 2 00:30:45.110 02:42:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:45.110 02:42:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:45.110 02:42:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:45.110 02:42:09 -- scripts/common.sh@367 -- # return 0 00:30:45.110 02:42:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:45.110 02:42:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.110 --rc genhtml_branch_coverage=1 00:30:45.110 --rc genhtml_function_coverage=1 00:30:45.110 --rc genhtml_legend=1 00:30:45.110 --rc geninfo_all_blocks=1 00:30:45.110 --rc geninfo_unexecuted_blocks=1 00:30:45.110 00:30:45.110 ' 00:30:45.110 02:42:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.110 --rc genhtml_branch_coverage=1 00:30:45.110 --rc genhtml_function_coverage=1 00:30:45.110 --rc genhtml_legend=1 00:30:45.110 --rc geninfo_all_blocks=1 00:30:45.110 --rc geninfo_unexecuted_blocks=1 00:30:45.110 00:30:45.110 ' 00:30:45.110 02:42:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.110 --rc genhtml_branch_coverage=1 00:30:45.110 --rc genhtml_function_coverage=1 00:30:45.110 --rc genhtml_legend=1 00:30:45.110 --rc geninfo_all_blocks=1 00:30:45.110 --rc geninfo_unexecuted_blocks=1 00:30:45.110 00:30:45.110 ' 00:30:45.110 02:42:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:45.110 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.110 --rc genhtml_branch_coverage=1 00:30:45.110 --rc genhtml_function_coverage=1 00:30:45.110 --rc genhtml_legend=1 00:30:45.110 --rc geninfo_all_blocks=1 00:30:45.110 --rc geninfo_unexecuted_blocks=1 00:30:45.110 00:30:45.110 ' 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:45.110 02:42:09 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:45.110 02:42:09 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:45.110 02:42:09 -- nvmf/common.sh@7 -- # uname -s 00:30:45.110 02:42:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:45.110 02:42:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:45.110 02:42:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:45.110 02:42:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:45.110 02:42:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:45.110 02:42:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:45.110 02:42:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:45.110 02:42:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:45.110 02:42:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:45.110 02:42:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:45.110 02:42:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.110 02:42:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.110 02:42:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:45.110 02:42:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:45.110 02:42:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:45.110 02:42:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.110 02:42:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.110 02:42:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.110 02:42:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.110 02:42:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.110 02:42:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.110 02:42:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.110 02:42:09 -- paths/export.sh@5 -- # export PATH 00:30:45.110 02:42:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.110 02:42:09 -- nvmf/common.sh@46 -- # : 0 00:30:45.110 02:42:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:45.110 02:42:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:45.110 02:42:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:45.110 02:42:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:45.110 02:42:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:45.110 02:42:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:45.110 02:42:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:45.110 02:42:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:45.110 02:42:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:45.110 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.110 02:42:09 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:45.110 02:42:09 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2204382 00:30:45.110 02:42:09 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:45.110 02:42:09 -- spdkcli/common.sh@34 -- # waitforlisten 2204382 00:30:45.110 02:42:09 -- common/autotest_common.sh@829 -- # '[' -z 2204382 ']' 00:30:45.110 02:42:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:45.110 02:42:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:45.110 02:42:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:45.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:45.110 02:42:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:45.110 02:42:09 -- common/autotest_common.sh@10 -- # set +x 00:30:45.110 [2024-11-27 02:42:09.503385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:45.110 [2024-11-27 02:42:09.503477] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2204382 ] 00:30:45.110 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.110 [2024-11-27 02:42:09.567848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:45.110 [2024-11-27 02:42:09.664399] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:45.110 [2024-11-27 02:42:09.665512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:45.110 [2024-11-27 02:42:09.665572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:46.044 02:42:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:46.044 02:42:10 -- common/autotest_common.sh@862 -- # return 0 00:30:46.044 02:42:10 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:46.044 02:42:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:46.044 02:42:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.044 02:42:10 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:46.044 02:42:10 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:46.044 02:42:10 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:46.044 02:42:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:46.044 02:42:10 -- common/autotest_common.sh@10 -- # set +x 00:30:46.044 02:42:10 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:46.044 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:46.044 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:46.044 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:46.044 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:46.044 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:46.044 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:46.044 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:46.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:46.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:46.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:46.045 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:46.045 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:46.045 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:46.045 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:46.045 ' 00:30:46.303 [2024-11-27 02:42:10.919260] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:48.831 [2024-11-27 02:42:13.115314] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:49.764 [2024-11-27 02:42:14.367989] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:52.290 [2024-11-27 02:42:16.683339] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:54.188 [2024-11-27 02:42:18.678016] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:56.088 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:56.088 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:56.088 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:56.088 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:56.088 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:56.088 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:56.088 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:56.088 02:42:20 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:56.089 02:42:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:56.089 02:42:20 -- common/autotest_common.sh@10 -- # set +x 00:30:56.089 02:42:20 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:56.089 02:42:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:56.089 02:42:20 -- common/autotest_common.sh@10 -- # set +x 00:30:56.089 02:42:20 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:56.089 02:42:20 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:56.347 02:42:20 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:56.347 02:42:20 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:56.347 02:42:20 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:56.347 02:42:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:56.347 02:42:20 -- common/autotest_common.sh@10 -- # set +x 00:30:56.347 02:42:20 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:56.347 02:42:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:56.347 02:42:20 -- common/autotest_common.sh@10 -- # set +x 00:30:56.347 02:42:20 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:56.347 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:56.347 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:56.347 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:56.347 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:56.347 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:56.347 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:56.347 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:56.347 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:56.347 ' 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:01.610 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:01.610 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:01.610 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:01.610 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:01.610 02:42:26 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:01.610 02:42:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:01.610 02:42:26 -- common/autotest_common.sh@10 -- # set +x 00:31:01.610 02:42:26 -- spdkcli/nvmf.sh@90 -- # killprocess 2204382 00:31:01.610 02:42:26 -- common/autotest_common.sh@936 -- # '[' -z 2204382 ']' 00:31:01.610 02:42:26 -- common/autotest_common.sh@940 -- # kill -0 2204382 00:31:01.610 02:42:26 -- common/autotest_common.sh@941 -- # uname 00:31:01.610 02:42:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:01.610 02:42:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2204382 00:31:01.610 02:42:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:01.610 02:42:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:01.610 02:42:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2204382' 00:31:01.610 killing process with pid 2204382 00:31:01.610 02:42:26 -- common/autotest_common.sh@955 -- # kill 2204382 00:31:01.610 [2024-11-27 02:42:26.239669] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:01.610 02:42:26 -- common/autotest_common.sh@960 -- # wait 2204382 00:31:01.869 02:42:26 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:01.869 02:42:26 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:01.869 02:42:26 -- spdkcli/common.sh@13 -- # '[' -n 2204382 ']' 00:31:01.869 02:42:26 -- spdkcli/common.sh@14 -- # killprocess 2204382 00:31:01.869 02:42:26 -- common/autotest_common.sh@936 -- # '[' -z 2204382 ']' 00:31:01.869 02:42:26 -- common/autotest_common.sh@940 -- # kill -0 2204382 00:31:01.869 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2204382) - No such process 00:31:01.869 02:42:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2204382 is not found' 00:31:01.869 Process with pid 2204382 is not found 00:31:01.869 02:42:26 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:01.869 02:42:26 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:01.869 02:42:26 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:01.869 00:31:01.869 real 0m17.162s 00:31:01.869 user 0m36.733s 00:31:01.869 sys 0m0.827s 00:31:01.869 02:42:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:01.869 02:42:26 -- common/autotest_common.sh@10 -- # set +x 00:31:01.869 ************************************ 00:31:01.869 END TEST spdkcli_nvmf_tcp 00:31:01.869 ************************************ 00:31:01.869 02:42:26 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:01.869 02:42:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:01.869 02:42:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:01.869 02:42:26 -- common/autotest_common.sh@10 -- # set +x 00:31:01.869 ************************************ 00:31:01.869 START TEST nvmf_identify_passthru 00:31:01.869 ************************************ 00:31:01.869 02:42:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:02.127 * Looking for test storage... 00:31:02.127 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:02.127 02:42:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:02.127 02:42:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:02.127 02:42:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:02.127 02:42:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:02.127 02:42:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:02.127 02:42:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:02.127 02:42:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:02.127 02:42:26 -- scripts/common.sh@335 -- # IFS=.-: 00:31:02.127 02:42:26 -- scripts/common.sh@335 -- # read -ra ver1 00:31:02.127 02:42:26 -- scripts/common.sh@336 -- # IFS=.-: 00:31:02.127 02:42:26 -- scripts/common.sh@336 -- # read -ra ver2 00:31:02.127 02:42:26 -- scripts/common.sh@337 -- # local 'op=<' 00:31:02.127 02:42:26 -- scripts/common.sh@339 -- # ver1_l=2 00:31:02.127 02:42:26 -- scripts/common.sh@340 -- # ver2_l=1 00:31:02.128 02:42:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:02.128 02:42:26 -- scripts/common.sh@343 -- # case "$op" in 00:31:02.128 02:42:26 -- scripts/common.sh@344 -- # : 1 00:31:02.128 02:42:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:02.128 02:42:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:02.128 02:42:26 -- scripts/common.sh@364 -- # decimal 1 00:31:02.128 02:42:26 -- scripts/common.sh@352 -- # local d=1 00:31:02.128 02:42:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:02.128 02:42:26 -- scripts/common.sh@354 -- # echo 1 00:31:02.128 02:42:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:02.128 02:42:26 -- scripts/common.sh@365 -- # decimal 2 00:31:02.128 02:42:26 -- scripts/common.sh@352 -- # local d=2 00:31:02.128 02:42:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:02.128 02:42:26 -- scripts/common.sh@354 -- # echo 2 00:31:02.128 02:42:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:02.128 02:42:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:02.128 02:42:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:02.128 02:42:26 -- scripts/common.sh@367 -- # return 0 00:31:02.128 02:42:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:02.128 02:42:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:02.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:02.128 --rc genhtml_branch_coverage=1 00:31:02.128 --rc genhtml_function_coverage=1 00:31:02.128 --rc genhtml_legend=1 00:31:02.128 --rc geninfo_all_blocks=1 00:31:02.128 --rc geninfo_unexecuted_blocks=1 00:31:02.128 00:31:02.128 ' 00:31:02.128 02:42:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:02.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:02.128 --rc genhtml_branch_coverage=1 00:31:02.128 --rc genhtml_function_coverage=1 00:31:02.128 --rc genhtml_legend=1 00:31:02.128 --rc geninfo_all_blocks=1 00:31:02.128 --rc geninfo_unexecuted_blocks=1 00:31:02.128 00:31:02.128 ' 00:31:02.128 02:42:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:02.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:02.128 --rc genhtml_branch_coverage=1 00:31:02.128 --rc genhtml_function_coverage=1 00:31:02.128 --rc genhtml_legend=1 00:31:02.128 --rc geninfo_all_blocks=1 00:31:02.128 --rc geninfo_unexecuted_blocks=1 00:31:02.128 00:31:02.128 ' 00:31:02.128 02:42:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:02.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:02.128 --rc genhtml_branch_coverage=1 00:31:02.128 --rc genhtml_function_coverage=1 00:31:02.128 --rc genhtml_legend=1 00:31:02.128 --rc geninfo_all_blocks=1 00:31:02.128 --rc geninfo_unexecuted_blocks=1 00:31:02.128 00:31:02.128 ' 00:31:02.128 02:42:26 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:02.128 02:42:26 -- nvmf/common.sh@7 -- # uname -s 00:31:02.128 02:42:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:02.128 02:42:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:02.128 02:42:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:02.128 02:42:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:02.128 02:42:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:02.128 02:42:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:02.128 02:42:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:02.128 02:42:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:02.128 02:42:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:02.128 02:42:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:02.128 02:42:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:02.128 02:42:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:02.128 02:42:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:02.128 02:42:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:02.128 02:42:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:02.128 02:42:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:02.128 02:42:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:02.128 02:42:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:02.128 02:42:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:02.128 02:42:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@5 -- # export PATH 00:31:02.128 02:42:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- nvmf/common.sh@46 -- # : 0 00:31:02.128 02:42:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:02.128 02:42:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:02.128 02:42:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:02.128 02:42:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:02.128 02:42:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:02.128 02:42:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:02.128 02:42:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:02.128 02:42:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:02.128 02:42:26 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:02.128 02:42:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:02.128 02:42:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:02.128 02:42:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:02.128 02:42:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- paths/export.sh@5 -- # export PATH 00:31:02.128 02:42:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.128 02:42:26 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:02.128 02:42:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:02.128 02:42:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:02.128 02:42:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:02.128 02:42:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:02.128 02:42:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:02.128 02:42:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:02.128 02:42:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:02.128 02:42:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:02.128 02:42:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:02.128 02:42:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:02.128 02:42:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:02.128 02:42:26 -- common/autotest_common.sh@10 -- # set +x 00:31:04.657 02:42:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:04.657 02:42:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:04.657 02:42:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:04.657 02:42:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:04.657 02:42:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:04.657 02:42:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:04.657 02:42:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:04.657 02:42:28 -- nvmf/common.sh@294 -- # net_devs=() 00:31:04.657 02:42:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:04.657 02:42:28 -- nvmf/common.sh@295 -- # e810=() 00:31:04.657 02:42:28 -- nvmf/common.sh@295 -- # local -ga e810 00:31:04.657 02:42:28 -- nvmf/common.sh@296 -- # x722=() 00:31:04.657 02:42:28 -- nvmf/common.sh@296 -- # local -ga x722 00:31:04.657 02:42:28 -- nvmf/common.sh@297 -- # mlx=() 00:31:04.657 02:42:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:04.657 02:42:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:04.657 02:42:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:04.657 02:42:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:04.657 02:42:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:04.657 02:42:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:04.657 02:42:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:04.657 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:04.657 02:42:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:04.657 02:42:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:04.657 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:04.657 02:42:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:04.657 02:42:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:04.657 02:42:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:04.657 02:42:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:04.657 02:42:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:04.657 02:42:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:04.657 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:04.657 02:42:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:04.657 02:42:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:04.657 02:42:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:04.657 02:42:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:04.657 02:42:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:04.657 02:42:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:04.657 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:04.657 02:42:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:04.657 02:42:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:04.657 02:42:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:04.657 02:42:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:04.657 02:42:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:04.657 02:42:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:04.657 02:42:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:04.657 02:42:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:04.657 02:42:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:04.658 02:42:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:04.658 02:42:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:04.658 02:42:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:04.658 02:42:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:04.658 02:42:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:04.658 02:42:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:04.658 02:42:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:04.658 02:42:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:04.658 02:42:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:04.658 02:42:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:04.658 02:42:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:04.658 02:42:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:04.658 02:42:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:04.658 02:42:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:04.658 02:42:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:04.658 02:42:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:04.658 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:04.658 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:31:04.658 00:31:04.658 --- 10.0.0.2 ping statistics --- 00:31:04.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:04.658 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:31:04.658 02:42:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:04.658 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:04.658 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:31:04.658 00:31:04.658 --- 10.0.0.1 ping statistics --- 00:31:04.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:04.658 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:31:04.658 02:42:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:04.658 02:42:28 -- nvmf/common.sh@410 -- # return 0 00:31:04.658 02:42:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:04.658 02:42:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:04.658 02:42:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:04.658 02:42:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:04.658 02:42:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:04.658 02:42:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:04.658 02:42:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:04.658 02:42:28 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:04.658 02:42:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:04.658 02:42:28 -- common/autotest_common.sh@10 -- # set +x 00:31:04.658 02:42:28 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:04.658 02:42:28 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:04.658 02:42:28 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:04.658 02:42:28 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:04.658 02:42:28 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:04.658 02:42:28 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:04.658 02:42:28 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:04.658 02:42:28 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:04.658 02:42:28 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:04.658 02:42:28 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:04.658 02:42:29 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:04.658 02:42:29 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:04.658 02:42:29 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:04.658 02:42:29 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:04.658 02:42:29 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:04.658 02:42:29 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:04.658 02:42:29 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:04.658 02:42:29 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:04.658 EAL: No free 2048 kB hugepages reported on node 1 00:31:08.840 02:42:33 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:08.840 02:42:33 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:08.840 02:42:33 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:08.840 02:42:33 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:08.840 EAL: No free 2048 kB hugepages reported on node 1 00:31:13.027 02:42:37 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:13.027 02:42:37 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:13.027 02:42:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:13.027 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.027 02:42:37 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:13.027 02:42:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:13.027 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.027 02:42:37 -- target/identify_passthru.sh@31 -- # nvmfpid=2209266 00:31:13.027 02:42:37 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:13.027 02:42:37 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:13.027 02:42:37 -- target/identify_passthru.sh@35 -- # waitforlisten 2209266 00:31:13.027 02:42:37 -- common/autotest_common.sh@829 -- # '[' -z 2209266 ']' 00:31:13.027 02:42:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:13.027 02:42:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:13.027 02:42:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:13.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:13.027 02:42:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:13.027 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.027 [2024-11-27 02:42:37.534182] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:13.027 [2024-11-27 02:42:37.534260] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:13.027 EAL: No free 2048 kB hugepages reported on node 1 00:31:13.027 [2024-11-27 02:42:37.607652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:13.285 [2024-11-27 02:42:37.697820] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:13.285 [2024-11-27 02:42:37.697984] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:13.285 [2024-11-27 02:42:37.698004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:13.285 [2024-11-27 02:42:37.698018] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:13.285 [2024-11-27 02:42:37.698081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:13.285 [2024-11-27 02:42:37.698137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:13.285 [2024-11-27 02:42:37.698257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:13.285 [2024-11-27 02:42:37.698259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:13.285 02:42:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:13.285 02:42:37 -- common/autotest_common.sh@862 -- # return 0 00:31:13.285 02:42:37 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:13.285 02:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:13.285 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.285 INFO: Log level set to 20 00:31:13.285 INFO: Requests: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "method": "nvmf_set_config", 00:31:13.285 "id": 1, 00:31:13.285 "params": { 00:31:13.285 "admin_cmd_passthru": { 00:31:13.285 "identify_ctrlr": true 00:31:13.285 } 00:31:13.285 } 00:31:13.285 } 00:31:13.285 00:31:13.285 INFO: response: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "id": 1, 00:31:13.285 "result": true 00:31:13.285 } 00:31:13.285 00:31:13.285 02:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:13.285 02:42:37 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:13.285 02:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:13.285 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.285 INFO: Setting log level to 20 00:31:13.285 INFO: Setting log level to 20 00:31:13.285 INFO: Log level set to 20 00:31:13.285 INFO: Log level set to 20 00:31:13.285 INFO: Requests: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "method": "framework_start_init", 00:31:13.285 "id": 1 00:31:13.285 } 00:31:13.285 00:31:13.285 INFO: Requests: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "method": "framework_start_init", 00:31:13.285 "id": 1 00:31:13.285 } 00:31:13.285 00:31:13.285 [2024-11-27 02:42:37.836806] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:13.285 INFO: response: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "id": 1, 00:31:13.285 "result": true 00:31:13.285 } 00:31:13.285 00:31:13.285 INFO: response: 00:31:13.285 { 00:31:13.285 "jsonrpc": "2.0", 00:31:13.285 "id": 1, 00:31:13.285 "result": true 00:31:13.285 } 00:31:13.285 00:31:13.285 02:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:13.285 02:42:37 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:13.285 02:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:13.285 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.285 INFO: Setting log level to 40 00:31:13.285 INFO: Setting log level to 40 00:31:13.285 INFO: Setting log level to 40 00:31:13.285 [2024-11-27 02:42:37.846790] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:13.285 02:42:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:13.285 02:42:37 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:13.285 02:42:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:13.285 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:13.285 02:42:37 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:13.285 02:42:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:13.285 02:42:37 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 Nvme0n1 00:31:16.572 02:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:40 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:16.572 02:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.572 02:42:40 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 02:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:40 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:16.572 02:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.572 02:42:40 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 02:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:40 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:16.572 02:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.572 02:42:40 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 [2024-11-27 02:42:40.734706] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:16.572 02:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:40 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:16.572 02:42:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.572 02:42:40 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 [2024-11-27 02:42:40.742406] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:16.572 [ 00:31:16.572 { 00:31:16.572 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:16.572 "subtype": "Discovery", 00:31:16.572 "listen_addresses": [], 00:31:16.572 "allow_any_host": true, 00:31:16.572 "hosts": [] 00:31:16.572 }, 00:31:16.572 { 00:31:16.572 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:16.572 "subtype": "NVMe", 00:31:16.572 "listen_addresses": [ 00:31:16.572 { 00:31:16.572 "transport": "TCP", 00:31:16.572 "trtype": "TCP", 00:31:16.572 "adrfam": "IPv4", 00:31:16.572 "traddr": "10.0.0.2", 00:31:16.572 "trsvcid": "4420" 00:31:16.572 } 00:31:16.572 ], 00:31:16.572 "allow_any_host": true, 00:31:16.572 "hosts": [], 00:31:16.572 "serial_number": "SPDK00000000000001", 00:31:16.572 "model_number": "SPDK bdev Controller", 00:31:16.572 "max_namespaces": 1, 00:31:16.572 "min_cntlid": 1, 00:31:16.572 "max_cntlid": 65519, 00:31:16.572 "namespaces": [ 00:31:16.572 { 00:31:16.572 "nsid": 1, 00:31:16.572 "bdev_name": "Nvme0n1", 00:31:16.572 "name": "Nvme0n1", 00:31:16.572 "nguid": "8E839DDD07944AD89630897972EF2D3F", 00:31:16.572 "uuid": "8e839ddd-0794-4ad8-9630-897972ef2d3f" 00:31:16.572 } 00:31:16.572 ] 00:31:16.572 } 00:31:16.572 ] 00:31:16.572 02:42:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:40 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:16.572 02:42:40 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:16.572 02:42:40 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:16.572 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.572 02:42:41 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:16.572 02:42:41 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:16.572 02:42:41 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:16.572 02:42:41 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:16.572 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.572 02:42:41 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:16.572 02:42:41 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:16.572 02:42:41 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:16.572 02:42:41 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:16.572 02:42:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.572 02:42:41 -- common/autotest_common.sh@10 -- # set +x 00:31:16.572 02:42:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.572 02:42:41 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:16.572 02:42:41 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:16.572 02:42:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:16.572 02:42:41 -- nvmf/common.sh@116 -- # sync 00:31:16.572 02:42:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:16.572 02:42:41 -- nvmf/common.sh@119 -- # set +e 00:31:16.572 02:42:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:16.572 02:42:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:16.572 rmmod nvme_tcp 00:31:16.831 rmmod nvme_fabrics 00:31:16.831 rmmod nvme_keyring 00:31:16.831 02:42:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:16.831 02:42:41 -- nvmf/common.sh@123 -- # set -e 00:31:16.831 02:42:41 -- nvmf/common.sh@124 -- # return 0 00:31:16.831 02:42:41 -- nvmf/common.sh@477 -- # '[' -n 2209266 ']' 00:31:16.831 02:42:41 -- nvmf/common.sh@478 -- # killprocess 2209266 00:31:16.831 02:42:41 -- common/autotest_common.sh@936 -- # '[' -z 2209266 ']' 00:31:16.831 02:42:41 -- common/autotest_common.sh@940 -- # kill -0 2209266 00:31:16.831 02:42:41 -- common/autotest_common.sh@941 -- # uname 00:31:16.831 02:42:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:16.831 02:42:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2209266 00:31:16.831 02:42:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:16.831 02:42:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:16.831 02:42:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2209266' 00:31:16.831 killing process with pid 2209266 00:31:16.831 02:42:41 -- common/autotest_common.sh@955 -- # kill 2209266 00:31:16.831 [2024-11-27 02:42:41.285677] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:16.831 02:42:41 -- common/autotest_common.sh@960 -- # wait 2209266 00:31:18.206 02:42:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:18.206 02:42:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:18.206 02:42:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:18.206 02:42:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:18.206 02:42:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:18.206 02:42:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:18.206 02:42:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:18.206 02:42:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:20.737 02:42:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:20.737 00:31:20.737 real 0m18.368s 00:31:20.737 user 0m27.051s 00:31:20.737 sys 0m2.439s 00:31:20.737 02:42:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:20.737 02:42:44 -- common/autotest_common.sh@10 -- # set +x 00:31:20.737 ************************************ 00:31:20.737 END TEST nvmf_identify_passthru 00:31:20.737 ************************************ 00:31:20.737 02:42:44 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:20.737 02:42:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:20.737 02:42:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:20.737 02:42:44 -- common/autotest_common.sh@10 -- # set +x 00:31:20.737 ************************************ 00:31:20.737 START TEST nvmf_dif 00:31:20.737 ************************************ 00:31:20.737 02:42:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:20.737 * Looking for test storage... 00:31:20.737 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:20.737 02:42:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:20.737 02:42:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:20.737 02:42:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:20.737 02:42:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:20.737 02:42:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:20.737 02:42:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:20.737 02:42:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:20.737 02:42:45 -- scripts/common.sh@335 -- # IFS=.-: 00:31:20.737 02:42:45 -- scripts/common.sh@335 -- # read -ra ver1 00:31:20.737 02:42:45 -- scripts/common.sh@336 -- # IFS=.-: 00:31:20.737 02:42:45 -- scripts/common.sh@336 -- # read -ra ver2 00:31:20.737 02:42:45 -- scripts/common.sh@337 -- # local 'op=<' 00:31:20.737 02:42:45 -- scripts/common.sh@339 -- # ver1_l=2 00:31:20.737 02:42:45 -- scripts/common.sh@340 -- # ver2_l=1 00:31:20.737 02:42:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:20.737 02:42:45 -- scripts/common.sh@343 -- # case "$op" in 00:31:20.737 02:42:45 -- scripts/common.sh@344 -- # : 1 00:31:20.737 02:42:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:20.737 02:42:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:20.737 02:42:45 -- scripts/common.sh@364 -- # decimal 1 00:31:20.737 02:42:45 -- scripts/common.sh@352 -- # local d=1 00:31:20.737 02:42:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:20.737 02:42:45 -- scripts/common.sh@354 -- # echo 1 00:31:20.737 02:42:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:20.737 02:42:45 -- scripts/common.sh@365 -- # decimal 2 00:31:20.737 02:42:45 -- scripts/common.sh@352 -- # local d=2 00:31:20.737 02:42:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:20.737 02:42:45 -- scripts/common.sh@354 -- # echo 2 00:31:20.737 02:42:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:20.737 02:42:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:20.737 02:42:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:20.737 02:42:45 -- scripts/common.sh@367 -- # return 0 00:31:20.737 02:42:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:20.737 02:42:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:20.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:20.737 --rc genhtml_branch_coverage=1 00:31:20.737 --rc genhtml_function_coverage=1 00:31:20.737 --rc genhtml_legend=1 00:31:20.737 --rc geninfo_all_blocks=1 00:31:20.737 --rc geninfo_unexecuted_blocks=1 00:31:20.737 00:31:20.737 ' 00:31:20.737 02:42:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:20.737 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:20.737 --rc genhtml_branch_coverage=1 00:31:20.738 --rc genhtml_function_coverage=1 00:31:20.738 --rc genhtml_legend=1 00:31:20.738 --rc geninfo_all_blocks=1 00:31:20.738 --rc geninfo_unexecuted_blocks=1 00:31:20.738 00:31:20.738 ' 00:31:20.738 02:42:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:20.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:20.738 --rc genhtml_branch_coverage=1 00:31:20.738 --rc genhtml_function_coverage=1 00:31:20.738 --rc genhtml_legend=1 00:31:20.738 --rc geninfo_all_blocks=1 00:31:20.738 --rc geninfo_unexecuted_blocks=1 00:31:20.738 00:31:20.738 ' 00:31:20.738 02:42:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:20.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:20.738 --rc genhtml_branch_coverage=1 00:31:20.738 --rc genhtml_function_coverage=1 00:31:20.738 --rc genhtml_legend=1 00:31:20.738 --rc geninfo_all_blocks=1 00:31:20.738 --rc geninfo_unexecuted_blocks=1 00:31:20.738 00:31:20.738 ' 00:31:20.738 02:42:45 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:20.738 02:42:45 -- nvmf/common.sh@7 -- # uname -s 00:31:20.738 02:42:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:20.738 02:42:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:20.738 02:42:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:20.738 02:42:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:20.738 02:42:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:20.738 02:42:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:20.738 02:42:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:20.738 02:42:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:20.738 02:42:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:20.738 02:42:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:20.738 02:42:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:20.738 02:42:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:20.738 02:42:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:20.738 02:42:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:20.738 02:42:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:20.738 02:42:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:20.738 02:42:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:20.738 02:42:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:20.738 02:42:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:20.738 02:42:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.738 02:42:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.738 02:42:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.738 02:42:45 -- paths/export.sh@5 -- # export PATH 00:31:20.738 02:42:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.738 02:42:45 -- nvmf/common.sh@46 -- # : 0 00:31:20.738 02:42:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:20.738 02:42:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:20.738 02:42:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:20.738 02:42:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:20.738 02:42:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:20.738 02:42:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:20.738 02:42:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:20.738 02:42:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:20.738 02:42:45 -- target/dif.sh@15 -- # NULL_META=16 00:31:20.738 02:42:45 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:20.738 02:42:45 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:20.738 02:42:45 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:20.738 02:42:45 -- target/dif.sh@135 -- # nvmftestinit 00:31:20.738 02:42:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:20.738 02:42:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:20.738 02:42:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:20.738 02:42:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:20.738 02:42:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:20.738 02:42:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:20.738 02:42:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:20.738 02:42:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:20.738 02:42:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:20.738 02:42:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:20.738 02:42:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:20.738 02:42:45 -- common/autotest_common.sh@10 -- # set +x 00:31:22.641 02:42:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:22.641 02:42:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:22.642 02:42:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:22.642 02:42:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:22.642 02:42:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:22.642 02:42:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:22.642 02:42:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:22.642 02:42:47 -- nvmf/common.sh@294 -- # net_devs=() 00:31:22.642 02:42:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:22.642 02:42:47 -- nvmf/common.sh@295 -- # e810=() 00:31:22.642 02:42:47 -- nvmf/common.sh@295 -- # local -ga e810 00:31:22.642 02:42:47 -- nvmf/common.sh@296 -- # x722=() 00:31:22.642 02:42:47 -- nvmf/common.sh@296 -- # local -ga x722 00:31:22.642 02:42:47 -- nvmf/common.sh@297 -- # mlx=() 00:31:22.642 02:42:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:22.642 02:42:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:22.642 02:42:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:22.642 02:42:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:22.642 02:42:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:22.642 02:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:22.642 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:22.642 02:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:22.642 02:42:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:22.642 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:22.642 02:42:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:22.642 02:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:22.642 02:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:22.642 02:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:22.642 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:22.642 02:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:22.642 02:42:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:22.642 02:42:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:22.642 02:42:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:22.642 02:42:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:22.642 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:22.642 02:42:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:22.642 02:42:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:22.642 02:42:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:22.642 02:42:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:22.642 02:42:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:22.642 02:42:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:22.642 02:42:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:22.642 02:42:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:22.642 02:42:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:22.642 02:42:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:22.642 02:42:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:22.642 02:42:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:22.642 02:42:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:22.642 02:42:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:22.642 02:42:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:22.642 02:42:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:22.642 02:42:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:22.642 02:42:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:22.642 02:42:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:22.642 02:42:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:22.642 02:42:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:22.901 02:42:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:22.901 02:42:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:22.901 02:42:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:22.901 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:22.901 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:31:22.901 00:31:22.901 --- 10.0.0.2 ping statistics --- 00:31:22.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:22.901 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:31:22.901 02:42:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:22.901 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:22.901 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:31:22.901 00:31:22.901 --- 10.0.0.1 ping statistics --- 00:31:22.901 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:22.901 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:31:22.901 02:42:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:22.901 02:42:47 -- nvmf/common.sh@410 -- # return 0 00:31:22.901 02:42:47 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:22.901 02:42:47 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:23.836 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:23.836 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:23.836 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:24.094 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:24.094 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:24.094 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:24.094 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:24.094 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:24.094 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:24.094 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:24.094 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:24.094 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:24.094 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:24.094 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:24.094 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:24.094 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:24.094 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:24.094 02:42:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:24.094 02:42:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:24.094 02:42:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:24.094 02:42:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:24.094 02:42:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:24.094 02:42:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:24.094 02:42:48 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:24.094 02:42:48 -- target/dif.sh@137 -- # nvmfappstart 00:31:24.094 02:42:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:24.094 02:42:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:24.094 02:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:24.095 02:42:48 -- nvmf/common.sh@469 -- # nvmfpid=2212590 00:31:24.095 02:42:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:24.095 02:42:48 -- nvmf/common.sh@470 -- # waitforlisten 2212590 00:31:24.095 02:42:48 -- common/autotest_common.sh@829 -- # '[' -z 2212590 ']' 00:31:24.095 02:42:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:24.095 02:42:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:24.095 02:42:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:24.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:24.095 02:42:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:24.095 02:42:48 -- common/autotest_common.sh@10 -- # set +x 00:31:24.095 [2024-11-27 02:42:48.724387] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:24.095 [2024-11-27 02:42:48.724459] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:24.353 EAL: No free 2048 kB hugepages reported on node 1 00:31:24.353 [2024-11-27 02:42:48.791827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:24.353 [2024-11-27 02:42:48.881192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:24.353 [2024-11-27 02:42:48.881365] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:24.353 [2024-11-27 02:42:48.881385] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:24.353 [2024-11-27 02:42:48.881399] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:24.353 [2024-11-27 02:42:48.881430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:25.286 02:42:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:25.286 02:42:49 -- common/autotest_common.sh@862 -- # return 0 00:31:25.286 02:42:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:25.286 02:42:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 02:42:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:25.286 02:42:49 -- target/dif.sh@139 -- # create_transport 00:31:25.286 02:42:49 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:25.286 02:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 [2024-11-27 02:42:49.748046] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:25.286 02:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.286 02:42:49 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:25.286 02:42:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:25.286 02:42:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 ************************************ 00:31:25.286 START TEST fio_dif_1_default 00:31:25.286 ************************************ 00:31:25.286 02:42:49 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:25.286 02:42:49 -- target/dif.sh@86 -- # create_subsystems 0 00:31:25.286 02:42:49 -- target/dif.sh@28 -- # local sub 00:31:25.286 02:42:49 -- target/dif.sh@30 -- # for sub in "$@" 00:31:25.286 02:42:49 -- target/dif.sh@31 -- # create_subsystem 0 00:31:25.286 02:42:49 -- target/dif.sh@18 -- # local sub_id=0 00:31:25.286 02:42:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:25.286 02:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 bdev_null0 00:31:25.286 02:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.286 02:42:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:25.286 02:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 02:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.286 02:42:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:25.286 02:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 02:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.286 02:42:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:25.286 02:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:25.286 02:42:49 -- common/autotest_common.sh@10 -- # set +x 00:31:25.286 [2024-11-27 02:42:49.784319] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:25.286 02:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:25.286 02:42:49 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:25.286 02:42:49 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:25.286 02:42:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:25.286 02:42:49 -- nvmf/common.sh@520 -- # config=() 00:31:25.286 02:42:49 -- nvmf/common.sh@520 -- # local subsystem config 00:31:25.286 02:42:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:25.286 02:42:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:25.286 { 00:31:25.286 "params": { 00:31:25.286 "name": "Nvme$subsystem", 00:31:25.286 "trtype": "$TEST_TRANSPORT", 00:31:25.286 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:25.286 "adrfam": "ipv4", 00:31:25.286 "trsvcid": "$NVMF_PORT", 00:31:25.286 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:25.286 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:25.286 "hdgst": ${hdgst:-false}, 00:31:25.286 "ddgst": ${ddgst:-false} 00:31:25.286 }, 00:31:25.286 "method": "bdev_nvme_attach_controller" 00:31:25.286 } 00:31:25.286 EOF 00:31:25.286 )") 00:31:25.286 02:42:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:25.286 02:42:49 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:25.286 02:42:49 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:25.286 02:42:49 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:25.286 02:42:49 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:25.286 02:42:49 -- target/dif.sh@82 -- # gen_fio_conf 00:31:25.286 02:42:49 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:25.286 02:42:49 -- common/autotest_common.sh@1330 -- # shift 00:31:25.286 02:42:49 -- target/dif.sh@54 -- # local file 00:31:25.286 02:42:49 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:25.286 02:42:49 -- target/dif.sh@56 -- # cat 00:31:25.286 02:42:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:25.286 02:42:49 -- nvmf/common.sh@542 -- # cat 00:31:25.286 02:42:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:25.286 02:42:49 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:25.286 02:42:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:25.286 02:42:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:25.286 02:42:49 -- target/dif.sh@72 -- # (( file <= files )) 00:31:25.287 02:42:49 -- nvmf/common.sh@544 -- # jq . 00:31:25.287 02:42:49 -- nvmf/common.sh@545 -- # IFS=, 00:31:25.287 02:42:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:25.287 "params": { 00:31:25.287 "name": "Nvme0", 00:31:25.287 "trtype": "tcp", 00:31:25.287 "traddr": "10.0.0.2", 00:31:25.287 "adrfam": "ipv4", 00:31:25.287 "trsvcid": "4420", 00:31:25.287 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:25.287 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:25.287 "hdgst": false, 00:31:25.287 "ddgst": false 00:31:25.287 }, 00:31:25.287 "method": "bdev_nvme_attach_controller" 00:31:25.287 }' 00:31:25.287 02:42:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:25.287 02:42:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:25.287 02:42:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:25.287 02:42:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:25.287 02:42:49 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:25.287 02:42:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:25.287 02:42:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:25.287 02:42:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:25.287 02:42:49 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:25.287 02:42:49 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:25.545 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:25.545 fio-3.35 00:31:25.545 Starting 1 thread 00:31:25.545 EAL: No free 2048 kB hugepages reported on node 1 00:31:26.112 [2024-11-27 02:42:50.543426] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:26.112 [2024-11-27 02:42:50.543480] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:36.085 00:31:36.085 filename0: (groupid=0, jobs=1): err= 0: pid=2212955: Wed Nov 27 02:43:00 2024 00:31:36.085 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10008msec) 00:31:36.085 slat (nsec): min=4078, max=65513, avg=8287.72, stdev=2726.07 00:31:36.085 clat (usec): min=535, max=49215, avg=21086.51, stdev=20441.20 00:31:36.085 lat (usec): min=542, max=49241, avg=21094.80, stdev=20440.98 00:31:36.085 clat percentiles (usec): 00:31:36.085 | 1.00th=[ 545], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 562], 00:31:36.085 | 30.00th=[ 570], 40.00th=[ 578], 50.00th=[41157], 60.00th=[41157], 00:31:36.085 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:36.085 | 99.00th=[42206], 99.50th=[42206], 99.90th=[49021], 99.95th=[49021], 00:31:36.085 | 99.99th=[49021] 00:31:36.085 bw ( KiB/s): min= 672, max= 768, per=99.76%, avg=756.80, stdev=28.00, samples=20 00:31:36.085 iops : min= 168, max= 192, avg=189.20, stdev= 7.00, samples=20 00:31:36.085 lat (usec) : 750=49.79% 00:31:36.085 lat (msec) : 50=50.21% 00:31:36.085 cpu : usr=91.93%, sys=7.78%, ctx=16, majf=0, minf=330 00:31:36.085 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:36.085 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.085 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:36.085 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:36.085 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:36.085 00:31:36.085 Run status group 0 (all jobs): 00:31:36.085 READ: bw=758KiB/s (776kB/s), 758KiB/s-758KiB/s (776kB/s-776kB/s), io=7584KiB (7766kB), run=10008-10008msec 00:31:36.343 02:43:00 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:36.343 02:43:00 -- target/dif.sh@43 -- # local sub 00:31:36.343 02:43:00 -- target/dif.sh@45 -- # for sub in "$@" 00:31:36.343 02:43:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:36.343 02:43:00 -- target/dif.sh@36 -- # local sub_id=0 00:31:36.343 02:43:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:36.343 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.343 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.343 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.343 02:43:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:36.343 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.343 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.343 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.343 00:31:36.343 real 0m11.124s 00:31:36.343 user 0m10.294s 00:31:36.343 sys 0m1.028s 00:31:36.343 02:43:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:36.343 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.343 ************************************ 00:31:36.343 END TEST fio_dif_1_default 00:31:36.343 ************************************ 00:31:36.343 02:43:00 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:36.343 02:43:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:36.343 02:43:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:36.343 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.343 ************************************ 00:31:36.343 START TEST fio_dif_1_multi_subsystems 00:31:36.343 ************************************ 00:31:36.343 02:43:00 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:36.343 02:43:00 -- target/dif.sh@92 -- # local files=1 00:31:36.343 02:43:00 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:36.343 02:43:00 -- target/dif.sh@28 -- # local sub 00:31:36.343 02:43:00 -- target/dif.sh@30 -- # for sub in "$@" 00:31:36.343 02:43:00 -- target/dif.sh@31 -- # create_subsystem 0 00:31:36.343 02:43:00 -- target/dif.sh@18 -- # local sub_id=0 00:31:36.343 02:43:00 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 bdev_null0 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 [2024-11-27 02:43:00.941135] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@30 -- # for sub in "$@" 00:31:36.344 02:43:00 -- target/dif.sh@31 -- # create_subsystem 1 00:31:36.344 02:43:00 -- target/dif.sh@18 -- # local sub_id=1 00:31:36.344 02:43:00 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 bdev_null1 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.344 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.344 02:43:00 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:36.344 02:43:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:36.344 02:43:00 -- common/autotest_common.sh@10 -- # set +x 00:31:36.602 02:43:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:36.602 02:43:00 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:36.602 02:43:00 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.602 02:43:00 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:36.602 02:43:00 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.602 02:43:00 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:36.602 02:43:00 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:36.602 02:43:00 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:36.602 02:43:00 -- nvmf/common.sh@520 -- # config=() 00:31:36.602 02:43:00 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:36.602 02:43:00 -- target/dif.sh@82 -- # gen_fio_conf 00:31:36.602 02:43:00 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.602 02:43:00 -- nvmf/common.sh@520 -- # local subsystem config 00:31:36.602 02:43:00 -- target/dif.sh@54 -- # local file 00:31:36.602 02:43:00 -- common/autotest_common.sh@1330 -- # shift 00:31:36.602 02:43:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:36.602 02:43:00 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:36.602 02:43:00 -- target/dif.sh@56 -- # cat 00:31:36.602 02:43:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:36.602 { 00:31:36.602 "params": { 00:31:36.602 "name": "Nvme$subsystem", 00:31:36.602 "trtype": "$TEST_TRANSPORT", 00:31:36.602 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:36.602 "adrfam": "ipv4", 00:31:36.602 "trsvcid": "$NVMF_PORT", 00:31:36.602 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:36.602 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:36.602 "hdgst": ${hdgst:-false}, 00:31:36.602 "ddgst": ${ddgst:-false} 00:31:36.602 }, 00:31:36.602 "method": "bdev_nvme_attach_controller" 00:31:36.602 } 00:31:36.602 EOF 00:31:36.602 )") 00:31:36.602 02:43:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:36.602 02:43:00 -- nvmf/common.sh@542 -- # cat 00:31:36.602 02:43:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.602 02:43:00 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:36.602 02:43:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:36.602 02:43:00 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:36.602 02:43:00 -- target/dif.sh@72 -- # (( file <= files )) 00:31:36.602 02:43:00 -- target/dif.sh@73 -- # cat 00:31:36.602 02:43:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:36.602 02:43:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:36.602 { 00:31:36.602 "params": { 00:31:36.602 "name": "Nvme$subsystem", 00:31:36.602 "trtype": "$TEST_TRANSPORT", 00:31:36.602 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:36.602 "adrfam": "ipv4", 00:31:36.602 "trsvcid": "$NVMF_PORT", 00:31:36.602 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:36.602 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:36.602 "hdgst": ${hdgst:-false}, 00:31:36.602 "ddgst": ${ddgst:-false} 00:31:36.602 }, 00:31:36.602 "method": "bdev_nvme_attach_controller" 00:31:36.602 } 00:31:36.602 EOF 00:31:36.602 )") 00:31:36.602 02:43:00 -- target/dif.sh@72 -- # (( file++ )) 00:31:36.602 02:43:00 -- target/dif.sh@72 -- # (( file <= files )) 00:31:36.602 02:43:00 -- nvmf/common.sh@542 -- # cat 00:31:36.602 02:43:00 -- nvmf/common.sh@544 -- # jq . 00:31:36.602 02:43:00 -- nvmf/common.sh@545 -- # IFS=, 00:31:36.602 02:43:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:36.602 "params": { 00:31:36.602 "name": "Nvme0", 00:31:36.602 "trtype": "tcp", 00:31:36.602 "traddr": "10.0.0.2", 00:31:36.602 "adrfam": "ipv4", 00:31:36.602 "trsvcid": "4420", 00:31:36.602 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:36.602 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:36.602 "hdgst": false, 00:31:36.602 "ddgst": false 00:31:36.602 }, 00:31:36.602 "method": "bdev_nvme_attach_controller" 00:31:36.602 },{ 00:31:36.602 "params": { 00:31:36.602 "name": "Nvme1", 00:31:36.602 "trtype": "tcp", 00:31:36.602 "traddr": "10.0.0.2", 00:31:36.603 "adrfam": "ipv4", 00:31:36.603 "trsvcid": "4420", 00:31:36.603 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:36.603 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:36.603 "hdgst": false, 00:31:36.603 "ddgst": false 00:31:36.603 }, 00:31:36.603 "method": "bdev_nvme_attach_controller" 00:31:36.603 }' 00:31:36.603 02:43:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:36.603 02:43:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:36.603 02:43:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:36.603 02:43:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:36.603 02:43:01 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:36.603 02:43:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:36.603 02:43:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:36.603 02:43:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:36.603 02:43:01 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:36.603 02:43:01 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.861 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:36.862 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:36.862 fio-3.35 00:31:36.862 Starting 2 threads 00:31:36.862 EAL: No free 2048 kB hugepages reported on node 1 00:31:37.427 [2024-11-27 02:43:01.892781] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:37.427 [2024-11-27 02:43:01.892863] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:49.618 00:31:49.618 filename0: (groupid=0, jobs=1): err= 0: pid=2214392: Wed Nov 27 02:43:12 2024 00:31:49.618 read: IOPS=98, BW=393KiB/s (403kB/s)(3936KiB/10010msec) 00:31:49.618 slat (nsec): min=6956, max=74953, avg=8935.35, stdev=3434.65 00:31:49.618 clat (usec): min=586, max=44389, avg=40660.75, stdev=3634.08 00:31:49.618 lat (usec): min=594, max=44426, avg=40669.69, stdev=3633.44 00:31:49.618 clat percentiles (usec): 00:31:49.618 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:49.618 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:49.618 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:49.618 | 99.00th=[41157], 99.50th=[41157], 99.90th=[44303], 99.95th=[44303], 00:31:49.618 | 99.99th=[44303] 00:31:49.618 bw ( KiB/s): min= 383, max= 416, per=49.73%, avg=391.95, stdev=14.25, samples=20 00:31:49.618 iops : min= 95, max= 104, avg=97.95, stdev= 3.59, samples=20 00:31:49.618 lat (usec) : 750=0.81% 00:31:49.618 lat (msec) : 50=99.19% 00:31:49.618 cpu : usr=95.49%, sys=4.20%, ctx=12, majf=0, minf=240 00:31:49.618 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:49.618 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.618 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.618 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.618 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:49.618 filename1: (groupid=0, jobs=1): err= 0: pid=2214393: Wed Nov 27 02:43:12 2024 00:31:49.618 read: IOPS=98, BW=393KiB/s (403kB/s)(3936KiB/10012msec) 00:31:49.618 slat (nsec): min=6957, max=27274, avg=8857.08, stdev=2484.07 00:31:49.618 clat (usec): min=572, max=46344, avg=40669.65, stdev=3646.73 00:31:49.618 lat (usec): min=580, max=46365, avg=40678.51, stdev=3646.74 00:31:49.618 clat percentiles (usec): 00:31:49.618 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:49.618 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:49.618 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:49.618 | 99.00th=[41157], 99.50th=[41681], 99.90th=[46400], 99.95th=[46400], 00:31:49.618 | 99.99th=[46400] 00:31:49.619 bw ( KiB/s): min= 384, max= 448, per=49.86%, avg=392.00, stdev=17.60, samples=20 00:31:49.619 iops : min= 96, max= 112, avg=98.00, stdev= 4.40, samples=20 00:31:49.619 lat (usec) : 750=0.81% 00:31:49.619 lat (msec) : 50=99.19% 00:31:49.619 cpu : usr=95.26%, sys=4.44%, ctx=12, majf=0, minf=120 00:31:49.619 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:49.619 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.619 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:49.619 issued rwts: total=984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:49.619 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:49.619 00:31:49.619 Run status group 0 (all jobs): 00:31:49.619 READ: bw=786KiB/s (805kB/s), 393KiB/s-393KiB/s (403kB/s-403kB/s), io=7872KiB (8061kB), run=10010-10012msec 00:31:49.619 02:43:12 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:49.619 02:43:12 -- target/dif.sh@43 -- # local sub 00:31:49.619 02:43:12 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.619 02:43:12 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:49.619 02:43:12 -- target/dif.sh@36 -- # local sub_id=0 00:31:49.619 02:43:12 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@45 -- # for sub in "$@" 00:31:49.619 02:43:12 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:49.619 02:43:12 -- target/dif.sh@36 -- # local sub_id=1 00:31:49.619 02:43:12 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 00:31:49.619 real 0m11.425s 00:31:49.619 user 0m20.509s 00:31:49.619 sys 0m1.178s 00:31:49.619 02:43:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 ************************************ 00:31:49.619 END TEST fio_dif_1_multi_subsystems 00:31:49.619 ************************************ 00:31:49.619 02:43:12 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:49.619 02:43:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:49.619 02:43:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 ************************************ 00:31:49.619 START TEST fio_dif_rand_params 00:31:49.619 ************************************ 00:31:49.619 02:43:12 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:49.619 02:43:12 -- target/dif.sh@100 -- # local NULL_DIF 00:31:49.619 02:43:12 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:49.619 02:43:12 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:49.619 02:43:12 -- target/dif.sh@103 -- # bs=128k 00:31:49.619 02:43:12 -- target/dif.sh@103 -- # numjobs=3 00:31:49.619 02:43:12 -- target/dif.sh@103 -- # iodepth=3 00:31:49.619 02:43:12 -- target/dif.sh@103 -- # runtime=5 00:31:49.619 02:43:12 -- target/dif.sh@105 -- # create_subsystems 0 00:31:49.619 02:43:12 -- target/dif.sh@28 -- # local sub 00:31:49.619 02:43:12 -- target/dif.sh@30 -- # for sub in "$@" 00:31:49.619 02:43:12 -- target/dif.sh@31 -- # create_subsystem 0 00:31:49.619 02:43:12 -- target/dif.sh@18 -- # local sub_id=0 00:31:49.619 02:43:12 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 bdev_null0 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:49.619 02:43:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:49.619 02:43:12 -- common/autotest_common.sh@10 -- # set +x 00:31:49.619 [2024-11-27 02:43:12.392304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:49.619 02:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:49.619 02:43:12 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:49.619 02:43:12 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:49.619 02:43:12 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:49.619 02:43:12 -- nvmf/common.sh@520 -- # config=() 00:31:49.619 02:43:12 -- nvmf/common.sh@520 -- # local subsystem config 00:31:49.619 02:43:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:49.619 02:43:12 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.619 02:43:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:49.619 { 00:31:49.619 "params": { 00:31:49.619 "name": "Nvme$subsystem", 00:31:49.619 "trtype": "$TEST_TRANSPORT", 00:31:49.619 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:49.619 "adrfam": "ipv4", 00:31:49.619 "trsvcid": "$NVMF_PORT", 00:31:49.619 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:49.619 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:49.619 "hdgst": ${hdgst:-false}, 00:31:49.619 "ddgst": ${ddgst:-false} 00:31:49.619 }, 00:31:49.619 "method": "bdev_nvme_attach_controller" 00:31:49.619 } 00:31:49.619 EOF 00:31:49.619 )") 00:31:49.619 02:43:12 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.619 02:43:12 -- target/dif.sh@82 -- # gen_fio_conf 00:31:49.619 02:43:12 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:49.619 02:43:12 -- target/dif.sh@54 -- # local file 00:31:49.619 02:43:12 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:49.619 02:43:12 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:49.619 02:43:12 -- target/dif.sh@56 -- # cat 00:31:49.619 02:43:12 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.619 02:43:12 -- common/autotest_common.sh@1330 -- # shift 00:31:49.619 02:43:12 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:49.619 02:43:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.619 02:43:12 -- nvmf/common.sh@542 -- # cat 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.619 02:43:12 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:49.619 02:43:12 -- target/dif.sh@72 -- # (( file <= files )) 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:49.619 02:43:12 -- nvmf/common.sh@544 -- # jq . 00:31:49.619 02:43:12 -- nvmf/common.sh@545 -- # IFS=, 00:31:49.619 02:43:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:49.619 "params": { 00:31:49.619 "name": "Nvme0", 00:31:49.619 "trtype": "tcp", 00:31:49.619 "traddr": "10.0.0.2", 00:31:49.619 "adrfam": "ipv4", 00:31:49.619 "trsvcid": "4420", 00:31:49.619 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:49.619 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:49.619 "hdgst": false, 00:31:49.619 "ddgst": false 00:31:49.619 }, 00:31:49.619 "method": "bdev_nvme_attach_controller" 00:31:49.619 }' 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:49.619 02:43:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:49.619 02:43:12 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:49.619 02:43:12 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:49.619 02:43:12 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:49.619 02:43:12 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:49.619 02:43:12 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:49.619 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:49.619 ... 00:31:49.619 fio-3.35 00:31:49.619 Starting 3 threads 00:31:49.619 EAL: No free 2048 kB hugepages reported on node 1 00:31:49.619 [2024-11-27 02:43:13.013863] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:49.619 [2024-11-27 02:43:13.013938] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:53.880 00:31:53.880 filename0: (groupid=0, jobs=1): err= 0: pid=2215828: Wed Nov 27 02:43:18 2024 00:31:53.880 read: IOPS=216, BW=27.1MiB/s (28.4MB/s)(137MiB/5045msec) 00:31:53.880 slat (nsec): min=7233, max=38799, avg=13399.42, stdev=3362.32 00:31:53.880 clat (usec): min=4724, max=57223, avg=13803.76, stdev=7416.06 00:31:53.880 lat (usec): min=4735, max=57235, avg=13817.16, stdev=7415.79 00:31:53.880 clat percentiles (usec): 00:31:53.880 | 1.00th=[ 5342], 5.00th=[ 8356], 10.00th=[ 9241], 20.00th=[11207], 00:31:53.880 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12649], 60.00th=[13173], 00:31:53.880 | 70.00th=[13698], 80.00th=[14484], 90.00th=[15401], 95.00th=[16712], 00:31:53.880 | 99.00th=[52167], 99.50th=[53740], 99.90th=[55837], 99.95th=[57410], 00:31:53.880 | 99.99th=[57410] 00:31:53.880 bw ( KiB/s): min=20480, max=33024, per=32.18%, avg=27878.40, stdev=3631.33, samples=10 00:31:53.880 iops : min= 160, max= 258, avg=217.80, stdev=28.37, samples=10 00:31:53.880 lat (msec) : 10=12.64%, 20=83.88%, 50=0.73%, 100=2.75% 00:31:53.880 cpu : usr=93.36%, sys=6.17%, ctx=25, majf=0, minf=90 00:31:53.880 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.880 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.880 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.880 issued rwts: total=1092,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.880 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:53.880 filename0: (groupid=0, jobs=1): err= 0: pid=2215829: Wed Nov 27 02:43:18 2024 00:31:53.880 read: IOPS=243, BW=30.4MiB/s (31.9MB/s)(153MiB/5029msec) 00:31:53.880 slat (usec): min=7, max=126, avg=12.81, stdev= 4.07 00:31:53.880 clat (usec): min=4733, max=54382, avg=12315.75, stdev=5598.33 00:31:53.880 lat (usec): min=4741, max=54394, avg=12328.56, stdev=5598.34 00:31:53.880 clat percentiles (usec): 00:31:53.880 | 1.00th=[ 5342], 5.00th=[ 8094], 10.00th=[ 8717], 20.00th=[10552], 00:31:53.880 | 30.00th=[11207], 40.00th=[11731], 50.00th=[11994], 60.00th=[12256], 00:31:53.880 | 70.00th=[12649], 80.00th=[13042], 90.00th=[13566], 95.00th=[14091], 00:31:53.880 | 99.00th=[49546], 99.50th=[51643], 99.90th=[54264], 99.95th=[54264], 00:31:53.880 | 99.99th=[54264] 00:31:53.880 bw ( KiB/s): min=24625, max=35072, per=36.06%, avg=31236.90, stdev=2990.42, samples=10 00:31:53.880 iops : min= 192, max= 274, avg=244.00, stdev=23.46, samples=10 00:31:53.881 lat (msec) : 10=16.68%, 20=81.36%, 50=1.31%, 100=0.65% 00:31:53.881 cpu : usr=93.50%, sys=5.95%, ctx=16, majf=0, minf=165 00:31:53.881 IO depths : 1=1.1%, 2=98.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.881 issued rwts: total=1223,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.881 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:53.881 filename0: (groupid=0, jobs=1): err= 0: pid=2215830: Wed Nov 27 02:43:18 2024 00:31:53.881 read: IOPS=219, BW=27.5MiB/s (28.8MB/s)(137MiB/5003msec) 00:31:53.881 slat (usec): min=6, max=112, avg=12.41, stdev= 3.63 00:31:53.881 clat (usec): min=4667, max=56714, avg=13639.50, stdev=7287.48 00:31:53.881 lat (usec): min=4678, max=56732, avg=13651.91, stdev=7287.59 00:31:53.881 clat percentiles (usec): 00:31:53.881 | 1.00th=[ 5211], 5.00th=[ 8356], 10.00th=[ 9372], 20.00th=[11600], 00:31:53.881 | 30.00th=[11994], 40.00th=[12387], 50.00th=[12649], 60.00th=[13042], 00:31:53.881 | 70.00th=[13435], 80.00th=[13829], 90.00th=[14615], 95.00th=[15533], 00:31:53.881 | 99.00th=[53216], 99.50th=[54789], 99.90th=[55837], 99.95th=[56886], 00:31:53.881 | 99.99th=[56886] 00:31:53.881 bw ( KiB/s): min=21504, max=31744, per=32.42%, avg=28083.20, stdev=3797.19, samples=10 00:31:53.881 iops : min= 168, max= 248, avg=219.40, stdev=29.67, samples=10 00:31:53.881 lat (msec) : 10=12.19%, 20=84.53%, 50=1.00%, 100=2.27% 00:31:53.881 cpu : usr=93.24%, sys=6.26%, ctx=17, majf=0, minf=151 00:31:53.881 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.881 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.881 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.881 issued rwts: total=1099,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.881 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:53.881 00:31:53.881 Run status group 0 (all jobs): 00:31:53.881 READ: bw=84.6MiB/s (88.7MB/s), 27.1MiB/s-30.4MiB/s (28.4MB/s-31.9MB/s), io=427MiB (447MB), run=5003-5045msec 00:31:53.881 02:43:18 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:53.881 02:43:18 -- target/dif.sh@43 -- # local sub 00:31:53.881 02:43:18 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.881 02:43:18 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:53.881 02:43:18 -- target/dif.sh@36 -- # local sub_id=0 00:31:53.881 02:43:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # bs=4k 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # numjobs=8 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # iodepth=16 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # runtime= 00:31:53.881 02:43:18 -- target/dif.sh@109 -- # files=2 00:31:53.881 02:43:18 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:53.881 02:43:18 -- target/dif.sh@28 -- # local sub 00:31:53.881 02:43:18 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.881 02:43:18 -- target/dif.sh@31 -- # create_subsystem 0 00:31:53.881 02:43:18 -- target/dif.sh@18 -- # local sub_id=0 00:31:53.881 02:43:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 bdev_null0 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 [2024-11-27 02:43:18.421656] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.881 02:43:18 -- target/dif.sh@31 -- # create_subsystem 1 00:31:53.881 02:43:18 -- target/dif.sh@18 -- # local sub_id=1 00:31:53.881 02:43:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 bdev_null1 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.881 02:43:18 -- target/dif.sh@31 -- # create_subsystem 2 00:31:53.881 02:43:18 -- target/dif.sh@18 -- # local sub_id=2 00:31:53.881 02:43:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 bdev_null2 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:53.881 02:43:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:53.881 02:43:18 -- common/autotest_common.sh@10 -- # set +x 00:31:53.881 02:43:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:53.881 02:43:18 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:53.881 02:43:18 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:53.881 02:43:18 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:53.881 02:43:18 -- nvmf/common.sh@520 -- # config=() 00:31:53.881 02:43:18 -- nvmf/common.sh@520 -- # local subsystem config 00:31:53.881 02:43:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.881 02:43:18 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.881 { 00:31:53.881 "params": { 00:31:53.881 "name": "Nvme$subsystem", 00:31:53.881 "trtype": "$TEST_TRANSPORT", 00:31:53.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.881 "adrfam": "ipv4", 00:31:53.881 "trsvcid": "$NVMF_PORT", 00:31:53.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.881 "hdgst": ${hdgst:-false}, 00:31:53.881 "ddgst": ${ddgst:-false} 00:31:53.881 }, 00:31:53.881 "method": "bdev_nvme_attach_controller" 00:31:53.881 } 00:31:53.881 EOF 00:31:53.881 )") 00:31:53.881 02:43:18 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.881 02:43:18 -- target/dif.sh@82 -- # gen_fio_conf 00:31:53.881 02:43:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:53.881 02:43:18 -- target/dif.sh@54 -- # local file 00:31:53.881 02:43:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:53.881 02:43:18 -- target/dif.sh@56 -- # cat 00:31:53.881 02:43:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:53.881 02:43:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.881 02:43:18 -- common/autotest_common.sh@1330 -- # shift 00:31:53.881 02:43:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # cat 00:31:53.881 02:43:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.881 02:43:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.881 02:43:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:53.881 02:43:18 -- target/dif.sh@73 -- # cat 00:31:53.881 02:43:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.881 02:43:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.881 { 00:31:53.881 "params": { 00:31:53.881 "name": "Nvme$subsystem", 00:31:53.881 "trtype": "$TEST_TRANSPORT", 00:31:53.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.881 "adrfam": "ipv4", 00:31:53.881 "trsvcid": "$NVMF_PORT", 00:31:53.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.881 "hdgst": ${hdgst:-false}, 00:31:53.881 "ddgst": ${ddgst:-false} 00:31:53.881 }, 00:31:53.881 "method": "bdev_nvme_attach_controller" 00:31:53.881 } 00:31:53.881 EOF 00:31:53.881 )") 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # cat 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file++ )) 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.881 02:43:18 -- target/dif.sh@73 -- # cat 00:31:53.881 02:43:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.881 { 00:31:53.881 "params": { 00:31:53.881 "name": "Nvme$subsystem", 00:31:53.881 "trtype": "$TEST_TRANSPORT", 00:31:53.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.881 "adrfam": "ipv4", 00:31:53.881 "trsvcid": "$NVMF_PORT", 00:31:53.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.881 "hdgst": ${hdgst:-false}, 00:31:53.881 "ddgst": ${ddgst:-false} 00:31:53.881 }, 00:31:53.881 "method": "bdev_nvme_attach_controller" 00:31:53.881 } 00:31:53.881 EOF 00:31:53.881 )") 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file++ )) 00:31:53.881 02:43:18 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.881 02:43:18 -- nvmf/common.sh@542 -- # cat 00:31:53.881 02:43:18 -- nvmf/common.sh@544 -- # jq . 00:31:53.881 02:43:18 -- nvmf/common.sh@545 -- # IFS=, 00:31:53.881 02:43:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:53.881 "params": { 00:31:53.881 "name": "Nvme0", 00:31:53.881 "trtype": "tcp", 00:31:53.881 "traddr": "10.0.0.2", 00:31:53.881 "adrfam": "ipv4", 00:31:53.881 "trsvcid": "4420", 00:31:53.881 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:53.881 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:53.881 "hdgst": false, 00:31:53.881 "ddgst": false 00:31:53.881 }, 00:31:53.881 "method": "bdev_nvme_attach_controller" 00:31:53.881 },{ 00:31:53.882 "params": { 00:31:53.882 "name": "Nvme1", 00:31:53.882 "trtype": "tcp", 00:31:53.882 "traddr": "10.0.0.2", 00:31:53.882 "adrfam": "ipv4", 00:31:53.882 "trsvcid": "4420", 00:31:53.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:53.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:53.882 "hdgst": false, 00:31:53.882 "ddgst": false 00:31:53.882 }, 00:31:53.882 "method": "bdev_nvme_attach_controller" 00:31:53.882 },{ 00:31:53.882 "params": { 00:31:53.882 "name": "Nvme2", 00:31:53.882 "trtype": "tcp", 00:31:53.882 "traddr": "10.0.0.2", 00:31:53.882 "adrfam": "ipv4", 00:31:53.882 "trsvcid": "4420", 00:31:53.882 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:53.882 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:53.882 "hdgst": false, 00:31:53.882 "ddgst": false 00:31:53.882 }, 00:31:53.882 "method": "bdev_nvme_attach_controller" 00:31:53.882 }' 00:31:53.882 02:43:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.882 02:43:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.882 02:43:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:54.139 02:43:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.139 02:43:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:54.139 02:43:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:54.139 02:43:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:54.139 02:43:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:54.139 02:43:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:54.139 02:43:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.139 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:54.139 ... 00:31:54.139 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:54.139 ... 00:31:54.139 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:54.139 ... 00:31:54.139 fio-3.35 00:31:54.139 Starting 24 threads 00:31:54.397 EAL: No free 2048 kB hugepages reported on node 1 00:31:55.331 [2024-11-27 02:43:19.631632] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:55.331 [2024-11-27 02:43:19.631690] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:05.308 00:32:05.308 filename0: (groupid=0, jobs=1): err= 0: pid=2216647: Wed Nov 27 02:43:29 2024 00:32:05.308 read: IOPS=52, BW=211KiB/s (216kB/s)(2128KiB/10095msec) 00:32:05.308 slat (usec): min=8, max=136, avg=16.42, stdev=15.43 00:32:05.309 clat (msec): min=137, max=575, avg=302.69, stdev=74.91 00:32:05.309 lat (msec): min=137, max=575, avg=302.71, stdev=74.91 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 138], 5.00th=[ 148], 10.00th=[ 230], 20.00th=[ 257], 00:32:05.309 | 30.00th=[ 264], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 309], 00:32:05.309 | 70.00th=[ 338], 80.00th=[ 376], 90.00th=[ 405], 95.00th=[ 418], 00:32:05.309 | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.309 | 99.99th=[ 575] 00:32:05.309 bw ( KiB/s): min= 128, max= 256, per=4.98%, avg=206.35, stdev=41.43, samples=20 00:32:05.309 iops : min= 32, max= 64, avg=51.55, stdev=10.31, samples=20 00:32:05.309 lat (msec) : 250=16.92%, 500=82.71%, 750=0.38% 00:32:05.309 cpu : usr=98.57%, sys=0.85%, ctx=44, majf=0, minf=68 00:32:05.309 IO depths : 1=1.7%, 2=3.9%, 4=12.6%, 8=70.7%, 16=11.1%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=90.4%, 8=4.4%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=532,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216648: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10058msec) 00:32:05.309 slat (usec): min=14, max=184, avg=45.82, stdev=26.65 00:32:05.309 clat (msec): min=270, max=579, avg=418.67, stdev=74.83 00:32:05.309 lat (msec): min=270, max=579, avg=418.72, stdev=74.82 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.309 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.309 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.309 | 99.00th=[ 575], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.309 | 99.99th=[ 584] 00:32:05.309 bw ( KiB/s): min= 128, max= 256, per=3.73%, avg=154.95, stdev=51.72, samples=19 00:32:05.309 iops : min= 32, max= 64, avg=38.74, stdev=12.93, samples=19 00:32:05.309 lat (msec) : 500=81.77%, 750=18.23% 00:32:05.309 cpu : usr=98.34%, sys=0.95%, ctx=74, majf=0, minf=25 00:32:05.309 IO depths : 1=3.9%, 2=10.2%, 4=25.0%, 8=52.3%, 16=8.6%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216649: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=37, BW=152KiB/s (155kB/s)(1528KiB/10066msec) 00:32:05.309 slat (usec): min=7, max=115, avg=15.65, stdev=16.27 00:32:05.309 clat (msec): min=145, max=800, avg=421.12, stdev=114.25 00:32:05.309 lat (msec): min=145, max=800, avg=421.13, stdev=114.24 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 146], 5.00th=[ 165], 10.00th=[ 292], 20.00th=[ 376], 00:32:05.309 | 30.00th=[ 388], 40.00th=[ 418], 50.00th=[ 439], 60.00th=[ 451], 00:32:05.309 | 70.00th=[ 460], 80.00th=[ 477], 90.00th=[ 506], 95.00th=[ 584], 00:32:05.309 | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], 00:32:05.309 | 99.99th=[ 802] 00:32:05.309 bw ( KiB/s): min= 112, max= 256, per=3.56%, avg=147.15, stdev=43.64, samples=20 00:32:05.309 iops : min= 28, max= 64, avg=36.75, stdev=10.93, samples=20 00:32:05.309 lat (msec) : 250=6.28%, 500=76.44%, 750=14.66%, 1000=2.62% 00:32:05.309 cpu : usr=98.88%, sys=0.72%, ctx=19, majf=0, minf=26 00:32:05.309 IO depths : 1=3.4%, 2=9.4%, 4=24.3%, 8=53.9%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=382,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216650: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10056msec) 00:32:05.309 slat (usec): min=9, max=129, avg=40.47, stdev=19.33 00:32:05.309 clat (msec): min=269, max=570, avg=418.64, stdev=73.64 00:32:05.309 lat (msec): min=269, max=570, avg=418.68, stdev=73.63 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.309 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.309 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.309 | 99.00th=[ 550], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.309 | 99.99th=[ 575] 00:32:05.309 bw ( KiB/s): min= 16, max= 256, per=3.56%, avg=147.20, stdev=57.71, samples=20 00:32:05.309 iops : min= 4, max= 64, avg=36.80, stdev=14.43, samples=20 00:32:05.309 lat (msec) : 500=82.81%, 750=17.19% 00:32:05.309 cpu : usr=98.92%, sys=0.66%, ctx=9, majf=0, minf=27 00:32:05.309 IO depths : 1=3.9%, 2=10.2%, 4=25.0%, 8=52.3%, 16=8.6%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216651: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10060msec) 00:32:05.309 slat (nsec): min=8766, max=55597, avg=33076.15, stdev=8683.08 00:32:05.309 clat (msec): min=230, max=579, avg=418.90, stdev=75.49 00:32:05.309 lat (msec): min=230, max=579, avg=418.93, stdev=75.50 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 264], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.309 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.309 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.309 | 99.00th=[ 575], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.309 | 99.99th=[ 584] 00:32:05.309 bw ( KiB/s): min= 127, max= 256, per=3.56%, avg=147.15, stdev=46.91, samples=20 00:32:05.309 iops : min= 31, max= 64, avg=36.75, stdev=11.75, samples=20 00:32:05.309 lat (msec) : 250=0.52%, 500=81.25%, 750=18.23% 00:32:05.309 cpu : usr=98.81%, sys=0.79%, ctx=21, majf=0, minf=41 00:32:05.309 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216653: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=49, BW=197KiB/s (202kB/s)(1984KiB/10080msec) 00:32:05.309 slat (usec): min=8, max=134, avg=30.74, stdev=33.53 00:32:05.309 clat (msec): min=147, max=698, avg=324.69, stdev=92.68 00:32:05.309 lat (msec): min=147, max=698, avg=324.72, stdev=92.68 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 148], 5.00th=[ 155], 10.00th=[ 171], 20.00th=[ 259], 00:32:05.309 | 30.00th=[ 271], 40.00th=[ 292], 50.00th=[ 317], 60.00th=[ 359], 00:32:05.309 | 70.00th=[ 380], 80.00th=[ 409], 90.00th=[ 435], 95.00th=[ 451], 00:32:05.309 | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 701], 99.95th=[ 701], 00:32:05.309 | 99.99th=[ 701] 00:32:05.309 bw ( KiB/s): min= 128, max= 256, per=4.64%, avg=192.00, stdev=57.57, samples=20 00:32:05.309 iops : min= 32, max= 64, avg=48.00, stdev=14.39, samples=20 00:32:05.309 lat (msec) : 250=17.34%, 500=79.03%, 750=3.63% 00:32:05.309 cpu : usr=98.34%, sys=1.08%, ctx=46, majf=0, minf=32 00:32:05.309 IO depths : 1=2.4%, 2=6.7%, 4=19.0%, 8=61.9%, 16=10.1%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=92.3%, 8=2.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216654: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10074msec) 00:32:05.309 slat (nsec): min=6578, max=99219, avg=36633.71, stdev=14235.97 00:32:05.309 clat (msec): min=148, max=550, avg=402.64, stdev=93.45 00:32:05.309 lat (msec): min=148, max=550, avg=402.68, stdev=93.45 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 148], 5.00th=[ 262], 10.00th=[ 271], 20.00th=[ 309], 00:32:05.309 | 30.00th=[ 380], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.309 | 70.00th=[ 460], 80.00th=[ 477], 90.00th=[ 514], 95.00th=[ 518], 00:32:05.309 | 99.00th=[ 535], 99.50th=[ 542], 99.90th=[ 550], 99.95th=[ 550], 00:32:05.309 | 99.99th=[ 550] 00:32:05.309 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.60, stdev=50.70, samples=20 00:32:05.309 iops : min= 32, max= 64, avg=38.40, stdev=12.68, samples=20 00:32:05.309 lat (msec) : 250=4.00%, 500=80.00%, 750=16.00% 00:32:05.309 cpu : usr=98.87%, sys=0.71%, ctx=30, majf=0, minf=23 00:32:05.309 IO depths : 1=4.5%, 2=10.8%, 4=25.0%, 8=51.7%, 16=8.0%, 32=0.0%, >=64=0.0% 00:32:05.309 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.309 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.309 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.309 filename0: (groupid=0, jobs=1): err= 0: pid=2216655: Wed Nov 27 02:43:29 2024 00:32:05.309 read: IOPS=53, BW=212KiB/s (218kB/s)(2144KiB/10093msec) 00:32:05.309 slat (usec): min=5, max=146, avg=30.04, stdev=30.75 00:32:05.309 clat (msec): min=10, max=512, avg=300.66, stdev=109.22 00:32:05.309 lat (msec): min=10, max=512, avg=300.69, stdev=109.23 00:32:05.309 clat percentiles (msec): 00:32:05.309 | 1.00th=[ 11], 5.00th=[ 39], 10.00th=[ 144], 20.00th=[ 239], 00:32:05.309 | 30.00th=[ 264], 40.00th=[ 292], 50.00th=[ 305], 60.00th=[ 359], 00:32:05.309 | 70.00th=[ 376], 80.00th=[ 397], 90.00th=[ 418], 95.00th=[ 435], 00:32:05.309 | 99.00th=[ 481], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], 00:32:05.309 | 99.99th=[ 514] 00:32:05.309 bw ( KiB/s): min= 128, max= 512, per=5.03%, avg=208.00, stdev=87.94, samples=20 00:32:05.310 iops : min= 32, max= 128, avg=52.00, stdev=21.99, samples=20 00:32:05.310 lat (msec) : 20=2.99%, 50=2.99%, 250=20.15%, 500=73.13%, 750=0.75% 00:32:05.310 cpu : usr=98.37%, sys=1.05%, ctx=63, majf=0, minf=33 00:32:05.310 IO depths : 1=2.6%, 2=6.3%, 4=17.2%, 8=63.8%, 16=10.1%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=91.7%, 8=2.9%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=536,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216656: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=50, BW=203KiB/s (208kB/s)(2048KiB/10073msec) 00:32:05.310 slat (usec): min=8, max=152, avg=35.21, stdev=37.51 00:32:05.310 clat (msec): min=147, max=418, avg=314.47, stdev=93.37 00:32:05.310 lat (msec): min=147, max=418, avg=314.50, stdev=93.38 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 148], 5.00th=[ 155], 10.00th=[ 171], 20.00th=[ 176], 00:32:05.310 | 30.00th=[ 271], 40.00th=[ 317], 50.00th=[ 359], 60.00th=[ 368], 00:32:05.310 | 70.00th=[ 380], 80.00th=[ 393], 90.00th=[ 409], 95.00th=[ 418], 00:32:05.310 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:05.310 | 99.99th=[ 418] 00:32:05.310 bw ( KiB/s): min= 128, max= 256, per=4.79%, avg=198.40, stdev=65.33, samples=20 00:32:05.310 iops : min= 32, max= 64, avg=49.60, stdev=16.33, samples=20 00:32:05.310 lat (msec) : 250=25.00%, 500=75.00% 00:32:05.310 cpu : usr=98.80%, sys=0.73%, ctx=21, majf=0, minf=32 00:32:05.310 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216657: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10074msec) 00:32:05.310 slat (usec): min=11, max=102, avg=34.88, stdev=17.24 00:32:05.310 clat (msec): min=148, max=572, avg=402.66, stdev=93.40 00:32:05.310 lat (msec): min=148, max=572, avg=402.69, stdev=93.39 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 148], 5.00th=[ 264], 10.00th=[ 271], 20.00th=[ 300], 00:32:05.310 | 30.00th=[ 380], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 430], 00:32:05.310 | 70.00th=[ 456], 80.00th=[ 477], 90.00th=[ 514], 95.00th=[ 518], 00:32:05.310 | 99.00th=[ 535], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.310 | 99.99th=[ 575] 00:32:05.310 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.60, stdev=52.53, samples=20 00:32:05.310 iops : min= 32, max= 64, avg=38.40, stdev=13.13, samples=20 00:32:05.310 lat (msec) : 250=4.50%, 500=79.00%, 750=16.50% 00:32:05.310 cpu : usr=98.65%, sys=0.77%, ctx=99, majf=0, minf=26 00:32:05.310 IO depths : 1=5.5%, 2=11.8%, 4=25.0%, 8=50.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216658: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10074msec) 00:32:05.310 slat (usec): min=11, max=136, avg=33.53, stdev=19.08 00:32:05.310 clat (msec): min=148, max=579, avg=402.68, stdev=94.97 00:32:05.310 lat (msec): min=148, max=579, avg=402.71, stdev=94.97 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 148], 5.00th=[ 262], 10.00th=[ 271], 20.00th=[ 313], 00:32:05.310 | 30.00th=[ 372], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 430], 00:32:05.310 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.310 | 99.00th=[ 550], 99.50th=[ 575], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.310 | 99.99th=[ 584] 00:32:05.310 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.55, stdev=50.60, samples=20 00:32:05.310 iops : min= 32, max= 64, avg=38.35, stdev=12.57, samples=20 00:32:05.310 lat (msec) : 250=4.50%, 500=78.00%, 750=17.50% 00:32:05.310 cpu : usr=98.84%, sys=0.75%, ctx=15, majf=0, minf=33 00:32:05.310 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216660: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10063msec) 00:32:05.310 slat (usec): min=9, max=165, avg=39.76, stdev=20.37 00:32:05.310 clat (msec): min=270, max=571, avg=418.72, stdev=72.74 00:32:05.310 lat (msec): min=270, max=571, avg=418.76, stdev=72.74 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 372], 00:32:05.310 | 30.00th=[ 397], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.310 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.310 | 99.00th=[ 550], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.310 | 99.99th=[ 575] 00:32:05.310 bw ( KiB/s): min= 16, max= 256, per=3.56%, avg=147.20, stdev=59.32, samples=20 00:32:05.310 iops : min= 4, max= 64, avg=36.80, stdev=14.83, samples=20 00:32:05.310 lat (msec) : 500=82.81%, 750=17.19% 00:32:05.310 cpu : usr=98.57%, sys=0.86%, ctx=23, majf=0, minf=30 00:32:05.310 IO depths : 1=5.5%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216661: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10061msec) 00:32:05.310 slat (nsec): min=5278, max=86350, avg=35799.84, stdev=12330.17 00:32:05.310 clat (msec): min=262, max=579, avg=418.88, stdev=75.08 00:32:05.310 lat (msec): min=262, max=579, avg=418.91, stdev=75.08 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.310 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.310 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.310 | 99.00th=[ 575], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.310 | 99.99th=[ 584] 00:32:05.310 bw ( KiB/s): min= 127, max= 256, per=3.56%, avg=147.15, stdev=46.91, samples=20 00:32:05.310 iops : min= 31, max= 64, avg=36.75, stdev=11.75, samples=20 00:32:05.310 lat (msec) : 500=81.77%, 750=18.23% 00:32:05.310 cpu : usr=98.75%, sys=0.83%, ctx=21, majf=0, minf=33 00:32:05.310 IO depths : 1=3.4%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216662: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=46, BW=186KiB/s (191kB/s)(1880KiB/10089msec) 00:32:05.310 slat (usec): min=4, max=137, avg=72.22, stdev=31.51 00:32:05.310 clat (msec): min=3, max=578, avg=341.20, stdev=158.18 00:32:05.310 lat (msec): min=3, max=579, avg=341.27, stdev=158.20 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 55], 20.00th=[ 163], 00:32:05.310 | 30.00th=[ 292], 40.00th=[ 368], 50.00th=[ 393], 60.00th=[ 409], 00:32:05.310 | 70.00th=[ 439], 80.00th=[ 477], 90.00th=[ 510], 95.00th=[ 535], 00:32:05.310 | 99.00th=[ 550], 99.50th=[ 558], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.310 | 99.99th=[ 584] 00:32:05.310 bw ( KiB/s): min= 128, max= 688, per=4.38%, avg=181.60, stdev=131.05, samples=20 00:32:05.310 iops : min= 32, max= 172, avg=45.40, stdev=32.76, samples=20 00:32:05.310 lat (msec) : 4=3.40%, 10=2.98%, 20=0.43%, 50=1.70%, 100=1.70% 00:32:05.310 lat (msec) : 250=16.17%, 500=58.72%, 750=14.89% 00:32:05.310 cpu : usr=98.75%, sys=0.75%, ctx=15, majf=0, minf=29 00:32:05.310 IO depths : 1=2.6%, 2=7.2%, 4=20.0%, 8=60.2%, 16=10.0%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=92.9%, 8=1.5%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=470,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216663: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10092msec) 00:32:05.310 slat (nsec): min=3813, max=47498, avg=12390.98, stdev=6014.47 00:32:05.310 clat (msec): min=84, max=418, avg=288.07, stdev=96.26 00:32:05.310 lat (msec): min=84, max=418, avg=288.09, stdev=96.26 00:32:05.310 clat percentiles (msec): 00:32:05.310 | 1.00th=[ 85], 5.00th=[ 138], 10.00th=[ 153], 20.00th=[ 174], 00:32:05.310 | 30.00th=[ 232], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 351], 00:32:05.310 | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 409], 00:32:05.310 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:05.310 | 99.99th=[ 418] 00:32:05.310 bw ( KiB/s): min= 128, max= 384, per=5.25%, avg=217.60, stdev=70.49, samples=20 00:32:05.310 iops : min= 32, max= 96, avg=54.40, stdev=17.62, samples=20 00:32:05.310 lat (msec) : 100=2.86%, 250=30.71%, 500=66.43% 00:32:05.310 cpu : usr=98.89%, sys=0.69%, ctx=26, majf=0, minf=46 00:32:05.310 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:32:05.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.310 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.310 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.310 filename1: (groupid=0, jobs=1): err= 0: pid=2216664: Wed Nov 27 02:43:29 2024 00:32:05.310 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10077msec) 00:32:05.310 slat (nsec): min=4521, max=65900, avg=26214.31, stdev=12440.79 00:32:05.310 clat (msec): min=83, max=606, avg=402.67, stdev=98.07 00:32:05.311 lat (msec): min=83, max=606, avg=402.69, stdev=98.07 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 84], 5.00th=[ 268], 10.00th=[ 292], 20.00th=[ 334], 00:32:05.311 | 30.00th=[ 376], 40.00th=[ 393], 50.00th=[ 414], 60.00th=[ 430], 00:32:05.311 | 70.00th=[ 456], 80.00th=[ 477], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.311 | 99.00th=[ 550], 99.50th=[ 575], 99.90th=[ 609], 99.95th=[ 609], 00:32:05.311 | 99.99th=[ 609] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.60, stdev=48.81, samples=20 00:32:05.311 iops : min= 32, max= 64, avg=38.40, stdev=12.20, samples=20 00:32:05.311 lat (msec) : 100=3.50%, 250=1.00%, 500=79.00%, 750=16.50% 00:32:05.311 cpu : usr=98.79%, sys=0.80%, ctx=20, majf=0, minf=36 00:32:05.311 IO depths : 1=3.8%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.8%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216665: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=57, BW=228KiB/s (234kB/s)(2304KiB/10093msec) 00:32:05.311 slat (nsec): min=4149, max=97091, avg=18085.92, stdev=16057.68 00:32:05.311 clat (msec): min=10, max=418, avg=280.06, stdev=108.57 00:32:05.311 lat (msec): min=10, max=418, avg=280.08, stdev=108.57 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 11], 5.00th=[ 39], 10.00th=[ 138], 20.00th=[ 171], 00:32:05.311 | 30.00th=[ 180], 40.00th=[ 271], 50.00th=[ 317], 60.00th=[ 351], 00:32:05.311 | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 409], 00:32:05.311 | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], 00:32:05.311 | 99.99th=[ 418] 00:32:05.311 bw ( KiB/s): min= 128, max= 512, per=5.39%, avg=224.00, stdev=86.40, samples=20 00:32:05.311 iops : min= 32, max= 128, avg=56.00, stdev=21.60, samples=20 00:32:05.311 lat (msec) : 20=2.78%, 50=2.43%, 100=0.35%, 250=27.08%, 500=67.36% 00:32:05.311 cpu : usr=98.69%, sys=0.86%, ctx=14, majf=0, minf=38 00:32:05.311 IO depths : 1=0.9%, 2=7.1%, 4=25.0%, 8=55.4%, 16=11.6%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216666: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10060msec) 00:32:05.311 slat (usec): min=9, max=124, avg=38.23, stdev=17.07 00:32:05.311 clat (msec): min=269, max=570, avg=418.68, stdev=73.90 00:32:05.311 lat (msec): min=270, max=570, avg=418.72, stdev=73.90 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.311 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.311 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.311 | 99.00th=[ 550], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.311 | 99.99th=[ 575] 00:32:05.311 bw ( KiB/s): min= 16, max= 256, per=3.56%, avg=147.20, stdev=56.05, samples=20 00:32:05.311 iops : min= 4, max= 64, avg=36.80, stdev=14.01, samples=20 00:32:05.311 lat (msec) : 500=82.81%, 750=17.19% 00:32:05.311 cpu : usr=98.77%, sys=0.83%, ctx=12, majf=0, minf=31 00:32:05.311 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216667: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=50, BW=203KiB/s (208kB/s)(2048KiB/10079msec) 00:32:05.311 slat (usec): min=8, max=147, avg=38.13, stdev=39.10 00:32:05.311 clat (msec): min=147, max=496, avg=314.49, stdev=94.48 00:32:05.311 lat (msec): min=147, max=496, avg=314.53, stdev=94.50 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 148], 5.00th=[ 155], 10.00th=[ 171], 20.00th=[ 180], 00:32:05.311 | 30.00th=[ 264], 40.00th=[ 305], 50.00th=[ 359], 60.00th=[ 363], 00:32:05.311 | 70.00th=[ 380], 80.00th=[ 393], 90.00th=[ 418], 95.00th=[ 430], 00:32:05.311 | 99.00th=[ 443], 99.50th=[ 477], 99.90th=[ 498], 99.95th=[ 498], 00:32:05.311 | 99.99th=[ 498] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=4.79%, avg=198.40, stdev=62.38, samples=20 00:32:05.311 iops : min= 32, max= 64, avg=49.60, stdev=15.59, samples=20 00:32:05.311 lat (msec) : 250=27.73%, 500=72.27% 00:32:05.311 cpu : usr=98.86%, sys=0.62%, ctx=19, majf=0, minf=44 00:32:05.311 IO depths : 1=1.4%, 2=7.6%, 4=25.0%, 8=54.9%, 16=11.1%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216669: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10074msec) 00:32:05.311 slat (usec): min=8, max=108, avg=32.58, stdev=18.12 00:32:05.311 clat (msec): min=82, max=536, avg=402.68, stdev=97.66 00:32:05.311 lat (msec): min=82, max=536, avg=402.71, stdev=97.66 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 85], 5.00th=[ 266], 10.00th=[ 288], 20.00th=[ 330], 00:32:05.311 | 30.00th=[ 376], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 430], 00:32:05.311 | 70.00th=[ 456], 80.00th=[ 477], 90.00th=[ 514], 95.00th=[ 514], 00:32:05.311 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:32:05.311 | 99.99th=[ 535] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.60, stdev=52.53, samples=20 00:32:05.311 iops : min= 32, max= 64, avg=38.40, stdev=13.13, samples=20 00:32:05.311 lat (msec) : 100=4.00%, 500=80.00%, 750=16.00% 00:32:05.311 cpu : usr=98.94%, sys=0.60%, ctx=57, majf=0, minf=31 00:32:05.311 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216670: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10079msec) 00:32:05.311 slat (nsec): min=9746, max=64705, avg=28643.04, stdev=10186.00 00:32:05.311 clat (msec): min=147, max=571, avg=402.75, stdev=94.10 00:32:05.311 lat (msec): min=147, max=571, avg=402.78, stdev=94.10 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 148], 5.00th=[ 262], 10.00th=[ 271], 20.00th=[ 309], 00:32:05.311 | 30.00th=[ 380], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 430], 00:32:05.311 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 523], 00:32:05.311 | 99.00th=[ 542], 99.50th=[ 550], 99.90th=[ 575], 99.95th=[ 575], 00:32:05.311 | 99.99th=[ 575] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=3.70%, avg=153.60, stdev=48.81, samples=20 00:32:05.311 iops : min= 32, max= 64, avg=38.40, stdev=12.20, samples=20 00:32:05.311 lat (msec) : 250=4.50%, 500=78.50%, 750=17.00% 00:32:05.311 cpu : usr=98.23%, sys=1.08%, ctx=31, majf=0, minf=31 00:32:05.311 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216671: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=38, BW=154KiB/s (157kB/s)(1536KiB/10005msec) 00:32:05.311 slat (usec): min=13, max=161, avg=98.46, stdev=25.61 00:32:05.311 clat (msec): min=265, max=532, avg=415.98, stdev=73.31 00:32:05.311 lat (msec): min=265, max=532, avg=416.08, stdev=73.32 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 266], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 359], 00:32:05.311 | 30.00th=[ 380], 40.00th=[ 414], 50.00th=[ 435], 60.00th=[ 439], 00:32:05.311 | 70.00th=[ 468], 80.00th=[ 477], 90.00th=[ 502], 95.00th=[ 518], 00:32:05.311 | 99.00th=[ 531], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:32:05.311 | 99.99th=[ 535] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=3.73%, avg=154.95, stdev=53.61, samples=19 00:32:05.311 iops : min= 32, max= 64, avg=38.74, stdev=13.40, samples=19 00:32:05.311 lat (msec) : 500=91.15%, 750=8.85% 00:32:05.311 cpu : usr=98.41%, sys=0.94%, ctx=25, majf=0, minf=31 00:32:05.311 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.311 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.311 filename2: (groupid=0, jobs=1): err= 0: pid=2216672: Wed Nov 27 02:43:29 2024 00:32:05.311 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10058msec) 00:32:05.311 slat (nsec): min=9534, max=90148, avg=36327.72, stdev=13028.92 00:32:05.311 clat (msec): min=261, max=536, avg=418.72, stdev=71.97 00:32:05.311 lat (msec): min=261, max=536, avg=418.75, stdev=71.97 00:32:05.311 clat percentiles (msec): 00:32:05.311 | 1.00th=[ 271], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 372], 00:32:05.311 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.311 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 514], 00:32:05.311 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:32:05.311 | 99.99th=[ 535] 00:32:05.311 bw ( KiB/s): min= 128, max= 256, per=3.73%, avg=154.95, stdev=53.61, samples=19 00:32:05.311 iops : min= 32, max= 64, avg=38.74, stdev=13.40, samples=19 00:32:05.311 lat (msec) : 500=83.33%, 750=16.67% 00:32:05.311 cpu : usr=98.54%, sys=0.88%, ctx=47, majf=0, minf=24 00:32:05.311 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:05.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.311 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.312 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.312 filename2: (groupid=0, jobs=1): err= 0: pid=2216673: Wed Nov 27 02:43:29 2024 00:32:05.312 read: IOPS=38, BW=153KiB/s (156kB/s)(1536KiB/10056msec) 00:32:05.312 slat (nsec): min=9160, max=54773, avg=31793.01, stdev=7595.94 00:32:05.312 clat (msec): min=230, max=579, avg=418.70, stdev=75.56 00:32:05.312 lat (msec): min=230, max=579, avg=418.73, stdev=75.56 00:32:05.312 clat percentiles (msec): 00:32:05.312 | 1.00th=[ 264], 5.00th=[ 292], 10.00th=[ 300], 20.00th=[ 368], 00:32:05.312 | 30.00th=[ 393], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 439], 00:32:05.312 | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 535], 00:32:05.312 | 99.00th=[ 575], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], 00:32:05.312 | 99.99th=[ 584] 00:32:05.312 bw ( KiB/s): min= 128, max= 256, per=3.73%, avg=154.95, stdev=53.61, samples=19 00:32:05.312 iops : min= 32, max= 64, avg=38.74, stdev=13.40, samples=19 00:32:05.312 lat (msec) : 250=0.52%, 500=81.25%, 750=18.23% 00:32:05.312 cpu : usr=98.85%, sys=0.76%, ctx=15, majf=0, minf=38 00:32:05.312 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:05.312 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.312 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.312 issued rwts: total=384,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.312 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:05.312 00:32:05.312 Run status group 0 (all jobs): 00:32:05.312 READ: bw=4134KiB/s (4233kB/s), 152KiB/s-228KiB/s (155kB/s-234kB/s), io=40.8MiB (42.7MB), run=10005-10095msec 00:32:05.570 02:43:30 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:05.570 02:43:30 -- target/dif.sh@43 -- # local sub 00:32:05.570 02:43:30 -- target/dif.sh@45 -- # for sub in "$@" 00:32:05.570 02:43:30 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:05.570 02:43:30 -- target/dif.sh@36 -- # local sub_id=0 00:32:05.570 02:43:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.570 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.570 02:43:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.570 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.570 02:43:30 -- target/dif.sh@45 -- # for sub in "$@" 00:32:05.570 02:43:30 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:05.570 02:43:30 -- target/dif.sh@36 -- # local sub_id=1 00:32:05.570 02:43:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.570 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.570 02:43:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.570 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.570 02:43:30 -- target/dif.sh@45 -- # for sub in "$@" 00:32:05.570 02:43:30 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:05.570 02:43:30 -- target/dif.sh@36 -- # local sub_id=2 00:32:05.570 02:43:30 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.570 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.570 02:43:30 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:05.570 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.570 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.859 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.859 02:43:30 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:05.860 02:43:30 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:05.860 02:43:30 -- target/dif.sh@115 -- # numjobs=2 00:32:05.860 02:43:30 -- target/dif.sh@115 -- # iodepth=8 00:32:05.860 02:43:30 -- target/dif.sh@115 -- # runtime=5 00:32:05.860 02:43:30 -- target/dif.sh@115 -- # files=1 00:32:05.860 02:43:30 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:05.860 02:43:30 -- target/dif.sh@28 -- # local sub 00:32:05.860 02:43:30 -- target/dif.sh@30 -- # for sub in "$@" 00:32:05.860 02:43:30 -- target/dif.sh@31 -- # create_subsystem 0 00:32:05.860 02:43:30 -- target/dif.sh@18 -- # local sub_id=0 00:32:05.860 02:43:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 bdev_null0 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 [2024-11-27 02:43:30.233202] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@30 -- # for sub in "$@" 00:32:05.860 02:43:30 -- target/dif.sh@31 -- # create_subsystem 1 00:32:05.860 02:43:30 -- target/dif.sh@18 -- # local sub_id=1 00:32:05.860 02:43:30 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 bdev_null1 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:05.860 02:43:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:05.860 02:43:30 -- common/autotest_common.sh@10 -- # set +x 00:32:05.860 02:43:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:05.860 02:43:30 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:05.860 02:43:30 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:05.860 02:43:30 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:05.860 02:43:30 -- nvmf/common.sh@520 -- # config=() 00:32:05.860 02:43:30 -- nvmf/common.sh@520 -- # local subsystem config 00:32:05.860 02:43:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:05.860 02:43:30 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:05.860 02:43:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:05.860 { 00:32:05.860 "params": { 00:32:05.860 "name": "Nvme$subsystem", 00:32:05.860 "trtype": "$TEST_TRANSPORT", 00:32:05.860 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:05.860 "adrfam": "ipv4", 00:32:05.860 "trsvcid": "$NVMF_PORT", 00:32:05.860 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:05.860 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:05.860 "hdgst": ${hdgst:-false}, 00:32:05.860 "ddgst": ${ddgst:-false} 00:32:05.860 }, 00:32:05.860 "method": "bdev_nvme_attach_controller" 00:32:05.860 } 00:32:05.860 EOF 00:32:05.860 )") 00:32:05.860 02:43:30 -- target/dif.sh@82 -- # gen_fio_conf 00:32:05.860 02:43:30 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:05.860 02:43:30 -- target/dif.sh@54 -- # local file 00:32:05.860 02:43:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:05.860 02:43:30 -- target/dif.sh@56 -- # cat 00:32:05.860 02:43:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:05.860 02:43:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:05.860 02:43:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.860 02:43:30 -- common/autotest_common.sh@1330 -- # shift 00:32:05.860 02:43:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:05.860 02:43:30 -- nvmf/common.sh@542 -- # cat 00:32:05.860 02:43:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.860 02:43:30 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:05.860 02:43:30 -- target/dif.sh@72 -- # (( file <= files )) 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:05.860 02:43:30 -- target/dif.sh@73 -- # cat 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:05.860 02:43:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:05.860 02:43:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:05.860 { 00:32:05.860 "params": { 00:32:05.860 "name": "Nvme$subsystem", 00:32:05.860 "trtype": "$TEST_TRANSPORT", 00:32:05.860 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:05.860 "adrfam": "ipv4", 00:32:05.860 "trsvcid": "$NVMF_PORT", 00:32:05.860 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:05.860 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:05.860 "hdgst": ${hdgst:-false}, 00:32:05.860 "ddgst": ${ddgst:-false} 00:32:05.860 }, 00:32:05.860 "method": "bdev_nvme_attach_controller" 00:32:05.860 } 00:32:05.860 EOF 00:32:05.860 )") 00:32:05.860 02:43:30 -- nvmf/common.sh@542 -- # cat 00:32:05.860 02:43:30 -- target/dif.sh@72 -- # (( file++ )) 00:32:05.860 02:43:30 -- target/dif.sh@72 -- # (( file <= files )) 00:32:05.860 02:43:30 -- nvmf/common.sh@544 -- # jq . 00:32:05.860 02:43:30 -- nvmf/common.sh@545 -- # IFS=, 00:32:05.860 02:43:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:05.860 "params": { 00:32:05.860 "name": "Nvme0", 00:32:05.860 "trtype": "tcp", 00:32:05.860 "traddr": "10.0.0.2", 00:32:05.860 "adrfam": "ipv4", 00:32:05.860 "trsvcid": "4420", 00:32:05.860 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:05.860 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:05.860 "hdgst": false, 00:32:05.860 "ddgst": false 00:32:05.860 }, 00:32:05.860 "method": "bdev_nvme_attach_controller" 00:32:05.860 },{ 00:32:05.860 "params": { 00:32:05.860 "name": "Nvme1", 00:32:05.860 "trtype": "tcp", 00:32:05.860 "traddr": "10.0.0.2", 00:32:05.860 "adrfam": "ipv4", 00:32:05.860 "trsvcid": "4420", 00:32:05.860 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:05.860 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:05.860 "hdgst": false, 00:32:05.860 "ddgst": false 00:32:05.860 }, 00:32:05.860 "method": "bdev_nvme_attach_controller" 00:32:05.860 }' 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:05.860 02:43:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:05.860 02:43:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:05.860 02:43:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:05.860 02:43:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:05.860 02:43:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:05.860 02:43:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:06.119 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:06.119 ... 00:32:06.119 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:06.119 ... 00:32:06.119 fio-3.35 00:32:06.119 Starting 4 threads 00:32:06.119 EAL: No free 2048 kB hugepages reported on node 1 00:32:06.685 [2024-11-27 02:43:31.167793] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:06.685 [2024-11-27 02:43:31.167899] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.950 00:32:11.950 filename0: (groupid=0, jobs=1): err= 0: pid=2218065: Wed Nov 27 02:43:36 2024 00:32:11.950 read: IOPS=1874, BW=14.6MiB/s (15.4MB/s)(73.2MiB/5002msec) 00:32:11.950 slat (nsec): min=4621, max=88713, avg=18083.69, stdev=10621.36 00:32:11.950 clat (usec): min=933, max=7700, avg=4205.74, stdev=455.37 00:32:11.950 lat (usec): min=946, max=7719, avg=4223.83, stdev=456.17 00:32:11.950 clat percentiles (usec): 00:32:11.950 | 1.00th=[ 2704], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 4015], 00:32:11.950 | 30.00th=[ 4113], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4293], 00:32:11.950 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4490], 95.00th=[ 4621], 00:32:11.950 | 99.00th=[ 5932], 99.50th=[ 6259], 99.90th=[ 7046], 99.95th=[ 7308], 00:32:11.950 | 99.99th=[ 7701] 00:32:11.950 bw ( KiB/s): min=14720, max=15456, per=25.26%, avg=15045.33, stdev=337.62, samples=9 00:32:11.950 iops : min= 1840, max= 1932, avg=1880.67, stdev=42.20, samples=9 00:32:11.950 lat (usec) : 1000=0.02% 00:32:11.950 lat (msec) : 2=0.37%, 4=19.21%, 10=80.39% 00:32:11.950 cpu : usr=94.48%, sys=5.00%, ctx=8, majf=0, minf=126 00:32:11.950 IO depths : 1=0.4%, 2=14.0%, 4=58.9%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.950 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.950 complete : 0=0.0%, 4=91.7%, 8=8.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.950 issued rwts: total=9375,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.950 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.950 filename0: (groupid=0, jobs=1): err= 0: pid=2218066: Wed Nov 27 02:43:36 2024 00:32:11.950 read: IOPS=1844, BW=14.4MiB/s (15.1MB/s)(72.1MiB/5002msec) 00:32:11.950 slat (nsec): min=4584, max=75083, avg=20627.40, stdev=11066.53 00:32:11.950 clat (usec): min=763, max=7957, avg=4259.12, stdev=546.43 00:32:11.950 lat (usec): min=780, max=7977, avg=4279.75, stdev=546.38 00:32:11.950 clat percentiles (usec): 00:32:11.950 | 1.00th=[ 2507], 5.00th=[ 3687], 10.00th=[ 3884], 20.00th=[ 4015], 00:32:11.950 | 30.00th=[ 4113], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4293], 00:32:11.950 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 5014], 00:32:11.950 | 99.00th=[ 6521], 99.50th=[ 7046], 99.90th=[ 7701], 99.95th=[ 7767], 00:32:11.950 | 99.99th=[ 7963] 00:32:11.950 bw ( KiB/s): min=14448, max=15360, per=24.81%, avg=14780.44, stdev=265.54, samples=9 00:32:11.950 iops : min= 1806, max= 1920, avg=1847.56, stdev=33.19, samples=9 00:32:11.950 lat (usec) : 1000=0.13% 00:32:11.950 lat (msec) : 2=0.60%, 4=16.66%, 10=82.61% 00:32:11.950 cpu : usr=94.84%, sys=4.68%, ctx=9, majf=0, minf=73 00:32:11.950 IO depths : 1=0.1%, 2=18.0%, 4=55.5%, 8=26.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.950 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.950 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.950 issued rwts: total=9226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.950 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.950 filename1: (groupid=0, jobs=1): err= 0: pid=2218067: Wed Nov 27 02:43:36 2024 00:32:11.950 read: IOPS=1854, BW=14.5MiB/s (15.2MB/s)(72.5MiB/5001msec) 00:32:11.950 slat (nsec): min=4533, max=69651, avg=20443.53, stdev=8197.05 00:32:11.950 clat (usec): min=804, max=7829, avg=4242.43, stdev=513.73 00:32:11.950 lat (usec): min=822, max=7849, avg=4262.87, stdev=513.83 00:32:11.950 clat percentiles (usec): 00:32:11.950 | 1.00th=[ 2737], 5.00th=[ 3490], 10.00th=[ 3851], 20.00th=[ 4015], 00:32:11.950 | 30.00th=[ 4113], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4293], 00:32:11.951 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4948], 00:32:11.951 | 99.00th=[ 6325], 99.50th=[ 6718], 99.90th=[ 7373], 99.95th=[ 7701], 00:32:11.951 | 99.99th=[ 7832] 00:32:11.951 bw ( KiB/s): min=14528, max=15488, per=24.98%, avg=14879.67, stdev=331.98, samples=9 00:32:11.951 iops : min= 1816, max= 1936, avg=1859.89, stdev=41.54, samples=9 00:32:11.951 lat (usec) : 1000=0.04% 00:32:11.951 lat (msec) : 2=0.28%, 4=17.57%, 10=82.10% 00:32:11.951 cpu : usr=95.48%, sys=4.00%, ctx=17, majf=0, minf=96 00:32:11.951 IO depths : 1=0.2%, 2=15.3%, 4=57.9%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.951 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.951 issued rwts: total=9275,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.951 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.951 filename1: (groupid=0, jobs=1): err= 0: pid=2218068: Wed Nov 27 02:43:36 2024 00:32:11.951 read: IOPS=1873, BW=14.6MiB/s (15.3MB/s)(73.2MiB/5001msec) 00:32:11.951 slat (nsec): min=4611, max=79279, avg=20614.94, stdev=11268.65 00:32:11.951 clat (usec): min=812, max=7925, avg=4193.70, stdev=501.75 00:32:11.951 lat (usec): min=823, max=7938, avg=4214.31, stdev=502.60 00:32:11.951 clat percentiles (usec): 00:32:11.951 | 1.00th=[ 2474], 5.00th=[ 3490], 10.00th=[ 3785], 20.00th=[ 3982], 00:32:11.951 | 30.00th=[ 4080], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4293], 00:32:11.951 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4490], 95.00th=[ 4686], 00:32:11.951 | 99.00th=[ 6063], 99.50th=[ 6587], 99.90th=[ 7308], 99.95th=[ 7635], 00:32:11.951 | 99.99th=[ 7898] 00:32:11.951 bw ( KiB/s): min=14464, max=16064, per=25.25%, avg=15041.78, stdev=495.00, samples=9 00:32:11.951 iops : min= 1808, max= 2008, avg=1880.22, stdev=61.87, samples=9 00:32:11.951 lat (usec) : 1000=0.09% 00:32:11.951 lat (msec) : 2=0.34%, 4=21.62%, 10=77.95% 00:32:11.951 cpu : usr=95.24%, sys=4.26%, ctx=9, majf=0, minf=82 00:32:11.951 IO depths : 1=0.2%, 2=16.2%, 4=56.7%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.951 complete : 0=0.0%, 4=91.7%, 8=8.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.951 issued rwts: total=9371,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.951 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.951 00:32:11.951 Run status group 0 (all jobs): 00:32:11.951 READ: bw=58.2MiB/s (61.0MB/s), 14.4MiB/s-14.6MiB/s (15.1MB/s-15.4MB/s), io=291MiB (305MB), run=5001-5002msec 00:32:11.951 02:43:36 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:11.951 02:43:36 -- target/dif.sh@43 -- # local sub 00:32:11.951 02:43:36 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.951 02:43:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.951 02:43:36 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.951 02:43:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.951 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.951 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@45 -- # for sub in "$@" 00:32:12.209 02:43:36 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:12.209 02:43:36 -- target/dif.sh@36 -- # local sub_id=1 00:32:12.209 02:43:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 00:32:12.209 real 0m24.246s 00:32:12.209 user 4m36.146s 00:32:12.209 sys 0m4.776s 00:32:12.209 02:43:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 ************************************ 00:32:12.209 END TEST fio_dif_rand_params 00:32:12.209 ************************************ 00:32:12.209 02:43:36 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:12.209 02:43:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:12.209 02:43:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 ************************************ 00:32:12.209 START TEST fio_dif_digest 00:32:12.209 ************************************ 00:32:12.209 02:43:36 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:12.209 02:43:36 -- target/dif.sh@123 -- # local NULL_DIF 00:32:12.209 02:43:36 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:12.209 02:43:36 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:12.209 02:43:36 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:12.209 02:43:36 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:12.209 02:43:36 -- target/dif.sh@127 -- # numjobs=3 00:32:12.209 02:43:36 -- target/dif.sh@127 -- # iodepth=3 00:32:12.209 02:43:36 -- target/dif.sh@127 -- # runtime=10 00:32:12.209 02:43:36 -- target/dif.sh@128 -- # hdgst=true 00:32:12.209 02:43:36 -- target/dif.sh@128 -- # ddgst=true 00:32:12.209 02:43:36 -- target/dif.sh@130 -- # create_subsystems 0 00:32:12.209 02:43:36 -- target/dif.sh@28 -- # local sub 00:32:12.209 02:43:36 -- target/dif.sh@30 -- # for sub in "$@" 00:32:12.209 02:43:36 -- target/dif.sh@31 -- # create_subsystem 0 00:32:12.209 02:43:36 -- target/dif.sh@18 -- # local sub_id=0 00:32:12.209 02:43:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 bdev_null0 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:12.209 02:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:12.209 02:43:36 -- common/autotest_common.sh@10 -- # set +x 00:32:12.209 [2024-11-27 02:43:36.673242] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:12.209 02:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:12.209 02:43:36 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:12.209 02:43:36 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:12.209 02:43:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:12.209 02:43:36 -- nvmf/common.sh@520 -- # config=() 00:32:12.209 02:43:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.209 02:43:36 -- nvmf/common.sh@520 -- # local subsystem config 00:32:12.209 02:43:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.209 02:43:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:12.209 02:43:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:12.209 02:43:36 -- target/dif.sh@82 -- # gen_fio_conf 00:32:12.209 02:43:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:12.209 { 00:32:12.209 "params": { 00:32:12.209 "name": "Nvme$subsystem", 00:32:12.209 "trtype": "$TEST_TRANSPORT", 00:32:12.209 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:12.209 "adrfam": "ipv4", 00:32:12.209 "trsvcid": "$NVMF_PORT", 00:32:12.209 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:12.209 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:12.209 "hdgst": ${hdgst:-false}, 00:32:12.209 "ddgst": ${ddgst:-false} 00:32:12.209 }, 00:32:12.209 "method": "bdev_nvme_attach_controller" 00:32:12.209 } 00:32:12.209 EOF 00:32:12.209 )") 00:32:12.209 02:43:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:12.209 02:43:36 -- target/dif.sh@54 -- # local file 00:32:12.209 02:43:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:12.209 02:43:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.209 02:43:36 -- target/dif.sh@56 -- # cat 00:32:12.209 02:43:36 -- common/autotest_common.sh@1330 -- # shift 00:32:12.209 02:43:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:12.210 02:43:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:12.210 02:43:36 -- nvmf/common.sh@542 -- # cat 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:12.210 02:43:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:12.210 02:43:36 -- target/dif.sh@72 -- # (( file <= files )) 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:12.210 02:43:36 -- nvmf/common.sh@544 -- # jq . 00:32:12.210 02:43:36 -- nvmf/common.sh@545 -- # IFS=, 00:32:12.210 02:43:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:12.210 "params": { 00:32:12.210 "name": "Nvme0", 00:32:12.210 "trtype": "tcp", 00:32:12.210 "traddr": "10.0.0.2", 00:32:12.210 "adrfam": "ipv4", 00:32:12.210 "trsvcid": "4420", 00:32:12.210 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:12.210 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:12.210 "hdgst": true, 00:32:12.210 "ddgst": true 00:32:12.210 }, 00:32:12.210 "method": "bdev_nvme_attach_controller" 00:32:12.210 }' 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:12.210 02:43:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:12.210 02:43:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:12.210 02:43:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:12.210 02:43:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:12.210 02:43:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:12.210 02:43:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:12.467 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:12.467 ... 00:32:12.467 fio-3.35 00:32:12.467 Starting 3 threads 00:32:12.467 EAL: No free 2048 kB hugepages reported on node 1 00:32:13.033 [2024-11-27 02:43:37.426438] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:13.033 [2024-11-27 02:43:37.426497] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:23.001 00:32:23.001 filename0: (groupid=0, jobs=1): err= 0: pid=2218958: Wed Nov 27 02:43:47 2024 00:32:23.001 read: IOPS=200, BW=25.1MiB/s (26.3MB/s)(251MiB/10005msec) 00:32:23.001 slat (nsec): min=4875, max=39107, avg=13709.60, stdev=3175.74 00:32:23.001 clat (usec): min=5840, max=19726, avg=14906.87, stdev=1029.24 00:32:23.001 lat (usec): min=5853, max=19745, avg=14920.58, stdev=1029.24 00:32:23.001 clat percentiles (usec): 00:32:23.001 | 1.00th=[12518], 5.00th=[13304], 10.00th=[13698], 20.00th=[14091], 00:32:23.001 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:32:23.001 | 70.00th=[15401], 80.00th=[15664], 90.00th=[16188], 95.00th=[16581], 00:32:23.001 | 99.00th=[17433], 99.50th=[17695], 99.90th=[19792], 99.95th=[19792], 00:32:23.001 | 99.99th=[19792] 00:32:23.001 bw ( KiB/s): min=24576, max=26880, per=32.90%, avg=25715.20, stdev=697.26, samples=20 00:32:23.001 iops : min= 192, max= 210, avg=200.90, stdev= 5.45, samples=20 00:32:23.001 lat (msec) : 10=0.05%, 20=99.95% 00:32:23.001 cpu : usr=93.07%, sys=6.45%, ctx=27, majf=0, minf=123 00:32:23.001 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 issued rwts: total=2011,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.001 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.001 filename0: (groupid=0, jobs=1): err= 0: pid=2218959: Wed Nov 27 02:43:47 2024 00:32:23.001 read: IOPS=202, BW=25.3MiB/s (26.5MB/s)(254MiB/10044msec) 00:32:23.001 slat (nsec): min=5988, max=36168, avg=13799.06, stdev=3307.41 00:32:23.001 clat (usec): min=11231, max=52703, avg=14798.19, stdev=1524.07 00:32:23.001 lat (usec): min=11244, max=52716, avg=14811.99, stdev=1524.09 00:32:23.001 clat percentiles (usec): 00:32:23.001 | 1.00th=[12256], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:32:23.001 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:32:23.001 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16057], 95.00th=[16581], 00:32:23.001 | 99.00th=[17695], 99.50th=[18482], 99.90th=[18744], 99.95th=[44303], 00:32:23.001 | 99.99th=[52691] 00:32:23.001 bw ( KiB/s): min=24112, max=27392, per=33.23%, avg=25973.60, stdev=997.02, samples=20 00:32:23.001 iops : min= 188, max= 214, avg=202.90, stdev= 7.83, samples=20 00:32:23.001 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:32:23.001 cpu : usr=92.35%, sys=7.15%, ctx=22, majf=0, minf=164 00:32:23.001 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 issued rwts: total=2031,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.001 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.001 filename0: (groupid=0, jobs=1): err= 0: pid=2218960: Wed Nov 27 02:43:47 2024 00:32:23.001 read: IOPS=208, BW=26.0MiB/s (27.3MB/s)(262MiB/10043msec) 00:32:23.001 slat (nsec): min=4655, max=37382, avg=13809.72, stdev=3042.93 00:32:23.001 clat (usec): min=10897, max=54338, avg=14364.80, stdev=1593.67 00:32:23.001 lat (usec): min=10909, max=54351, avg=14378.61, stdev=1593.84 00:32:23.001 clat percentiles (usec): 00:32:23.001 | 1.00th=[11863], 5.00th=[12518], 10.00th=[13042], 20.00th=[13435], 00:32:23.001 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14353], 60.00th=[14615], 00:32:23.001 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16057], 00:32:23.001 | 99.00th=[16909], 99.50th=[17171], 99.90th=[17695], 99.95th=[51643], 00:32:23.001 | 99.99th=[54264] 00:32:23.001 bw ( KiB/s): min=25344, max=28416, per=34.22%, avg=26752.00, stdev=884.86, samples=20 00:32:23.001 iops : min= 198, max= 222, avg=209.00, stdev= 6.91, samples=20 00:32:23.001 lat (msec) : 20=99.90%, 100=0.10% 00:32:23.001 cpu : usr=92.37%, sys=7.13%, ctx=18, majf=0, minf=100 00:32:23.001 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.001 issued rwts: total=2092,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.001 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.001 00:32:23.001 Run status group 0 (all jobs): 00:32:23.001 READ: bw=76.3MiB/s (80.0MB/s), 25.1MiB/s-26.0MiB/s (26.3MB/s-27.3MB/s), io=767MiB (804MB), run=10005-10044msec 00:32:23.260 02:43:47 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:23.260 02:43:47 -- target/dif.sh@43 -- # local sub 00:32:23.260 02:43:47 -- target/dif.sh@45 -- # for sub in "$@" 00:32:23.260 02:43:47 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:23.260 02:43:47 -- target/dif.sh@36 -- # local sub_id=0 00:32:23.260 02:43:47 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:23.260 02:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.260 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:32:23.260 02:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.260 02:43:47 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:23.260 02:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.260 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:32:23.260 02:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.260 00:32:23.260 real 0m11.234s 00:32:23.260 user 0m29.166s 00:32:23.260 sys 0m2.366s 00:32:23.260 02:43:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:23.260 02:43:47 -- common/autotest_common.sh@10 -- # set +x 00:32:23.260 ************************************ 00:32:23.260 END TEST fio_dif_digest 00:32:23.260 ************************************ 00:32:23.518 02:43:47 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:23.518 02:43:47 -- target/dif.sh@147 -- # nvmftestfini 00:32:23.518 02:43:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:23.518 02:43:47 -- nvmf/common.sh@116 -- # sync 00:32:23.518 02:43:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:23.518 02:43:47 -- nvmf/common.sh@119 -- # set +e 00:32:23.518 02:43:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:23.518 02:43:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:23.518 rmmod nvme_tcp 00:32:23.518 rmmod nvme_fabrics 00:32:23.518 rmmod nvme_keyring 00:32:23.518 02:43:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:23.518 02:43:47 -- nvmf/common.sh@123 -- # set -e 00:32:23.518 02:43:47 -- nvmf/common.sh@124 -- # return 0 00:32:23.518 02:43:47 -- nvmf/common.sh@477 -- # '[' -n 2212590 ']' 00:32:23.518 02:43:47 -- nvmf/common.sh@478 -- # killprocess 2212590 00:32:23.518 02:43:47 -- common/autotest_common.sh@936 -- # '[' -z 2212590 ']' 00:32:23.518 02:43:47 -- common/autotest_common.sh@940 -- # kill -0 2212590 00:32:23.518 02:43:47 -- common/autotest_common.sh@941 -- # uname 00:32:23.518 02:43:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:23.518 02:43:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2212590 00:32:23.518 02:43:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:23.518 02:43:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:23.518 02:43:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2212590' 00:32:23.518 killing process with pid 2212590 00:32:23.518 02:43:48 -- common/autotest_common.sh@955 -- # kill 2212590 00:32:23.518 02:43:48 -- common/autotest_common.sh@960 -- # wait 2212590 00:32:23.777 02:43:48 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:23.778 02:43:48 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:25.151 Waiting for block devices as requested 00:32:25.151 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:25.151 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:25.151 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:25.151 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:25.409 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:25.409 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:25.409 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:25.409 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:25.667 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:25.667 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:25.667 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:25.667 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:25.925 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:25.925 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:25.925 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:25.925 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:26.183 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:26.183 02:43:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:26.183 02:43:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:26.183 02:43:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:26.183 02:43:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:26.183 02:43:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:26.183 02:43:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:26.183 02:43:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:28.715 02:43:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:28.715 00:32:28.715 real 1m7.867s 00:32:28.715 user 6m34.457s 00:32:28.715 sys 0m16.000s 00:32:28.715 02:43:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:28.715 02:43:52 -- common/autotest_common.sh@10 -- # set +x 00:32:28.715 ************************************ 00:32:28.715 END TEST nvmf_dif 00:32:28.715 ************************************ 00:32:28.715 02:43:52 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:28.715 02:43:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:28.715 02:43:52 -- common/autotest_common.sh@10 -- # set +x 00:32:28.715 ************************************ 00:32:28.715 START TEST nvmf_abort_qd_sizes 00:32:28.715 ************************************ 00:32:28.715 02:43:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:28.715 * Looking for test storage... 00:32:28.715 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:28.715 02:43:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:28.715 02:43:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:28.715 02:43:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:28.715 02:43:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:28.715 02:43:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:28.715 02:43:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:28.715 02:43:52 -- scripts/common.sh@335 -- # IFS=.-: 00:32:28.715 02:43:52 -- scripts/common.sh@335 -- # read -ra ver1 00:32:28.715 02:43:52 -- scripts/common.sh@336 -- # IFS=.-: 00:32:28.715 02:43:52 -- scripts/common.sh@336 -- # read -ra ver2 00:32:28.715 02:43:52 -- scripts/common.sh@337 -- # local 'op=<' 00:32:28.715 02:43:52 -- scripts/common.sh@339 -- # ver1_l=2 00:32:28.715 02:43:52 -- scripts/common.sh@340 -- # ver2_l=1 00:32:28.715 02:43:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:28.715 02:43:52 -- scripts/common.sh@343 -- # case "$op" in 00:32:28.715 02:43:52 -- scripts/common.sh@344 -- # : 1 00:32:28.715 02:43:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:28.715 02:43:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:28.715 02:43:52 -- scripts/common.sh@364 -- # decimal 1 00:32:28.715 02:43:52 -- scripts/common.sh@352 -- # local d=1 00:32:28.715 02:43:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:28.715 02:43:52 -- scripts/common.sh@354 -- # echo 1 00:32:28.715 02:43:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:28.715 02:43:52 -- scripts/common.sh@365 -- # decimal 2 00:32:28.715 02:43:52 -- scripts/common.sh@352 -- # local d=2 00:32:28.715 02:43:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:28.715 02:43:52 -- scripts/common.sh@354 -- # echo 2 00:32:28.715 02:43:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:28.715 02:43:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:28.715 02:43:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:28.715 02:43:52 -- scripts/common.sh@367 -- # return 0 00:32:28.715 02:43:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:28.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:28.715 --rc genhtml_branch_coverage=1 00:32:28.715 --rc genhtml_function_coverage=1 00:32:28.715 --rc genhtml_legend=1 00:32:28.715 --rc geninfo_all_blocks=1 00:32:28.715 --rc geninfo_unexecuted_blocks=1 00:32:28.715 00:32:28.715 ' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:28.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:28.715 --rc genhtml_branch_coverage=1 00:32:28.715 --rc genhtml_function_coverage=1 00:32:28.715 --rc genhtml_legend=1 00:32:28.715 --rc geninfo_all_blocks=1 00:32:28.715 --rc geninfo_unexecuted_blocks=1 00:32:28.715 00:32:28.715 ' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:28.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:28.715 --rc genhtml_branch_coverage=1 00:32:28.715 --rc genhtml_function_coverage=1 00:32:28.715 --rc genhtml_legend=1 00:32:28.715 --rc geninfo_all_blocks=1 00:32:28.715 --rc geninfo_unexecuted_blocks=1 00:32:28.715 00:32:28.715 ' 00:32:28.715 02:43:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:28.715 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:28.715 --rc genhtml_branch_coverage=1 00:32:28.715 --rc genhtml_function_coverage=1 00:32:28.715 --rc genhtml_legend=1 00:32:28.715 --rc geninfo_all_blocks=1 00:32:28.715 --rc geninfo_unexecuted_blocks=1 00:32:28.715 00:32:28.715 ' 00:32:28.715 02:43:52 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:28.715 02:43:52 -- nvmf/common.sh@7 -- # uname -s 00:32:28.715 02:43:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:28.715 02:43:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:28.715 02:43:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:28.715 02:43:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:28.715 02:43:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:28.715 02:43:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:28.715 02:43:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:28.715 02:43:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:28.715 02:43:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:28.715 02:43:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:28.715 02:43:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:28.715 02:43:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:28.715 02:43:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:28.715 02:43:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:28.715 02:43:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:28.715 02:43:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:28.715 02:43:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:28.715 02:43:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:28.715 02:43:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:28.715 02:43:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:28.715 02:43:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:28.715 02:43:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:28.715 02:43:52 -- paths/export.sh@5 -- # export PATH 00:32:28.715 02:43:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:28.715 02:43:52 -- nvmf/common.sh@46 -- # : 0 00:32:28.715 02:43:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:28.715 02:43:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:28.715 02:43:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:28.715 02:43:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:28.715 02:43:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:28.715 02:43:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:28.715 02:43:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:28.715 02:43:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:28.715 02:43:52 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:28.715 02:43:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:28.715 02:43:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:28.715 02:43:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:28.715 02:43:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:28.715 02:43:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:28.715 02:43:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:28.715 02:43:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:28.715 02:43:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:28.715 02:43:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:28.715 02:43:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:28.715 02:43:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:28.715 02:43:52 -- common/autotest_common.sh@10 -- # set +x 00:32:30.616 02:43:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:30.616 02:43:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:30.616 02:43:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:30.616 02:43:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:30.616 02:43:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:30.616 02:43:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:30.616 02:43:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:30.616 02:43:54 -- nvmf/common.sh@294 -- # net_devs=() 00:32:30.616 02:43:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:30.616 02:43:54 -- nvmf/common.sh@295 -- # e810=() 00:32:30.616 02:43:54 -- nvmf/common.sh@295 -- # local -ga e810 00:32:30.616 02:43:54 -- nvmf/common.sh@296 -- # x722=() 00:32:30.616 02:43:54 -- nvmf/common.sh@296 -- # local -ga x722 00:32:30.616 02:43:54 -- nvmf/common.sh@297 -- # mlx=() 00:32:30.616 02:43:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:30.616 02:43:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:30.616 02:43:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:30.616 02:43:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:30.616 02:43:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:30.616 02:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:30.616 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:30.616 02:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:30.616 02:43:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:30.616 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:30.616 02:43:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:30.616 02:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:30.616 02:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:30.616 02:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:30.616 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:30.616 02:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:30.616 02:43:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:30.616 02:43:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:30.616 02:43:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:30.616 02:43:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:30.616 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:30.616 02:43:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:30.616 02:43:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:30.616 02:43:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:30.616 02:43:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:30.616 02:43:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:30.616 02:43:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:30.616 02:43:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:30.616 02:43:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:30.616 02:43:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:30.616 02:43:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:30.616 02:43:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:30.616 02:43:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:30.616 02:43:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:30.616 02:43:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:30.616 02:43:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:30.616 02:43:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:30.616 02:43:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:30.616 02:43:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:30.616 02:43:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:30.616 02:43:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:30.616 02:43:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:30.616 02:43:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:30.616 02:43:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:30.616 02:43:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:30.616 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:30.616 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:32:30.616 00:32:30.617 --- 10.0.0.2 ping statistics --- 00:32:30.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:30.617 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:32:30.617 02:43:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:30.617 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:30.617 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:32:30.617 00:32:30.617 --- 10.0.0.1 ping statistics --- 00:32:30.617 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:30.617 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:32:30.617 02:43:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:30.617 02:43:54 -- nvmf/common.sh@410 -- # return 0 00:32:30.617 02:43:54 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:30.617 02:43:54 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:31.551 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:31.551 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:31.552 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:31.552 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:31.552 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:31.552 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:31.552 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:31.552 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:31.811 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:31.811 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:31.811 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:32.749 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:32.749 02:43:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:32.749 02:43:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:32.749 02:43:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:32.749 02:43:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:32.749 02:43:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:32.749 02:43:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:32.749 02:43:57 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:32.749 02:43:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:32.749 02:43:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:32.749 02:43:57 -- common/autotest_common.sh@10 -- # set +x 00:32:32.749 02:43:57 -- nvmf/common.sh@469 -- # nvmfpid=2223855 00:32:32.749 02:43:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:32.749 02:43:57 -- nvmf/common.sh@470 -- # waitforlisten 2223855 00:32:32.749 02:43:57 -- common/autotest_common.sh@829 -- # '[' -z 2223855 ']' 00:32:32.749 02:43:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:32.749 02:43:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:32.749 02:43:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:32.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:32.749 02:43:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:32.749 02:43:57 -- common/autotest_common.sh@10 -- # set +x 00:32:32.749 [2024-11-27 02:43:57.327432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:32.749 [2024-11-27 02:43:57.327514] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:32.749 EAL: No free 2048 kB hugepages reported on node 1 00:32:33.007 [2024-11-27 02:43:57.390421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:33.007 [2024-11-27 02:43:57.481763] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:33.007 [2024-11-27 02:43:57.481915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:33.007 [2024-11-27 02:43:57.481932] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:33.007 [2024-11-27 02:43:57.481944] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:33.007 [2024-11-27 02:43:57.482014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:33.007 [2024-11-27 02:43:57.482075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:33.007 [2024-11-27 02:43:57.482141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:33.007 [2024-11-27 02:43:57.482143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:33.940 02:43:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:33.940 02:43:58 -- common/autotest_common.sh@862 -- # return 0 00:32:33.940 02:43:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:33.940 02:43:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:33.940 02:43:58 -- common/autotest_common.sh@10 -- # set +x 00:32:33.940 02:43:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:33.940 02:43:58 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:33.940 02:43:58 -- scripts/common.sh@312 -- # local nvmes 00:32:33.940 02:43:58 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:33.940 02:43:58 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:33.940 02:43:58 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:33.940 02:43:58 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:33.940 02:43:58 -- scripts/common.sh@322 -- # uname -s 00:32:33.940 02:43:58 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:33.940 02:43:58 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:33.940 02:43:58 -- scripts/common.sh@327 -- # (( 1 )) 00:32:33.940 02:43:58 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:33.940 02:43:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:33.940 02:43:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:33.940 02:43:58 -- common/autotest_common.sh@10 -- # set +x 00:32:33.940 ************************************ 00:32:33.940 START TEST spdk_target_abort 00:32:33.940 ************************************ 00:32:33.940 02:43:58 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:33.940 02:43:58 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:33.940 02:43:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:33.940 02:43:58 -- common/autotest_common.sh@10 -- # set +x 00:32:37.216 spdk_targetn1 00:32:37.216 02:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:37.216 02:44:01 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:37.216 02:44:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:37.216 02:44:01 -- common/autotest_common.sh@10 -- # set +x 00:32:37.216 [2024-11-27 02:44:01.178111] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:37.216 02:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:37.216 02:44:01 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:37.216 02:44:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:37.216 02:44:01 -- common/autotest_common.sh@10 -- # set +x 00:32:37.216 02:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:37.216 02:44:01 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:37.217 02:44:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:37.217 02:44:01 -- common/autotest_common.sh@10 -- # set +x 00:32:37.217 02:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:37.217 02:44:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:37.217 02:44:01 -- common/autotest_common.sh@10 -- # set +x 00:32:37.217 [2024-11-27 02:44:01.210358] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:37.217 02:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:37.217 02:44:01 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:37.217 EAL: No free 2048 kB hugepages reported on node 1 00:32:40.561 Initializing NVMe Controllers 00:32:40.561 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:40.561 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:40.561 Initialization complete. Launching workers. 00:32:40.561 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13147, failed: 0 00:32:40.561 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1288, failed to submit 11859 00:32:40.561 success 771, unsuccess 517, failed 0 00:32:40.561 02:44:04 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:40.561 02:44:04 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:40.561 EAL: No free 2048 kB hugepages reported on node 1 00:32:43.840 [2024-11-27 02:44:07.736590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.736648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.736664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.736676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.736687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.736699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17b0fb0 is same with the state(5) to be set 00:32:43.840 [2024-11-27 02:44:07.837151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbb60 is same with the state(5) to be set 00:32:43.840 Initializing NVMe Controllers 00:32:43.840 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:43.840 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:43.840 Initialization complete. Launching workers. 00:32:43.840 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8614, failed: 0 00:32:43.840 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1235, failed to submit 7379 00:32:43.840 success 349, unsuccess 886, failed 0 00:32:43.840 02:44:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:43.840 02:44:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:43.840 EAL: No free 2048 kB hugepages reported on node 1 00:32:47.116 Initializing NVMe Controllers 00:32:47.117 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:47.117 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:47.117 Initialization complete. Launching workers. 00:32:47.117 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30733, failed: 0 00:32:47.117 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2640, failed to submit 28093 00:32:47.117 success 547, unsuccess 2093, failed 0 00:32:47.117 02:44:11 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:47.117 02:44:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:47.117 02:44:11 -- common/autotest_common.sh@10 -- # set +x 00:32:47.117 02:44:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:47.117 02:44:11 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:47.117 02:44:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:47.117 02:44:11 -- common/autotest_common.sh@10 -- # set +x 00:32:48.049 02:44:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:48.049 02:44:12 -- target/abort_qd_sizes.sh@62 -- # killprocess 2223855 00:32:48.049 02:44:12 -- common/autotest_common.sh@936 -- # '[' -z 2223855 ']' 00:32:48.050 02:44:12 -- common/autotest_common.sh@940 -- # kill -0 2223855 00:32:48.050 02:44:12 -- common/autotest_common.sh@941 -- # uname 00:32:48.050 02:44:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:48.050 02:44:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2223855 00:32:48.050 02:44:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:48.050 02:44:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:48.050 02:44:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2223855' 00:32:48.050 killing process with pid 2223855 00:32:48.050 02:44:12 -- common/autotest_common.sh@955 -- # kill 2223855 00:32:48.050 02:44:12 -- common/autotest_common.sh@960 -- # wait 2223855 00:32:48.308 00:32:48.308 real 0m14.503s 00:32:48.308 user 0m57.437s 00:32:48.308 sys 0m2.627s 00:32:48.308 02:44:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:48.308 02:44:12 -- common/autotest_common.sh@10 -- # set +x 00:32:48.308 ************************************ 00:32:48.308 END TEST spdk_target_abort 00:32:48.308 ************************************ 00:32:48.308 02:44:12 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:48.308 02:44:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:48.308 02:44:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:48.308 02:44:12 -- common/autotest_common.sh@10 -- # set +x 00:32:48.308 ************************************ 00:32:48.308 START TEST kernel_target_abort 00:32:48.308 ************************************ 00:32:48.308 02:44:12 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:48.308 02:44:12 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:48.308 02:44:12 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:48.308 02:44:12 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:48.308 02:44:12 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:48.308 02:44:12 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:48.308 02:44:12 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:48.308 02:44:12 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:48.308 02:44:12 -- nvmf/common.sh@627 -- # local block nvme 00:32:48.308 02:44:12 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:48.308 02:44:12 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:48.308 02:44:12 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:48.308 02:44:12 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:49.683 Waiting for block devices as requested 00:32:49.683 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:49.683 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:49.941 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:49.941 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:49.941 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:49.941 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:50.200 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:50.200 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:50.200 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:50.200 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:50.459 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:50.459 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:50.459 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:50.459 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:50.718 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:50.718 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:50.718 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:50.977 02:44:15 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:50.977 02:44:15 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:50.977 02:44:15 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:50.977 02:44:15 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:50.977 02:44:15 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:50.977 No valid GPT data, bailing 00:32:50.977 02:44:15 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:50.977 02:44:15 -- scripts/common.sh@393 -- # pt= 00:32:50.977 02:44:15 -- scripts/common.sh@394 -- # return 1 00:32:50.977 02:44:15 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:50.977 02:44:15 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:50.977 02:44:15 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:50.977 02:44:15 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:50.977 02:44:15 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:50.977 02:44:15 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:50.977 02:44:15 -- nvmf/common.sh@654 -- # echo 1 00:32:50.977 02:44:15 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:50.977 02:44:15 -- nvmf/common.sh@656 -- # echo 1 00:32:50.977 02:44:15 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:50.977 02:44:15 -- nvmf/common.sh@663 -- # echo tcp 00:32:50.977 02:44:15 -- nvmf/common.sh@664 -- # echo 4420 00:32:50.977 02:44:15 -- nvmf/common.sh@665 -- # echo ipv4 00:32:50.977 02:44:15 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:50.977 02:44:15 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:50.977 00:32:50.977 Discovery Log Number of Records 2, Generation counter 2 00:32:50.977 =====Discovery Log Entry 0====== 00:32:50.977 trtype: tcp 00:32:50.977 adrfam: ipv4 00:32:50.977 subtype: current discovery subsystem 00:32:50.977 treq: not specified, sq flow control disable supported 00:32:50.977 portid: 1 00:32:50.977 trsvcid: 4420 00:32:50.977 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:50.977 traddr: 10.0.0.1 00:32:50.977 eflags: none 00:32:50.977 sectype: none 00:32:50.977 =====Discovery Log Entry 1====== 00:32:50.977 trtype: tcp 00:32:50.977 adrfam: ipv4 00:32:50.977 subtype: nvme subsystem 00:32:50.977 treq: not specified, sq flow control disable supported 00:32:50.977 portid: 1 00:32:50.977 trsvcid: 4420 00:32:50.977 subnqn: kernel_target 00:32:50.977 traddr: 10.0.0.1 00:32:50.977 eflags: none 00:32:50.977 sectype: none 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:50.977 02:44:15 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:51.235 EAL: No free 2048 kB hugepages reported on node 1 00:32:54.516 Initializing NVMe Controllers 00:32:54.516 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:54.516 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:54.516 Initialization complete. Launching workers. 00:32:54.516 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 48419, failed: 0 00:32:54.516 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 48419, failed to submit 0 00:32:54.516 success 0, unsuccess 48419, failed 0 00:32:54.516 02:44:18 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:54.516 02:44:18 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:54.516 EAL: No free 2048 kB hugepages reported on node 1 00:32:57.797 Initializing NVMe Controllers 00:32:57.797 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:57.797 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:57.797 Initialization complete. Launching workers. 00:32:57.797 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 82135, failed: 0 00:32:57.797 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20710, failed to submit 61425 00:32:57.797 success 0, unsuccess 20710, failed 0 00:32:57.797 02:44:21 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:57.797 02:44:21 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:57.797 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.326 Initializing NVMe Controllers 00:33:00.326 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:00.326 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:00.326 Initialization complete. Launching workers. 00:33:00.326 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 80171, failed: 0 00:33:00.326 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20022, failed to submit 60149 00:33:00.326 success 0, unsuccess 20022, failed 0 00:33:00.326 02:44:24 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:00.326 02:44:24 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:00.326 02:44:24 -- nvmf/common.sh@677 -- # echo 0 00:33:00.326 02:44:24 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:00.326 02:44:24 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:00.326 02:44:24 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:00.326 02:44:24 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:00.326 02:44:24 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:00.326 02:44:24 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:00.585 00:33:00.585 real 0m12.102s 00:33:00.585 user 0m5.982s 00:33:00.585 sys 0m2.381s 00:33:00.585 02:44:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:00.585 02:44:24 -- common/autotest_common.sh@10 -- # set +x 00:33:00.585 ************************************ 00:33:00.585 END TEST kernel_target_abort 00:33:00.585 ************************************ 00:33:00.585 02:44:24 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:00.585 02:44:24 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:00.585 02:44:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:00.585 02:44:24 -- nvmf/common.sh@116 -- # sync 00:33:00.585 02:44:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:00.585 02:44:24 -- nvmf/common.sh@119 -- # set +e 00:33:00.585 02:44:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:00.585 02:44:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:00.585 rmmod nvme_tcp 00:33:00.585 rmmod nvme_fabrics 00:33:00.585 rmmod nvme_keyring 00:33:00.585 02:44:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:00.585 02:44:25 -- nvmf/common.sh@123 -- # set -e 00:33:00.585 02:44:25 -- nvmf/common.sh@124 -- # return 0 00:33:00.585 02:44:25 -- nvmf/common.sh@477 -- # '[' -n 2223855 ']' 00:33:00.585 02:44:25 -- nvmf/common.sh@478 -- # killprocess 2223855 00:33:00.585 02:44:25 -- common/autotest_common.sh@936 -- # '[' -z 2223855 ']' 00:33:00.585 02:44:25 -- common/autotest_common.sh@940 -- # kill -0 2223855 00:33:00.585 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2223855) - No such process 00:33:00.585 02:44:25 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2223855 is not found' 00:33:00.585 Process with pid 2223855 is not found 00:33:00.585 02:44:25 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:00.585 02:44:25 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:01.520 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:01.520 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:01.779 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:01.779 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:01.779 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:01.780 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:01.780 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:01.780 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:01.780 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:01.780 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:01.780 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:01.780 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:01.780 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:01.780 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:01.780 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:01.780 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:01.780 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:02.039 02:44:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:02.039 02:44:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:02.039 02:44:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:02.039 02:44:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:02.039 02:44:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:02.039 02:44:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:02.039 02:44:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:03.940 02:44:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:03.940 00:33:03.940 real 0m35.706s 00:33:03.940 user 1m5.761s 00:33:03.940 sys 0m8.360s 00:33:03.940 02:44:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:03.940 02:44:28 -- common/autotest_common.sh@10 -- # set +x 00:33:03.940 ************************************ 00:33:03.940 END TEST nvmf_abort_qd_sizes 00:33:03.940 ************************************ 00:33:03.940 02:44:28 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:03.940 02:44:28 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:03.940 02:44:28 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:03.940 02:44:28 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:03.940 02:44:28 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:03.940 02:44:28 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:03.940 02:44:28 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:03.940 02:44:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:03.940 02:44:28 -- common/autotest_common.sh@10 -- # set +x 00:33:03.940 02:44:28 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:03.940 02:44:28 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:03.940 02:44:28 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:03.940 02:44:28 -- common/autotest_common.sh@10 -- # set +x 00:33:05.842 INFO: APP EXITING 00:33:05.842 INFO: killing all VMs 00:33:05.842 INFO: killing vhost app 00:33:05.842 INFO: EXIT DONE 00:33:06.779 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:06.779 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:06.779 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:06.779 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:06.779 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:06.779 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:07.036 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:07.036 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.036 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:07.036 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:07.036 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:07.036 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:07.036 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:07.036 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:07.036 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:07.036 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.036 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:08.411 Cleaning 00:33:08.411 Removing: /var/run/dpdk/spdk0/config 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:08.411 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:08.411 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:08.411 Removing: /var/run/dpdk/spdk1/config 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:08.411 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:08.411 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:08.411 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:08.411 Removing: /var/run/dpdk/spdk2/config 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:08.411 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:08.411 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:08.411 Removing: /var/run/dpdk/spdk3/config 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:08.411 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:08.411 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:08.411 Removing: /var/run/dpdk/spdk4/config 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:08.411 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:08.411 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:08.411 Removing: /dev/shm/bdev_svc_trace.1 00:33:08.411 Removing: /dev/shm/nvmf_trace.0 00:33:08.411 Removing: /dev/shm/spdk_tgt_trace.pid1944201 00:33:08.411 Removing: /var/run/dpdk/spdk0 00:33:08.411 Removing: /var/run/dpdk/spdk1 00:33:08.411 Removing: /var/run/dpdk/spdk2 00:33:08.411 Removing: /var/run/dpdk/spdk3 00:33:08.411 Removing: /var/run/dpdk/spdk4 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1942477 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1943273 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1944201 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1944698 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1946045 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1946994 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1947313 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1947521 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1947865 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1948075 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1948263 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1948510 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1948699 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1949165 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1951725 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1952017 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1952199 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1952340 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1952747 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1952787 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1953222 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1953417 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1953649 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1953789 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1953959 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1954101 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1954841 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955161 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955465 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955642 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955683 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955848 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1955995 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1956152 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1956412 00:33:08.411 Removing: /var/run/dpdk/spdk_pid1956571 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1956716 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1956877 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1957139 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1957310 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1957457 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1957610 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1957878 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958037 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958176 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958337 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958599 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958769 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1958908 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1959063 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1959328 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1959486 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1959635 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1959790 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960032 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960213 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960356 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960517 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960692 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1960931 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961082 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961236 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961387 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961658 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961807 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1961969 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1962170 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1962397 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1962543 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1962696 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1962960 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1963120 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1963245 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1963532 00:33:08.670 Removing: /var/run/dpdk/spdk_pid1965630 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2023067 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2025732 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2032850 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2036202 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2038604 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2039129 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2043031 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2043037 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2043710 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2044501 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2045554 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2045974 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2046098 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2046244 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2046387 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2046390 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2047062 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2047623 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2048298 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2048705 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2048708 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2048981 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2050025 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2050782 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2056408 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2056696 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2059381 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2063285 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2065529 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2072166 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2078309 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2079550 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2080236 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2090870 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2093125 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2096082 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2097225 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2098666 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2098815 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2098958 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2099113 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2099702 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2101167 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2102096 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2102541 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2106166 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2109791 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2114021 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2137702 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2141040 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2145010 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2146109 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2147225 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2149887 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2152341 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2156743 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2156854 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2159692 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2159949 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2160094 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2160367 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2160375 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2161480 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2162720 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2163924 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2165206 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2166479 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2167702 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2171724 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2172323 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2173991 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2174754 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2178666 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2180708 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2184326 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2187961 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2191632 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2192056 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2192591 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2193013 00:33:08.670 Removing: /var/run/dpdk/spdk_pid2193601 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2194162 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2194688 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2195145 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2197826 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2198091 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2201955 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2202142 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2204382 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2209691 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2209702 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2212770 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2214209 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2215654 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2216484 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2217996 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2218783 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2224296 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2224704 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2225108 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2226714 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2227001 00:33:08.928 Removing: /var/run/dpdk/spdk_pid2227410 00:33:08.928 Clean 00:33:08.928 killing process with pid 1914650 00:33:17.040 killing process with pid 1914647 00:33:17.299 killing process with pid 1914649 00:33:17.299 killing process with pid 1914648 00:33:17.299 02:44:41 -- common/autotest_common.sh@1446 -- # return 0 00:33:17.299 02:44:41 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:17.299 02:44:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:17.299 02:44:41 -- common/autotest_common.sh@10 -- # set +x 00:33:17.299 02:44:41 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:17.299 02:44:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:17.299 02:44:41 -- common/autotest_common.sh@10 -- # set +x 00:33:17.557 02:44:41 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:17.557 02:44:41 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:17.557 02:44:41 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:17.557 02:44:41 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:17.557 02:44:41 -- spdk/autotest.sh@383 -- # hostname 00:33:17.557 02:44:41 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:17.557 geninfo: WARNING: invalid characters removed from testname! 00:33:49.619 02:45:09 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:49.620 02:45:13 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:52.211 02:45:16 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:54.742 02:45:19 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:57.269 02:45:21 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:00.549 02:45:24 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:03.078 02:45:27 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:03.078 02:45:27 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:03.078 02:45:27 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:03.078 02:45:27 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:03.078 02:45:27 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:03.078 02:45:27 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:03.078 02:45:27 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:03.078 02:45:27 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:03.078 02:45:27 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:03.078 02:45:27 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:03.078 02:45:27 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:03.078 02:45:27 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:03.078 02:45:27 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:03.078 02:45:27 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:03.078 02:45:27 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:03.078 02:45:27 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:03.078 02:45:27 -- scripts/common.sh@343 -- $ case "$op" in 00:34:03.078 02:45:27 -- scripts/common.sh@344 -- $ : 1 00:34:03.078 02:45:27 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:03.078 02:45:27 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:03.078 02:45:27 -- scripts/common.sh@364 -- $ decimal 1 00:34:03.078 02:45:27 -- scripts/common.sh@352 -- $ local d=1 00:34:03.078 02:45:27 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:03.078 02:45:27 -- scripts/common.sh@354 -- $ echo 1 00:34:03.078 02:45:27 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:03.078 02:45:27 -- scripts/common.sh@365 -- $ decimal 2 00:34:03.078 02:45:27 -- scripts/common.sh@352 -- $ local d=2 00:34:03.078 02:45:27 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:03.078 02:45:27 -- scripts/common.sh@354 -- $ echo 2 00:34:03.078 02:45:27 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:03.078 02:45:27 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:03.078 02:45:27 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:03.078 02:45:27 -- scripts/common.sh@367 -- $ return 0 00:34:03.078 02:45:27 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:03.078 02:45:27 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:03.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.078 --rc genhtml_branch_coverage=1 00:34:03.078 --rc genhtml_function_coverage=1 00:34:03.078 --rc genhtml_legend=1 00:34:03.078 --rc geninfo_all_blocks=1 00:34:03.078 --rc geninfo_unexecuted_blocks=1 00:34:03.078 00:34:03.078 ' 00:34:03.078 02:45:27 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:03.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.078 --rc genhtml_branch_coverage=1 00:34:03.078 --rc genhtml_function_coverage=1 00:34:03.078 --rc genhtml_legend=1 00:34:03.078 --rc geninfo_all_blocks=1 00:34:03.078 --rc geninfo_unexecuted_blocks=1 00:34:03.078 00:34:03.078 ' 00:34:03.078 02:45:27 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:03.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.078 --rc genhtml_branch_coverage=1 00:34:03.078 --rc genhtml_function_coverage=1 00:34:03.078 --rc genhtml_legend=1 00:34:03.078 --rc geninfo_all_blocks=1 00:34:03.078 --rc geninfo_unexecuted_blocks=1 00:34:03.078 00:34:03.078 ' 00:34:03.078 02:45:27 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:03.078 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:03.078 --rc genhtml_branch_coverage=1 00:34:03.078 --rc genhtml_function_coverage=1 00:34:03.078 --rc genhtml_legend=1 00:34:03.078 --rc geninfo_all_blocks=1 00:34:03.078 --rc geninfo_unexecuted_blocks=1 00:34:03.078 00:34:03.078 ' 00:34:03.078 02:45:27 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:03.078 02:45:27 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:03.078 02:45:27 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:03.078 02:45:27 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:03.078 02:45:27 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.078 02:45:27 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.078 02:45:27 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.078 02:45:27 -- paths/export.sh@5 -- $ export PATH 00:34:03.078 02:45:27 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:03.078 02:45:27 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:03.078 02:45:27 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:03.078 02:45:27 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732671927.XXXXXX 00:34:03.078 02:45:27 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732671927.hD8QKJ 00:34:03.078 02:45:27 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:03.078 02:45:27 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:34:03.078 02:45:27 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:03.078 02:45:27 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:03.078 02:45:27 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:03.078 02:45:27 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:03.078 02:45:27 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:03.078 02:45:27 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:03.078 02:45:27 -- common/autotest_common.sh@10 -- $ set +x 00:34:03.078 02:45:27 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:03.078 02:45:27 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:03.078 02:45:27 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:03.078 02:45:27 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:03.078 02:45:27 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:03.078 02:45:27 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:03.078 02:45:27 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:03.078 02:45:27 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:03.078 02:45:27 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:03.078 02:45:27 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:03.078 02:45:27 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:03.078 + [[ -n 1859851 ]] 00:34:03.078 + sudo kill 1859851 00:34:03.086 [Pipeline] } 00:34:03.101 [Pipeline] // stage 00:34:03.106 [Pipeline] } 00:34:03.117 [Pipeline] // timeout 00:34:03.120 [Pipeline] } 00:34:03.131 [Pipeline] // catchError 00:34:03.133 [Pipeline] } 00:34:03.145 [Pipeline] // wrap 00:34:03.148 [Pipeline] } 00:34:03.158 [Pipeline] // catchError 00:34:03.164 [Pipeline] stage 00:34:03.166 [Pipeline] { (Epilogue) 00:34:03.175 [Pipeline] catchError 00:34:03.177 [Pipeline] { 00:34:03.187 [Pipeline] echo 00:34:03.188 Cleanup processes 00:34:03.193 [Pipeline] sh 00:34:03.473 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:03.473 2240445 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:03.487 [Pipeline] sh 00:34:03.766 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:03.766 ++ awk '{print $1}' 00:34:03.766 ++ grep -v 'sudo pgrep' 00:34:03.766 + sudo kill -9 00:34:03.766 + true 00:34:03.777 [Pipeline] sh 00:34:04.057 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:14.036 [Pipeline] sh 00:34:14.317 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:14.317 Artifacts sizes are good 00:34:14.331 [Pipeline] archiveArtifacts 00:34:14.338 Archiving artifacts 00:34:14.487 [Pipeline] sh 00:34:14.780 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:14.789 [Pipeline] cleanWs 00:34:14.796 [WS-CLEANUP] Deleting project workspace... 00:34:14.796 [WS-CLEANUP] Deferred wipeout is used... 00:34:14.800 [WS-CLEANUP] done 00:34:14.801 [Pipeline] } 00:34:14.811 [Pipeline] // catchError 00:34:14.819 [Pipeline] sh 00:34:15.098 + logger -p user.info -t JENKINS-CI 00:34:15.108 [Pipeline] } 00:34:15.120 [Pipeline] // stage 00:34:15.125 [Pipeline] } 00:34:15.137 [Pipeline] // node 00:34:15.141 [Pipeline] End of Pipeline 00:34:15.181 Finished: SUCCESS